[2025-09-17T01:44:05.194347] [INFO ] [MAIN ] Using last completed trading day: 2025-09-16 [2025-09-17T01:44:05.194662] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-17T01:44:05.194781] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-17T01:44:05.194835] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-17T01:44:06.758118] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-09-17T01:44:06.758406] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-17T01:44:06.758678] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-17T01:44:06.759349] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-09-17T01:44:06.759414] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-17T01:44:06.759453] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-17T01:44:06.759529] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-17T01:44:06.759723] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-17T01:44:06.760105] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-17T01:44:06.760158] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-17T01:44:06.760350] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-17T01:44:06.760412] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-09-17T01:44:06.760474] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-17T01:44:06.760535] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-17T01:44:06.786361] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-17T01:44:06.812560] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-17T01:44:06.812942] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-17T01:44:06.813005] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-17T01:44:06.813050] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-17T01:44:06.813497] [WARN ] [STATE ] State set to: RUNNING [2025-09-17T01:44:06.813683] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-17T01:44:06.814099] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-17T01:44:06.814151] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-17T01:44:06.814190] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-09-17T01:44:06.814226] [INFO ] [MAIN ] Running in parallel mode [2025-09-17T01:44:06.814526] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-09-17T01:44:07.336805] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.428274] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.565199] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.567753] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.567987] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-17T01:44:07.568740] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-17T01:44:07.569114] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-17T01:44:07.569195] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-17T01:44:07.570683] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-17T01:44:07.575681] [DEBUG] [LOCAL ] AACT: Loaded 8064 existing records from primary storage. [2025-09-17T01:44:07.575287] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-17T01:44:07.575885] [INFO ] [MAIN ] AACT: Loaded 8064 existing records. [2025-09-17T01:44:07.891936] [DEBUG] [LOCAL ] A: Loaded 37747 existing records from primary storage. [2025-09-17T01:44:07.914896] [INFO ] [MAIN ] A: Loaded 37747 existing records. [2025-09-17T01:44:07.941945] [WARN ] [MAIN ] AACT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:08.004499] [DEBUG] [LOCAL ] AA: Loaded 39972 existing records from primary storage. [2025-09-17T01:44:08.064928] [INFO ] [MAIN ] AA: Loaded 39972 existing records. [2025-09-17T01:44:08.010117] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-17T01:44:08.094191] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-17T01:44:08.152099] [DEBUG] [LOCAL ] AACT: Deleted primary data file. [2025-09-17T01:44:08.211218] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-17T01:44:08.420886] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:08.438971] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-17T01:44:08.546954] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-17T01:44:08.669256] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-17T01:44:08.673101] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-17T01:44:08.667450] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:08.673041] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:08.689999] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-11. [2025-09-17T01:44:08.695708] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-17T01:44:08.758559] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-17T01:44:08.850449] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-17T01:44:08.865416] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-17T01:44:09.440314] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:09.469134] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-11. [2025-09-17T01:44:09.576480] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:09.582491] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T01:44:09.593118] [INFO ] [REMOTE ] A: Fetching primary data for 2024-11. [2025-09-17T01:44:09.633408] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-17T01:44:09.662126] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:09.663090] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-11. [2025-09-17T01:44:10.007722] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-17T01:44:10.008873] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-17T01:44:10.107971] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T01:44:10.109688] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-17T01:44:10.355864] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T01:44:10.356908] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-17T01:44:10.617737] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-17T01:44:10.618771] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-17T01:44:10.708273] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T01:44:10.709356] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-17T01:44:10.967759] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T01:44:10.968786] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-17T01:44:10.984700] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-17T01:44:10.985833] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-17T01:44:11.346400] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T01:44:11.347441] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-17T01:44:11.434355] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T01:44:11.444530] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-17T01:44:11.508371] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T01:44:11.509450] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-17T01:44:11.558385] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T01:44:11.569101] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-17T01:44:11.646991] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-17T01:44:11.647900] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-17T01:44:11.907227] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-17T01:44:11.908141] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-17T01:44:11.923539] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T01:44:11.925036] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-17T01:44:12.155618] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-17T01:44:12.156566] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-17T01:44:12.432478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T01:44:12.433543] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-17T01:44:12.747735] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T01:44:12.750554] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-17T01:44:13.124238] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:44:13.125206] [INFO ] [REMOTE ] AAM: Full fetch complete (1044 records). [2025-09-17T01:44:13.125315] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-17T01:44:13.325507] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-17T01:44:13.325912] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:13.325976] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:13.326080] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-17T01:44:13.326207] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-17T01:44:13.326276] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-17T01:44:13.326353] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-17T01:44:13.326451] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAM took 6.4s. Estimated remaining: 4h 17m 1s. Rate: 9.2 symbols/min [2025-09-17T01:44:13.470709] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T01:44:13.531442] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-17T01:44:13.558890] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T01:44:13.557882] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:13.563379] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-17T01:44:13.563514] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-17T01:44:13.564629] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-17T01:44:13.564908] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-17T01:44:13.565080] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-17T01:44:13.565321] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-17T01:44:13.565490] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-17T01:44:13.879079] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T01:44:13.927533] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-17T01:44:13.992768] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:13.993179] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-11. [2025-09-17T01:44:14.191619] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T01:44:14.198735] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-17T01:44:14.207279] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:14.207677] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-11 [2025-09-17T01:44:14.208158] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-17T01:44:14.438037] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:14.438383] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-17T01:44:14.438870] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-17T01:44:15.066119] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T01:44:15.069116] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-17T01:44:15.267527] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T01:44:15.278062] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-17T01:44:15.474449] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T01:44:15.478317] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-17T01:44:16.061166] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T01:44:16.072237] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-17T01:44:16.093608] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T01:44:16.096747] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-17T01:44:16.297604] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T01:44:16.303333] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-17T01:44:17.036099] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T01:44:17.036302] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T01:44:17.048776] [INFO ] [REMOTE ] AACT: Full fetch complete (10140 records). [2025-09-17T01:44:17.048878] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-17T01:44:17.080932] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-17T01:44:17.236490] [WARN ] [VALIDATOR ] AACT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T01:44:17.236784] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:17.236861] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:17.236912] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-17T01:44:17.236977] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-17T01:44:17.237019] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-17T01:44:17.237273] [DEBUG] [LOCAL ] AACT: Deleted derivative data file. [2025-09-17T01:44:17.237403] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AACT took 10.4s. Estimated remaining: 3h 25m 36s. Rate: 11.5 symbols/min [2025-09-17T01:44:17.407297] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:17.421200] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T01:44:17.426413] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-17T01:44:17.465324] [DEBUG] [LOCAL ] AAP: Loaded 38811 existing records from primary storage. [2025-09-17T01:44:17.465485] [INFO ] [MAIN ] AAP: Loaded 38811 existing records. [2025-09-17T01:44:17.643699] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:17.643944] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-17T01:44:17.644005] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-17T01:44:17.645130] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-17T01:44:17.645195] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-17T01:44:18.033687] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:18.034058] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-11. [2025-09-17T01:44:18.065191] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T01:44:18.075502] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-17T01:44:18.567882] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T01:44:18.574227] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-17T01:44:18.688212] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:44:18.698774] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-17T01:44:19.689862] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:44:19.701724] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-17T01:44:19.739828] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T01:44:19.745679] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-17T01:44:19.906822] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T01:44:19.917278] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-17T01:44:20.159323] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T01:44:20.170223] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-17T01:44:20.650759] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T01:44:20.656145] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-17T01:44:21.309812] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:44:21.320731] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-17T01:44:21.479674] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T01:44:21.485834] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-17T01:44:21.689890] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T01:44:21.701991] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-17T01:44:21.930359] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T01:44:21.942887] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-17T01:44:22.621690] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T01:44:22.627223] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-17T01:44:22.767561] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T01:44:22.777907] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-17T01:44:23.010732] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T01:44:23.021711] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-17T01:44:23.754844] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T01:44:23.760749] [INFO ] [REMOTE ] AAMI: Full fetch complete (29371 records). [2025-09-17T01:44:23.761171] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-17T01:44:23.993590] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-09-17T01:44:23.994074] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:23.994215] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:23.994375] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-17T01:44:23.994528] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-17T01:44:23.994631] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-17T01:44:23.994719] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-17T01:44:23.994856] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. AAMI took 10.7s. Estimated remaining: 3h 45m 50s. Rate: 10.5 symbols/min [2025-09-17T01:44:24.204790] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:24.207909] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T01:44:24.221534] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-17T01:44:24.250919] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T01:44:24.261732] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-17T01:44:24.279725] [DEBUG] [LOCAL ] AAT: Loaded 22530 existing records from primary storage. [2025-09-17T01:44:24.279985] [INFO ] [MAIN ] AAT: Loaded 22530 existing records. [2025-09-17T01:44:24.460313] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:24.460574] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-17T01:44:24.460848] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-17T01:44:24.461772] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-17T01:44:24.461839] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-17T01:44:24.850378] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:24.850999] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-11. [2025-09-17T01:44:24.852485] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:44:24.865569] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-17T01:44:26.076887] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T01:44:26.082107] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-17T01:44:26.125812] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T01:44:26.137490] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-17T01:44:26.195437] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T01:44:26.206823] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-17T01:44:26.407748] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T01:44:26.418623] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-17T01:44:27.029694] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T01:44:27.035607] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-17T01:44:27.970104] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:44:27.982153] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-17T01:44:28.056600] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T01:44:28.068247] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-17T01:44:28.139603] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T01:44:28.161696] [INFO ] [REMOTE ] A: Full fetch complete (72976 records). [2025-09-17T01:44:28.162740] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T01:44:28.162817] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-17T01:44:28.212882] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-17T01:44:28.564359] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-17T01:44:28.564464] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-17T01:44:28.565168] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-17T01:44:28.565251] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-17T01:44:28.566756] [DEBUG] [LOCAL ] A: Trimmed 72976 records to 50850 (keeping 200 days of data) [2025-09-17T01:44:28.899160] [DEBUG] [LOCAL ] A: Primary data saved (50850 records). [2025-09-17T01:44:28.899352] [INFO ] [MAIN ] A: Full history saved. [2025-09-17T01:44:28.899787] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. A took 22.1s. Estimated remaining: 3h 37m 38s. Rate: 10.9 symbols/min [2025-09-17T01:44:29.073755] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:29.073969] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-17T01:44:29.074021] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-17T01:44:29.074136] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-17T01:44:29.074190] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-17T01:44:29.074241] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-17T01:44:29.074316] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-17T01:44:29.447411] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:29.447766] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-11. [2025-09-17T01:44:29.490899] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T01:44:29.496874] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-17T01:44:29.669055] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:29.669364] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-11 [2025-09-17T01:44:29.669822] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-17T01:44:29.737492] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T01:44:29.749548] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-17T01:44:29.817310] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T01:44:29.828364] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-17T01:44:29.875457] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:29.875841] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-17T01:44:29.876338] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-17T01:44:30.107307] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.107662] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-17T01:44:30.108084] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-17T01:44:30.336578] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.337000] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-17T01:44:30.337483] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-17T01:44:30.549572] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.549953] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-17T01:44:30.550398] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-17T01:44:30.779704] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.782814] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-17T01:44:30.783850] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T01:44:30.784142] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-17T01:44:30.791802] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-17T01:44:31.016193] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:31.016529] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-17T01:44:31.017000] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-17T01:44:31.500674] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T01:44:31.509914] [INFO ] [REMOTE ] AA: Full fetch complete (77366 records). [2025-09-17T01:44:31.510130] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-17T01:44:31.828335] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T01:44:31.831083] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-17T01:44:31.932753] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-17T01:44:31.932978] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-17T01:44:31.933818] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-17T01:44:31.933894] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-17T01:44:31.935835] [DEBUG] [LOCAL ] AA: Trimmed 77366 records to 53585 (keeping 200 days of data) [2025-09-17T01:44:32.107344] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-17T01:44:32.145431] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-17T01:44:32.324239] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T01:44:32.343046] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-17T01:44:32.491234] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T01:44:32.514213] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-17T01:44:32.525379] [DEBUG] [LOCAL ] AA: Primary data saved (53585 records). [2025-09-17T01:44:32.525728] [INFO ] [MAIN ] AA: Full history saved. [2025-09-17T01:44:32.526183] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AA took 25.7s. Estimated remaining: 3h 22m 37s. Rate: 11.7 symbols/min [2025-09-17T01:44:32.793235] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:32.822844] [DEBUG] [LOCAL ] AB: Loaded 17872 existing records from primary storage. [2025-09-17T01:44:32.823116] [INFO ] [MAIN ] AB: Loaded 17872 existing records. [2025-09-17T01:44:33.095410] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:33.095795] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-17T01:44:33.095891] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-17T01:44:33.096481] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-17T01:44:33.096545] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-17T01:44:33.461082] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:33.470892] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-11. [2025-09-17T01:44:33.471834] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T01:44:33.477035] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-17T01:44:34.004883] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T01:44:34.011529] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-17T01:44:34.094752] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T01:44:34.106223] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-17T01:44:34.166836] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:44:34.169335] [INFO ] [REMOTE ] AAUC: Full fetch complete (6523 records). [2025-09-17T01:44:34.169419] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-17T01:44:34.361363] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-17T01:44:34.361623] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:34.361692] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:34.361739] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-17T01:44:34.361801] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-17T01:44:34.361845] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-17T01:44:34.361894] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-17T01:44:34.361958] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAUC took 5.5s. Estimated remaining: 3h 0m 49s. Rate: 13.1 symbols/min [2025-09-17T01:44:34.531794] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:34.553272] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T01:44:34.560242] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-17T01:44:34.594549] [DEBUG] [LOCAL ] ABBV: Loaded 40044 existing records from primary storage. [2025-09-17T01:44:34.594735] [INFO ] [MAIN ] ABBV: Loaded 40044 existing records. [2025-09-17T01:44:34.769271] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:34.769555] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-17T01:44:34.769614] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-17T01:44:34.770611] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-17T01:44:34.770697] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-17T01:44:35.122755] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:35.123111] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-11. [2025-09-17T01:44:35.285599] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T01:44:35.292014] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-17T01:44:35.869512] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T01:44:35.882097] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-17T01:44:36.021486] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T01:44:36.028872] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-17T01:44:36.338628] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T01:44:36.345967] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-17T01:44:37.217780] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:44:37.225834] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-17T01:44:37.342389] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T01:44:37.352634] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-17T01:44:37.431979] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T01:44:37.441415] [INFO ] [REMOTE ] AAP: Full fetch complete (75131 records). [2025-09-17T01:44:37.441576] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-17T01:44:37.835987] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-17T01:44:37.841529] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-17T01:44:37.851812] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-17T01:44:37.852257] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-17T01:44:37.852874] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T01:44:37.859942] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-17T01:44:37.860977] [DEBUG] [LOCAL ] AAP: Trimmed 75131 records to 52202 (keeping 200 days of data) [2025-09-17T01:44:38.181016] [DEBUG] [LOCAL ] AAP: Primary data saved (52202 records). [2025-09-17T01:44:38.181171] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-17T01:44:38.181266] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AAP took 20.9s. Estimated remaining: 2h 56m 24s. Rate: 13.4 symbols/min [2025-09-17T01:44:38.350039] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:38.369765] [DEBUG] [LOCAL ] ABCB: Loaded 21813 existing records from primary storage. [2025-09-17T01:44:38.369907] [INFO ] [MAIN ] ABCB: Loaded 21813 existing records. [2025-09-17T01:44:38.546029] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:38.546274] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-17T01:44:38.546334] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-17T01:44:38.546890] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-17T01:44:38.546950] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-17T01:44:38.902016] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:38.902421] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-11. [2025-09-17T01:44:38.928200] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T01:44:38.937734] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-17T01:44:39.096356] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T01:44:39.100527] [INFO ] [REMOTE ] AAT: Full fetch complete (42467 records). [2025-09-17T01:44:39.100633] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-17T01:44:39.474571] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-17T01:44:39.474798] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-17T01:44:39.475282] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-17T01:44:39.475472] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-17T01:44:39.476688] [DEBUG] [LOCAL ] AAT: Trimmed 42467 records to 30568 (keeping 200 days of data) [2025-09-17T01:44:39.616510] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-17T01:44:39.629932] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-17T01:44:39.713704] [DEBUG] [LOCAL ] AAT: Primary data saved (30568 records). [2025-09-17T01:44:39.713884] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-17T01:44:39.714008] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AAT took 15.7s. Estimated remaining: 2h 41m 50s. Rate: 14.6 symbols/min [2025-09-17T01:44:39.884066] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:39.923262] [DEBUG] [LOCAL ] ABEV: Loaded 39678 existing records from primary storage. [2025-09-17T01:44:39.923428] [INFO ] [MAIN ] ABEV: Loaded 39678 existing records. [2025-09-17T01:44:40.101388] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:40.101710] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-17T01:44:40.101788] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-17T01:44:40.102753] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-17T01:44:40.102833] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-17T01:44:40.470909] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:40.471310] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-11. [2025-09-17T01:44:40.488429] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T01:44:40.494703] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-17T01:44:40.546339] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:44:40.556054] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-17T01:44:41.746613] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T01:44:41.755465] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-17T01:44:41.784068] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T01:44:41.795188] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-17T01:44:41.942112] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T01:44:41.951356] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-17T01:44:42.267166] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T01:44:42.277493] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-17T01:44:43.021549] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T01:44:43.027904] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-17T01:44:43.302870] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T01:44:43.310140] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-17T01:44:43.458548] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T01:44:43.468929] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-17T01:44:43.787459] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T01:44:43.792329] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-17T01:44:44.130055] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T01:44:44.141107] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-17T01:44:44.274816] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T01:44:44.281175] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-17T01:44:44.885546] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T01:44:44.891586] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-17T01:44:45.285164] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T01:44:45.295726] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-17T01:44:45.537381] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T01:44:45.548093] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-17T01:44:45.734740] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T01:44:45.746030] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-17T01:44:45.790356] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T01:44:45.795541] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-17T01:44:46.628357] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T01:44:46.631904] [INFO ] [REMOTE ] AB: Full fetch complete (46288 records). [2025-09-17T01:44:46.632013] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-17T01:44:47.012167] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-17T01:44:47.012362] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-17T01:44:47.013155] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-17T01:44:47.013404] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-17T01:44:47.035160] [DEBUG] [LOCAL ] AB: Trimmed 46288 records to 29296 (keeping 200 days of data) [2025-09-17T01:44:47.036061] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T01:44:47.044583] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-17T01:44:47.221221] [DEBUG] [LOCAL ] AB: Primary data saved (29296 records). [2025-09-17T01:44:47.221397] [INFO ] [MAIN ] AB: Full history saved. [2025-09-17T01:44:47.221494] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. AB took 14.7s. Estimated remaining: 2h 56m 36s. Rate: 13.4 symbols/min [2025-09-17T01:44:47.393237] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:47.420543] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T01:44:47.434554] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-17T01:44:47.440784] [DEBUG] [LOCAL ] ABG: Loaded 12960 existing records from primary storage. [2025-09-17T01:44:47.440895] [INFO ] [MAIN ] ABG: Loaded 12960 existing records. [2025-09-17T01:44:47.621038] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:47.621496] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-17T01:44:47.621626] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-17T01:44:47.622121] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-17T01:44:47.622245] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-17T01:44:48.007995] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:48.012040] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-11. [2025-09-17T01:44:48.015430] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T01:44:48.027479] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-17T01:44:48.142603] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T01:44:48.149536] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-17T01:44:49.084914] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T01:44:49.088908] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-17T01:44:49.273163] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T01:44:49.278833] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-17T01:44:49.369760] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T01:44:49.381162] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-17T01:44:49.834624] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T01:44:49.846109] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-17T01:44:49.949706] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T01:44:49.953125] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-17T01:44:50.700116] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T01:44:50.707472] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-17T01:44:51.111441] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T01:44:51.115923] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-17T01:44:51.291332] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T01:44:51.302675] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-17T01:44:51.617111] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T01:44:51.833201] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T01:44:51.890098] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-17T01:44:52.136256] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T01:44:52.690153] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-17T01:44:53.122303] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T01:44:53.494136] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-17T01:44:53.497408] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T01:44:54.049802] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-17T01:44:54.290087] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-17T01:44:54.639743] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T01:44:54.643620] [INFO ] [REMOTE ] ABCB: Full fetch complete (43851 records). [2025-09-17T01:44:54.643759] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-17T01:44:55.029062] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-17T01:44:55.029206] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-17T01:44:55.029679] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-17T01:44:55.029737] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-17T01:44:55.030791] [DEBUG] [LOCAL ] ABCB: Trimmed 43851 records to 30681 (keeping 200 days of data) [2025-09-17T01:44:55.094481] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-17T01:44:55.217244] [DEBUG] [LOCAL ] ABCB: Primary data saved (30681 records). [2025-09-17T01:44:55.217406] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-17T01:44:55.217501] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABCB took 17.0s. Estimated remaining: 3h 10m 18s. Rate: 12.4 symbols/min [2025-09-17T01:44:55.387373] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:55.409244] [DEBUG] [LOCAL ] ABM: Loaded 23397 existing records from primary storage. [2025-09-17T01:44:55.409393] [INFO ] [MAIN ] ABM: Loaded 23397 existing records. [2025-09-17T01:44:55.587843] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:55.588060] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-17T01:44:55.588110] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-17T01:44:55.588753] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-17T01:44:55.588813] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-17T01:44:55.907859] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-17T01:44:55.946794] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:56.347687] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T01:44:56.381620] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T01:44:56.690161] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-17T01:44:57.490137] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-11. [2025-09-17T01:44:57.667170] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T01:44:57.747779] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T01:44:58.290104] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-17T01:44:58.653914] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T01:44:59.090191] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-17T01:44:59.890190] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-17T01:44:59.994594] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T01:45:00.158978] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T01:45:00.167395] [INFO ] [REMOTE ] ABBV: Full fetch complete (77603 records). [2025-09-17T01:45:00.167618] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-17T01:45:00.573602] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-17T01:45:00.573732] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-17T01:45:00.574482] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-17T01:45:00.574545] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-17T01:45:00.576174] [DEBUG] [LOCAL ] ABBV: Trimmed 77603 records to 53690 (keeping 200 days of data) [2025-09-17T01:45:00.691254] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-17T01:45:00.965951] [DEBUG] [LOCAL ] ABBV: Primary data saved (53690 records). [2025-09-17T01:45:00.966218] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-17T01:45:00.968002] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABBV took 26.6s. Estimated remaining: 3h 13m 29s. Rate: 12.2 symbols/min [2025-09-17T01:45:01.145841] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T01:45:01.163814] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:01.220797] [DEBUG] [LOCAL ] ABR: Loaded 38749 existing records from primary storage. [2025-09-17T01:45:01.220993] [INFO ] [MAIN ] ABR: Loaded 38749 existing records. [2025-09-17T01:45:01.406532] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:01.406827] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-17T01:45:01.406884] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-17T01:45:01.407878] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-17T01:45:01.407950] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-17T01:45:01.495308] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-17T01:45:01.805128] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:01.820329] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T01:45:02.290135] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-17T01:45:03.090185] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-11. [2025-09-17T01:45:03.890131] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-17T01:45:04.230083] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-17T01:45:04.690197] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-17T01:45:05.302169] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-17T01:45:05.490151] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-17T01:45:05.913238] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T01:45:06.154864] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T01:45:06.290167] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-17T01:45:06.334520] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-11 (3.24 seconds). [2025-09-17T01:45:06.940971] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T01:45:06.943270] [INFO ] [REMOTE ] ABG: Full fetch complete (26179 records). [2025-09-17T01:45:06.943377] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-17T01:45:07.097239] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-17T01:45:07.340630] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-17T01:45:07.340795] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-17T01:45:07.341150] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-17T01:45:07.341305] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-17T01:45:07.342308] [DEBUG] [LOCAL ] ABG: Trimmed 26179 records to 18953 (keeping 200 days of data) [2025-09-17T01:45:07.461849] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:45:07.502323] [DEBUG] [LOCAL ] ABG: Primary data saved (18953 records). [2025-09-17T01:45:07.502527] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-17T01:45:07.502672] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABG took 20.3s. Estimated remaining: 3h 18m 40s. Rate: 11.9 symbols/min [2025-09-17T01:45:07.681458] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:07.726920] [DEBUG] [LOCAL ] ABT: Loaded 39983 existing records from primary storage. [2025-09-17T01:45:07.727096] [INFO ] [MAIN ] ABT: Loaded 39983 existing records. [2025-09-17T01:45:07.894040] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-17T01:45:07.917065] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:07.917309] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-17T01:45:07.917373] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-17T01:45:07.918341] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-17T01:45:07.918418] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-17T01:45:08.279917] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:08.495978] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T01:45:08.690141] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-17T01:45:09.490149] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-17T01:45:09.630262] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T01:45:09.636929] [INFO ] [REMOTE ] ABEV: Full fetch complete (77060 records). [2025-09-17T01:45:09.637135] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-17T01:45:10.032160] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-17T01:45:10.032289] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-17T01:45:10.033043] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-17T01:45:10.033108] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-17T01:45:10.034797] [DEBUG] [LOCAL ] ABEV: Trimmed 77060 records to 53272 (keeping 200 days of data) [2025-09-17T01:45:10.292333] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-11. [2025-09-17T01:45:10.284941] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T01:45:10.390444] [DEBUG] [LOCAL ] ABEV: Primary data saved (53272 records). [2025-09-17T01:45:10.390656] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-17T01:45:10.392314] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABEV took 30.7s. Estimated remaining: 3h 12m 2s. Rate: 12.3 symbols/min [2025-09-17T01:45:10.563226] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:10.583068] [DEBUG] [LOCAL ] ACA: Loaded 16738 existing records from primary storage. [2025-09-17T01:45:10.583244] [INFO ] [MAIN ] ACA: Loaded 16738 existing records. [2025-09-17T01:45:10.765584] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:10.765858] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-17T01:45:10.765910] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-17T01:45:10.766394] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-17T01:45:10.766454] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-17T01:45:11.105929] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-17T01:45:11.139287] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:11.161724] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T01:45:11.890144] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-11. [2025-09-17T01:45:12.227283] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T01:45:12.481807] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T01:45:12.690091] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-17T01:45:13.072604] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T01:45:13.490121] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-17T01:45:13.691468] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T01:45:14.290184] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-17T01:45:15.090162] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-17T01:45:15.890207] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-17T01:45:16.444768] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-17T01:45:16.693921] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-17T01:45:16.696406] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (3.21 seconds). [2025-09-17T01:45:16.962832] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T01:45:17.490149] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-17T01:45:17.579018] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-17T01:45:17.904726] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T01:45:18.290125] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-17T01:45:19.090172] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-17T01:45:19.319451] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T01:45:19.872100] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T01:45:19.890068] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-17T01:45:20.218381] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T01:45:20.690132] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-17T01:45:21.490137] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-17T01:45:21.807324] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:45:22.096054] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T01:45:22.290111] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-17T01:45:22.607281] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T01:45:23.090154] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-17T01:45:23.535089] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T01:45:23.540394] [INFO ] [REMOTE ] ABM: Full fetch complete (43959 records). [2025-09-17T01:45:23.540607] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-17T01:45:23.896325] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-17T01:45:23.932981] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-17T01:45:23.933093] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-17T01:45:23.933597] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-17T01:45:23.933677] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-17T01:45:23.935355] [DEBUG] [LOCAL ] ABM: Trimmed 43959 records to 32145 (keeping 200 days of data) [2025-09-17T01:45:24.126786] [DEBUG] [LOCAL ] ABM: Primary data saved (32145 records). [2025-09-17T01:45:24.126957] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-17T01:45:24.127055] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ABM took 28.9s. Estimated remaining: 3h 36m 45s. Rate: 10.9 symbols/min [2025-09-17T01:45:24.330912] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:24.367226] [DEBUG] [LOCAL ] ACCO: Loaded 27598 existing records from primary storage. [2025-09-17T01:45:24.367452] [INFO ] [MAIN ] ACCO: Loaded 27598 existing records. [2025-09-17T01:45:24.607830] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:24.608197] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-17T01:45:24.608273] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-17T01:45:24.608939] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-17T01:45:24.609003] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-17T01:45:24.695359] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-17T01:45:25.103827] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:25.181083] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T01:45:25.426171] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T01:45:25.490182] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-17T01:45:26.290096] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-17T01:45:26.326987] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T01:45:26.640299] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T01:45:27.090191] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-11. [2025-09-17T01:45:27.890173] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-17T01:45:28.258335] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T01:45:28.370867] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T01:45:28.690132] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-17T01:45:29.375908] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T01:45:29.490131] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-17T01:45:30.290116] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-17T01:45:30.597565] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T01:45:30.709611] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T01:45:31.090149] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-17T01:45:31.890127] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-17T01:45:32.193508] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T01:45:32.334037] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T01:45:32.690205] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-17T01:45:33.490193] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-17T01:45:33.840569] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T01:45:33.973450] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T01:45:34.290193] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-17T01:45:35.090109] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-17T01:45:35.267523] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T01:45:35.597557] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T01:45:35.603813] [INFO ] [REMOTE ] ABR: Full fetch complete (75060 records). [2025-09-17T01:45:35.604001] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-17T01:45:35.898708] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-17T01:45:36.006359] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-17T01:45:36.006507] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-17T01:45:36.007338] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-17T01:45:36.007425] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-17T01:45:36.009195] [DEBUG] [LOCAL ] ABR: Trimmed 75060 records to 52177 (keeping 200 days of data) [2025-09-17T01:45:36.240044] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T01:45:36.349921] [DEBUG] [LOCAL ] ABR: Primary data saved (52177 records). [2025-09-17T01:45:36.350085] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-17T01:45:36.351469] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ABR took 35.4s. Estimated remaining: 3h 54m 11s. Rate: 10.1 symbols/min [2025-09-17T01:45:36.518414] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:36.518572] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-09-17T01:45:36.518616] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-09-17T01:45:36.518754] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-17T01:45:36.518818] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-17T01:45:36.518867] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-17T01:45:36.518980] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-17T01:45:36.695436] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-17T01:45:36.883292] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:37.291928] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:45:37.490153] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-11. [2025-09-17T01:45:37.721022] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T01:45:37.723783] [INFO ] [REMOTE ] ACA: Full fetch complete (34094 records). [2025-09-17T01:45:37.723874] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-17T01:45:38.090509] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-17T01:45:38.090605] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-17T01:45:38.090973] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-17T01:45:38.091039] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-17T01:45:38.091889] [DEBUG] [LOCAL ] ACA: Trimmed 34094 records to 24455 (keeping 200 days of data) [2025-09-17T01:45:38.239546] [DEBUG] [LOCAL ] ACA: Primary data saved (24455 records). [2025-09-17T01:45:38.239708] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-17T01:45:38.239803] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ACA took 27.8s. Estimated remaining: 3h 44m 5s. Rate: 10.5 symbols/min [2025-09-17T01:45:38.295305] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-17T01:45:38.418583] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:38.435613] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T01:45:38.478627] [DEBUG] [LOCAL ] ACHR: Loaded 40168 existing records from primary storage. [2025-09-17T01:45:38.478805] [INFO ] [MAIN ] ACHR: Loaded 40168 existing records. [2025-09-17T01:45:38.655318] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:38.655558] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-17T01:45:38.655609] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-17T01:45:38.656453] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-17T01:45:38.656515] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-17T01:45:39.007385] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:39.090079] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-11. [2025-09-17T01:45:39.812730] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T01:45:39.890117] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-17T01:45:40.690162] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-17T01:45:41.283005] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-17T01:45:41.312998] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T01:45:41.490167] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-17T01:45:41.856090] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T01:45:42.290164] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-17T01:45:43.057374] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T01:45:43.089066] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T01:45:43.097141] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-17T01:45:43.890140] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-17T01:45:44.690148] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-17T01:45:45.412915] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T01:45:45.490119] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-17T01:45:45.758052] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-17T01:45:46.027790] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T01:45:46.290145] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-17T01:45:46.547126] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:45:47.090151] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-17T01:45:47.608101] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T01:45:47.890120] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-17T01:45:48.410157] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T01:45:48.690129] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-17T01:45:49.336186] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T01:45:49.490073] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-17T01:45:50.290134] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-17T01:45:50.474971] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T01:45:50.538637] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T01:45:51.090183] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-17T01:45:51.890196] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-17T01:45:52.545755] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T01:45:52.609126] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T01:45:52.690112] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-17T01:45:52.800570] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T01:45:53.490196] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-17T01:45:53.829265] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T01:45:54.290101] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-17T01:45:54.654899] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T01:45:55.090166] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-17T01:45:55.292841] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T01:45:55.297069] [INFO ] [REMOTE ] ACCO: Full fetch complete (54179 records). [2025-09-17T01:45:55.297197] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-17T01:45:55.687315] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-17T01:45:55.687425] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-17T01:45:55.687999] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-17T01:45:55.688078] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-17T01:45:55.689872] [DEBUG] [LOCAL ] ACCO: Trimmed 54179 records to 38109 (keeping 200 days of data) [2025-09-17T01:45:55.893266] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-17T01:45:55.916721] [DEBUG] [LOCAL ] ACCO: Primary data saved (38109 records). [2025-09-17T01:45:55.916888] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-17T01:45:55.916998] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ACCO took 31.8s. Estimated remaining: 4h 11m 35s. Rate: 9.3 symbols/min [2025-09-17T01:45:56.106807] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:56.148162] [DEBUG] [LOCAL ] ACI: Loaded 39673 existing records from primary storage. [2025-09-17T01:45:56.148382] [INFO ] [MAIN ] ACI: Loaded 39673 existing records. [2025-09-17T01:45:56.339354] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:56.339814] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-17T01:45:56.339965] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-17T01:45:56.346032] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-17T01:45:56.355659] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-17T01:45:56.389468] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T01:45:56.701624] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-17T01:45:56.742870] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:57.490089] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-17T01:45:57.725389] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T01:45:57.728741] [INFO ] [REMOTE ] ACEL: Full fetch complete (39081 records). [2025-09-17T01:45:57.728862] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-17T01:45:58.111935] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-17T01:45:58.112132] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-17T01:45:58.112825] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-17T01:45:58.112923] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-17T01:45:58.114297] [DEBUG] [LOCAL ] ACEL: Trimmed 39081 records to 27547 (keeping 200 days of data) [2025-09-17T01:45:58.232333] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-17T01:45:58.293301] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-17T01:45:58.329110] [DEBUG] [LOCAL ] ACEL: Primary data saved (27547 records). [2025-09-17T01:45:58.329347] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-17T01:45:58.329480] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACEL took 22.0s. Estimated remaining: 4h 2m 45s. Rate: 9.7 symbols/min [2025-09-17T01:45:58.511949] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:58.545541] [DEBUG] [LOCAL ] ACM: Loaded 31522 existing records from primary storage. [2025-09-17T01:45:58.545741] [INFO ] [MAIN ] ACM: Loaded 31522 existing records. [2025-09-17T01:45:58.735231] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:58.735495] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-17T01:45:58.735547] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-17T01:45:58.736313] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-17T01:45:58.736379] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-17T01:45:59.092246] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:59.092382] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-11. [2025-09-17T01:45:59.890115] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-11. [2025-09-17T01:46:00.004230] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-17T01:46:00.258501] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:46:00.690131] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-17T01:46:00.878053] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T01:46:01.162985] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:46:01.490192] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-17T01:46:02.290181] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-17T01:46:03.090141] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-17T01:46:03.309903] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-17T01:46:03.348065] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T01:46:03.543196] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T01:46:03.549633] [INFO ] [REMOTE ] ABT: Full fetch complete (77429 records). [2025-09-17T01:46:03.549809] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-17T01:46:03.899250] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-17T01:46:03.961508] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-17T01:46:03.961673] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-17T01:46:03.962553] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-17T01:46:03.962656] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-17T01:46:03.964353] [DEBUG] [LOCAL ] ABT: Trimmed 77429 records to 53621 (keeping 200 days of data) [2025-09-17T01:46:04.319152] [DEBUG] [LOCAL ] ABT: Primary data saved (53621 records). [2025-09-17T01:46:04.319348] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-17T01:46:04.319476] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ABT took 56.8s. Estimated remaining: 4h 2m 14s. Rate: 9.7 symbols/min [2025-09-17T01:46:04.490696] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:04.528482] [DEBUG] [LOCAL ] ACN: Loaded 39800 existing records from primary storage. [2025-09-17T01:46:04.528668] [INFO ] [MAIN ] ACN: Loaded 39800 existing records. [2025-09-17T01:46:04.701490] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-17T01:46:04.707089] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:04.707472] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-17T01:46:04.707690] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-17T01:46:04.709055] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-17T01:46:04.709123] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-17T01:46:04.981025] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T01:46:05.103603] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:05.490152] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-17T01:46:05.774478] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T01:46:06.290176] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-17T01:46:07.090160] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-11. [2025-09-17T01:46:07.170907] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T01:46:07.397441] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-17T01:46:07.530004] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T01:46:07.890167] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-17T01:46:08.690190] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-17T01:46:08.966815] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T01:46:09.490192] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-17T01:46:09.752501] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T01:46:10.290144] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-17T01:46:10.832942] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T01:46:11.090118] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-17T01:46:11.387633] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-17T01:46:11.836851] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T01:46:11.890098] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-17T01:46:12.690174] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-17T01:46:12.717905] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T01:46:13.490137] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-17T01:46:13.852102] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T01:46:14.290145] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-17T01:46:15.090158] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-17T01:46:15.310318] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T01:46:15.347318] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-17T01:46:15.890155] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-17T01:46:16.141920] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T01:46:16.690158] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-17T01:46:16.946080] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T01:46:17.490172] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-17T01:46:17.538869] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T01:46:18.290153] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-17T01:46:19.090215] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-17T01:46:19.457582] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-17T01:46:19.506267] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T01:46:19.546719] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T01:46:19.890155] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-17T01:46:20.690174] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-17T01:46:20.970991] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T01:46:21.490112] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-17T01:46:21.918365] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T01:46:21.955325] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T01:46:22.290128] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-17T01:46:23.090188] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-17T01:46:23.491468] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T01:46:23.890139] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-17T01:46:24.153749] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-17T01:46:24.690128] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-17T01:46:24.804222] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:46:24.987603] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T01:46:24.993503] [INFO ] [REMOTE ] ACM: Full fetch complete (62353 records). [2025-09-17T01:46:24.993676] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-17T01:46:25.375569] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-17T01:46:25.375698] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-17T01:46:25.376337] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-17T01:46:25.376422] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-17T01:46:25.377728] [DEBUG] [LOCAL ] ACM: Trimmed 62353 records to 43150 (keeping 200 days of data) [2025-09-17T01:46:25.490240] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-17T01:46:25.650671] [DEBUG] [LOCAL ] ACM: Primary data saved (43150 records). [2025-09-17T01:46:25.650820] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-17T01:46:25.650916] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACM took 27.3s. Estimated remaining: 4h 31m 46s. Rate: 8.6 symbols/min [2025-09-17T01:46:25.822783] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:25.823012] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-09-17T01:46:25.823065] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-09-17T01:46:25.823170] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-17T01:46:25.823225] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-17T01:46:25.823274] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-17T01:46:25.823327] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-17T01:46:26.171812] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:26.290087] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-11. [2025-09-17T01:46:26.746335] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T01:46:27.090177] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-17T01:46:27.682934] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T01:46:27.890158] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-17T01:46:27.927923] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T01:46:27.937982] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-17T01:46:27.938187] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-17T01:46:28.331213] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-17T01:46:28.331353] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-17T01:46:28.332112] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-17T01:46:28.332178] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-17T01:46:28.333753] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-17T01:46:28.659176] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-17T01:46:28.659359] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-17T01:46:28.660540] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACHR took 50.4s. Estimated remaining: 4h 24m 20s. Rate: 8.9 symbols/min [2025-09-17T01:46:28.692162] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-17T01:46:28.848287] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:28.884671] [DEBUG] [LOCAL ] ACR: Loaded 4172 existing records from primary storage. [2025-09-17T01:46:28.886190] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T01:46:28.886528] [INFO ] [MAIN ] ACR: Loaded 4172 existing records. [2025-09-17T01:46:29.099397] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:29.099812] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-17T01:46:29.099886] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-17T01:46:29.100246] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-17T01:46:29.100319] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-17T01:46:29.475865] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:29.490088] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-11. [2025-09-17T01:46:29.699815] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T01:46:30.084755] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:46:30.097391] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T01:46:30.290117] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-17T01:46:31.090148] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-17T01:46:31.890127] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-17T01:46:32.433752] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T01:46:32.624962] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T01:46:32.690136] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-17T01:46:33.490123] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-17T01:46:33.847750] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T01:46:33.924938] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T01:46:34.290142] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-17T01:46:35.090189] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-17T01:46:35.187715] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T01:46:35.667870] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T01:46:35.890142] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-17T01:46:36.498043] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T01:46:36.506776] [INFO ] [REMOTE ] ACI: Full fetch complete (76852 records). [2025-09-17T01:46:36.507048] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-17T01:46:36.695429] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-17T01:46:37.058278] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-17T01:46:37.058432] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-17T01:46:37.059327] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-17T01:46:37.059424] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-17T01:46:37.061811] [DEBUG] [LOCAL ] ACI: Trimmed 76852 records to 53268 (keeping 200 days of data) [2025-09-17T01:46:37.350376] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T01:46:37.363921] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T01:46:37.446062] [DEBUG] [LOCAL ] ACI: Primary data saved (53268 records). [2025-09-17T01:46:37.446221] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-17T01:46:37.446331] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACI took 41.5s. Estimated remaining: 4h 27m 50s. Rate: 8.8 symbols/min [2025-09-17T01:46:37.498508] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-17T01:46:37.616214] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:37.639710] [DEBUG] [LOCAL ] ACRE: Loaded 24288 existing records from primary storage. [2025-09-17T01:46:37.639887] [INFO ] [MAIN ] ACRE: Loaded 24288 existing records. [2025-09-17T01:46:37.815081] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:37.815355] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-17T01:46:37.815452] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-17T01:46:37.816193] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-17T01:46:37.816266] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-17T01:46:38.165775] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:38.290110] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-17T01:46:38.903595] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T01:46:38.975572] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T01:46:39.090094] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-17T01:46:39.890131] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-17T01:46:40.385396] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T01:46:40.690145] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-17T01:46:41.342214] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T01:46:41.490134] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-17T01:46:41.589847] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T01:46:41.596893] [INFO ] [REMOTE ] ACN: Full fetch complete (76934 records). [2025-09-17T01:46:41.597090] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-17T01:46:41.987303] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-17T01:46:41.987432] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-17T01:46:41.988218] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-17T01:46:41.988295] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-17T01:46:41.989961] [DEBUG] [LOCAL ] ACN: Trimmed 76934 records to 53419 (keeping 200 days of data) [2025-09-17T01:46:42.292209] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-11. [2025-09-17T01:46:42.333578] [DEBUG] [LOCAL ] ACN: Primary data saved (53419 records). [2025-09-17T01:46:42.333746] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-17T01:46:42.333928] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACN took 38.0s. Estimated remaining: 4h 24m 23s. Rate: 8.9 symbols/min [2025-09-17T01:46:42.508320] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:42.515868] [DEBUG] [LOCAL ] ACV: Loaded 4619 existing records from primary storage. [2025-09-17T01:46:42.516018] [INFO ] [MAIN ] ACV: Loaded 4619 existing records. [2025-09-17T01:46:42.693830] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:42.694154] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-17T01:46:42.694230] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-17T01:46:42.694566] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-17T01:46:42.694669] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-17T01:46:43.059995] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:43.078265] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T01:46:43.090074] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-17T01:46:43.722796] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T01:46:43.890115] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-11. [2025-09-17T01:46:44.179963] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T01:46:44.361680] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T01:46:44.690168] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-17T01:46:45.329974] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T01:46:45.490143] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-17T01:46:46.212663] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T01:46:46.290126] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-17T01:46:47.090094] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-17T01:46:47.452440] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:46:47.457328] [INFO ] [REMOTE ] ACP: Full fetch complete (48113 records). [2025-09-17T01:46:47.457500] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-17T01:46:47.852795] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-17T01:46:47.857995] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-17T01:46:47.859053] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-17T01:46:47.859277] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T01:46:47.859417] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-17T01:46:47.862666] [DEBUG] [LOCAL ] ACP: Trimmed 48113 records to 31437 (keeping 200 days of data) [2025-09-17T01:46:47.913243] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-17T01:46:48.046894] [DEBUG] [LOCAL ] ACP: Primary data saved (31437 records). [2025-09-17T01:46:48.047070] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-17T01:46:48.047161] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACP took 22.4s. Estimated remaining: 4h 22m 34s. Rate: 8.9 symbols/min [2025-09-17T01:46:48.219446] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:48.254237] [DEBUG] [LOCAL ] ACVA: Loaded 36184 existing records from primary storage. [2025-09-17T01:46:48.254442] [INFO ] [MAIN ] ACVA: Loaded 36184 existing records. [2025-09-17T01:46:48.435007] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:48.440519] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-17T01:46:48.441023] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-17T01:46:48.441249] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T01:46:48.443216] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-17T01:46:48.443879] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-17T01:46:48.695269] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-17T01:46:48.798920] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:49.469420] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T01:46:49.490153] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-17T01:46:49.871334] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T01:46:50.290130] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-17T01:46:50.904225] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T01:46:51.090176] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-17T01:46:51.704480] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T01:46:51.890234] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-17T01:46:52.473509] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T01:46:52.690137] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-17T01:46:53.490123] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-11. [2025-09-17T01:46:54.166740] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T01:46:54.290154] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-17T01:46:55.023535] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T01:46:55.090089] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-17T01:46:55.149147] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:46:55.883748] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T01:46:55.890075] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-17T01:46:56.690151] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-17T01:46:57.242835] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T01:46:57.495192] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-17T01:46:57.506706] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T01:46:58.290155] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-17T01:46:58.980064] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:46:58.981070] [INFO ] [REMOTE ] ACR: Full fetch complete (8545 records). [2025-09-17T01:46:58.981157] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-17T01:46:59.094427] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-17T01:46:59.276292] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T01:46:59.380850] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-17T01:46:59.380944] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-17T01:46:59.381130] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-17T01:46:59.381179] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-17T01:46:59.381662] [DEBUG] [LOCAL ] ACR: Trimmed 8545 records to 6495 (keeping 200 days of data) [2025-09-17T01:46:59.419310] [DEBUG] [LOCAL ] ACR: Primary data saved (6495 records). [2025-09-17T01:46:59.419412] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-17T01:46:59.419525] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. ACR took 30.8s. Estimated remaining: 4h 29m 43s. Rate: 8.7 symbols/min [2025-09-17T01:46:59.588766] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:59.588967] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-17T01:46:59.589022] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-17T01:46:59.589123] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-17T01:46:59.589174] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-17T01:46:59.589221] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-17T01:46:59.589473] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-17T01:46:59.904609] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-17T01:46:59.941843] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:59.949610] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T01:47:00.690186] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-11. [2025-09-17T01:47:00.928285] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:00.928525] [WARN ] [REMOTE ] AD: No data returned for month 2024-11 [2025-09-17T01:47:01.356003] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T01:47:01.490148] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-17T01:47:01.708985] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:01.709394] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-17T01:47:02.290172] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-17T01:47:03.090136] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-17T01:47:03.724589] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T01:47:03.890138] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-17T01:47:04.222197] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T01:47:04.690143] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-17T01:47:05.342716] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T01:47:05.376344] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T01:47:05.490090] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-17T01:47:06.290136] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-17T01:47:06.576771] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T01:47:06.930112] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T01:47:07.090136] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-17T01:47:07.725903] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T01:47:07.727637] [INFO ] [REMOTE ] ACV: Full fetch complete (9540 records). [2025-09-17T01:47:07.727764] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-17T01:47:07.901217] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-17T01:47:08.091583] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-17T01:47:08.091696] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-17T01:47:08.091898] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-17T01:47:08.091995] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-17T01:47:08.092434] [DEBUG] [LOCAL ] ACV: Trimmed 9540 records to 6862 (keeping 200 days of data) [2025-09-17T01:47:08.134578] [DEBUG] [LOCAL ] ACV: Primary data saved (6862 records). [2025-09-17T01:47:08.134721] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-17T01:47:08.134815] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACV took 25.8s. Estimated remaining: 4h 32m 20s. Rate: 8.6 symbols/min [2025-09-17T01:47:08.303542] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:08.337222] [DEBUG] [LOCAL ] ADC: Loaded 34611 existing records from primary storage. [2025-09-17T01:47:08.337381] [INFO ] [MAIN ] ADC: Loaded 34611 existing records. [2025-09-17T01:47:08.517843] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:08.518105] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-17T01:47:08.518165] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-17T01:47:08.519013] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-17T01:47:08.519074] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-17T01:47:08.695313] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-17T01:47:08.881672] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:09.020206] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:09.020598] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-17T01:47:09.490379] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-17T01:47:09.490263] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T01:47:10.290191] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-17T01:47:10.399368] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T01:47:10.399888] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-17T01:47:10.873206] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T01:47:11.090216] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-17T01:47:11.890191] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-17T01:47:12.105632] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:12.105959] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-17T01:47:12.505028] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T01:47:12.690156] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-17T01:47:12.896171] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:12.896483] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-17T01:47:13.490117] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-17T01:47:13.701626] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:13.701892] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-17T01:47:14.290209] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-11. [2025-09-17T01:47:15.090184] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-17T01:47:15.869920] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T01:47:15.890069] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-17T01:47:16.442618] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T01:47:16.690187] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-17T01:47:17.453921] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T01:47:17.490113] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-17T01:47:18.290138] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-17T01:47:18.356949] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T01:47:19.097781] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-17T01:47:19.113626] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T01:47:19.634173] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T01:47:19.890141] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-17T01:47:20.690167] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-17T01:47:20.774404] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T01:47:20.909299] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:20.909888] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-17T01:47:21.387117] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T01:47:21.490181] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-17T01:47:21.701726] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:21.702061] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-17T01:47:22.290208] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-17T01:47:23.090141] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-17T01:47:23.890115] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-17T01:47:23.982205] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T01:47:24.175802] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T01:47:24.690182] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-17T01:47:25.024891] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T01:47:25.028752] [INFO ] [REMOTE ] ACRE: Full fetch complete (50403 records). [2025-09-17T01:47:25.028874] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-17T01:47:25.454224] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-17T01:47:25.454411] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-17T01:47:25.454943] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-17T01:47:25.455003] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-17T01:47:25.456075] [DEBUG] [LOCAL ] ACRE: Trimmed 50403 records to 33740 (keeping 200 days of data) [2025-09-17T01:47:25.505694] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-17T01:47:25.664478] [DEBUG] [LOCAL ] ACRE: Primary data saved (33740 records). [2025-09-17T01:47:25.664677] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-17T01:47:25.664780] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACRE took 48.2s. Estimated remaining: 4h 47m 28s. Rate: 8.1 symbols/min [2025-09-17T01:47:25.837704] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:25.864364] [DEBUG] [LOCAL ] ADCT: Loaded 25885 existing records from primary storage. [2025-09-17T01:47:25.864553] [INFO ] [MAIN ] ADCT: Loaded 25885 existing records. [2025-09-17T01:47:26.049119] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:26.049476] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-17T01:47:26.049530] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-17T01:47:26.050212] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-17T01:47:26.050276] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-17T01:47:26.292571] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-17T01:47:26.405819] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:26.434441] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:47:26.700342] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T01:47:26.703238] [INFO ] [REMOTE ] AD: Full fetch complete (4957 records). [2025-09-17T01:47:26.703325] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-17T01:47:26.882665] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 25 unique days, need 200 days [2025-09-17T01:47:26.882880] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:47:26.882930] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:47:26.882979] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-17T01:47:26.883043] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-17T01:47:26.883093] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-17T01:47:26.883161] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-17T01:47:26.883230] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. AD took 27.5s. Estimated remaining: 4h 38m 47s. Rate: 8.4 symbols/min [2025-09-17T01:47:27.057072] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:27.097351] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-17T01:47:27.103172] [DEBUG] [LOCAL ] ADM: Loaded 39782 existing records from primary storage. [2025-09-17T01:47:27.103575] [INFO ] [MAIN ] ADM: Loaded 39782 existing records. [2025-09-17T01:47:27.281369] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:27.281621] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-17T01:47:27.281699] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-17T01:47:27.282576] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-17T01:47:27.282636] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-17T01:47:27.640598] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:27.890140] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-11. [2025-09-17T01:47:28.111431] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T01:47:28.336677] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T01:47:28.690191] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-17T01:47:29.490223] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-17T01:47:29.692538] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T01:47:30.297864] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-17T01:47:30.335918] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T01:47:31.090135] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-17T01:47:31.234030] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T01:47:31.890198] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-17T01:47:31.999420] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T01:47:32.674190] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T01:47:32.680388] [INFO ] [REMOTE ] ACVA: Full fetch complete (69910 records). [2025-09-17T01:47:32.680536] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-17T01:47:32.695233] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-17T01:47:33.079097] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-17T01:47:33.079231] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-17T01:47:33.079971] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-17T01:47:33.080033] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-17T01:47:33.081827] [DEBUG] [LOCAL ] ACVA: Trimmed 69910 records to 49402 (keeping 200 days of data) [2025-09-17T01:47:33.368412] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T01:47:33.409058] [DEBUG] [LOCAL ] ACVA: Primary data saved (49402 records). [2025-09-17T01:47:33.409219] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-17T01:47:33.409314] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ACVA took 45.4s. Estimated remaining: 4h 37m 50s. Rate: 8.4 symbols/min [2025-09-17T01:47:33.495350] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-11. [2025-09-17T01:47:33.585609] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:33.619883] [DEBUG] [LOCAL ] ADNT: Loaded 35081 existing records from primary storage. [2025-09-17T01:47:33.620094] [INFO ] [MAIN ] ADNT: Loaded 35081 existing records. [2025-09-17T01:47:33.803293] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:33.803565] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-17T01:47:33.803625] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-17T01:47:33.804500] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-17T01:47:33.804569] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-17T01:47:34.162240] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:34.290080] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-11. [2025-09-17T01:47:34.600363] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T01:47:34.975024] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T01:47:35.090136] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-17T01:47:35.812245] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T01:47:35.890078] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-17T01:47:36.690201] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-17T01:47:36.808572] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T01:47:37.243506] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T01:47:37.490140] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-17T01:47:38.290120] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-17T01:47:38.571844] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T01:47:39.075665] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T01:47:39.090068] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-17T01:47:39.731874] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T01:47:39.890083] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-17T01:47:40.695215] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-17T01:47:40.710934] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T01:47:40.803813] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T01:47:41.490140] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-17T01:47:42.290162] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-17T01:47:42.331698] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T01:47:42.800938] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T01:47:43.090129] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-17T01:47:43.559613] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T01:47:43.567679] [INFO ] [REMOTE ] ADC: Full fetch complete (65868 records). [2025-09-17T01:47:43.567879] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-17T01:47:43.895199] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-17T01:47:43.967344] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-17T01:47:43.967476] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-17T01:47:43.968240] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-17T01:47:43.968322] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-17T01:47:43.969618] [DEBUG] [LOCAL ] ADC: Trimmed 65868 records to 46698 (keeping 200 days of data) [2025-09-17T01:47:44.257633] [DEBUG] [LOCAL ] ADC: Primary data saved (46698 records). [2025-09-17T01:47:44.257793] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-17T01:47:44.257878] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 36.1s. Estimated remaining: 4h 42m 33s. Rate: 8.3 symbols/min [2025-09-17T01:47:44.427971] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:44.463406] [DEBUG] [LOCAL ] ADT: Loaded 39870 existing records from primary storage. [2025-09-17T01:47:44.463571] [INFO ] [MAIN ] ADT: Loaded 39870 existing records. [2025-09-17T01:47:44.653200] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:44.653566] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-17T01:47:44.653663] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-17T01:47:44.654669] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-17T01:47:44.662391] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-17T01:47:44.706003] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-17T01:47:44.720275] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:47:45.043951] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:45.290827] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T01:47:45.490148] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-11. [2025-09-17T01:47:46.290154] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-17T01:47:46.630679] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T01:47:47.090151] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-17T01:47:47.146787] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:47:47.604041] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T01:47:47.890136] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-17T01:47:48.443926] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T01:47:48.690212] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-17T01:47:49.490149] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-17T01:47:49.667130] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T01:47:50.290179] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-17T01:47:50.581355] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T01:47:51.090232] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-17T01:47:51.173432] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T01:47:51.900229] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-17T01:47:51.902712] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T01:47:52.690166] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-17T01:47:53.069511] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T01:47:53.490139] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-17T01:47:53.657557] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T01:47:54.290110] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-17T01:47:54.337140] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T01:47:55.090155] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-17T01:47:55.307752] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T01:47:55.852673] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T01:47:55.890093] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-17T01:47:56.535800] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T01:47:56.690173] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-17T01:47:57.393169] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T01:47:57.490159] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-17T01:47:58.290132] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-17T01:47:58.677487] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T01:47:59.009571] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T01:47:59.090134] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-17T01:47:59.694620] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T01:47:59.890142] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-17T01:48:00.697790] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-17T01:48:00.703129] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T01:48:01.490182] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-17T01:48:02.290176] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-17T01:48:02.515497] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-17T01:48:03.090161] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-17T01:48:03.437350] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-17T01:48:03.441826] [INFO ] [REMOTE ] ADCT: Full fetch complete (51351 records). [2025-09-17T01:48:03.441948] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-17T01:48:03.821662] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-09-17T01:48:03.874550] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-17T01:48:03.874680] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-17T01:48:03.875223] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-17T01:48:03.875280] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-17T01:48:03.876822] [DEBUG] [LOCAL ] ADCT: Trimmed 51351 records to 33554 (keeping 200 days of data) [2025-09-17T01:48:03.922479] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-17T01:48:04.065023] [DEBUG] [LOCAL ] ADCT: Primary data saved (33554 records). [2025-09-17T01:48:04.065194] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-17T01:48:04.065284] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADCT took 38.4s. Estimated remaining: 4h 58m 13s. Rate: 7.8 symbols/min [2025-09-17T01:48:04.238047] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:04.259465] [DEBUG] [LOCAL ] ADX: Loaded 20576 existing records from primary storage. [2025-09-17T01:48:04.259690] [INFO ] [MAIN ] ADX: Loaded 20576 existing records. [2025-09-17T01:48:04.446377] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:04.446755] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-17T01:48:04.446815] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-17T01:48:04.447311] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-17T01:48:04.447371] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-17T01:48:04.801061] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:04.801418] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-11. [2025-09-17T01:48:05.005742] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-17T01:48:05.163266] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T01:48:05.169980] [INFO ] [REMOTE ] ADM: Full fetch complete (77055 records). [2025-09-17T01:48:05.170150] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-17T01:48:05.504044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-17T01:48:05.563206] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-17T01:48:05.563318] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-17T01:48:05.564094] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-17T01:48:05.564157] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-17T01:48:05.565820] [DEBUG] [LOCAL ] ADM: Trimmed 77055 records to 53399 (keeping 200 days of data) [2025-09-17T01:48:05.926634] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T01:48:05.962887] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T01:48:05.982350] [DEBUG] [LOCAL ] ADM: Primary data saved (53399 records). [2025-09-17T01:48:05.982549] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-17T01:48:05.982688] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADM took 39.1s. Estimated remaining: 4h 51m 7s. Rate: 8.0 symbols/min [2025-09-17T01:48:06.154723] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:06.154915] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-09-17T01:48:06.154993] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-09-17T01:48:06.155109] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-17T01:48:06.155154] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-17T01:48:06.155208] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-17T01:48:06.155252] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-17T01:48:06.295268] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-17T01:48:06.507136] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:07.091781] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-11. [2025-09-17T01:48:07.096861] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T01:48:07.103864] [INFO ] [REMOTE ] ADNT: Full fetch complete (68022 records). [2025-09-17T01:48:07.104171] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-17T01:48:07.503290] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-17T01:48:07.503418] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-17T01:48:07.504085] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-17T01:48:07.504147] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-17T01:48:07.505667] [DEBUG] [LOCAL ] ADNT: Trimmed 68022 records to 47668 (keeping 200 days of data) [2025-09-17T01:48:07.733474] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T01:48:07.808733] [DEBUG] [LOCAL ] ADNT: Primary data saved (47668 records). [2025-09-17T01:48:07.808923] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-17T01:48:07.809064] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADNT took 34.4s. Estimated remaining: 4h 44m 20s. Rate: 8.2 symbols/min [2025-09-17T01:48:07.895310] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-17T01:48:07.986032] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:07.993485] [DEBUG] [LOCAL ] AEFC: Loaded 5914 existing records from primary storage. [2025-09-17T01:48:07.993605] [INFO ] [MAIN ] AEFC: Loaded 5914 existing records. [2025-09-17T01:48:08.173071] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:08.173327] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-17T01:48:08.173388] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-17T01:48:08.173753] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-17T01:48:08.173814] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-17T01:48:08.553100] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:08.583444] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T01:48:08.690082] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-17T01:48:09.490140] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-11. [2025-09-17T01:48:09.732694] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T01:48:10.210802] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T01:48:10.290076] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-17T01:48:10.396286] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T01:48:11.090196] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-17T01:48:11.090525] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T01:48:11.890159] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-17T01:48:12.498333] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T01:48:12.690195] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-17T01:48:13.490176] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-17T01:48:13.723231] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:48:13.751371] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:48:14.290174] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-17T01:48:15.090151] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-17T01:48:15.878032] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-17T01:48:15.890069] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-17T01:48:16.473014] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T01:48:16.690161] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-17T01:48:17.082023] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T01:48:17.490118] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-17T01:48:17.789962] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T01:48:17.964158] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T01:48:18.290134] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-17T01:48:18.781248] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T01:48:19.090185] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-17T01:48:19.309892] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T01:48:19.543248] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T01:48:19.890108] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-17T01:48:20.690165] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-17T01:48:21.495679] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-17T01:48:21.500851] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T01:48:21.507700] [INFO ] [REMOTE ] ADT: Full fetch complete (77041 records). [2025-09-17T01:48:21.507838] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-17T01:48:21.934627] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-17T01:48:21.934800] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-17T01:48:21.935723] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-17T01:48:21.935824] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-17T01:48:21.937828] [DEBUG] [LOCAL ] ADT: Trimmed 77041 records to 53455 (keeping 200 days of data) [2025-09-17T01:48:22.292067] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-17T01:48:22.441444] [DEBUG] [LOCAL ] ADT: Primary data saved (53455 records). [2025-09-17T01:48:22.441746] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-17T01:48:22.441940] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 38.2s. Estimated remaining: 4h 52m 36s. Rate: 8.0 symbols/min [2025-09-17T01:48:22.725858] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:22.790836] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T01:48:22.800422] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T01:48:22.841835] [DEBUG] [LOCAL ] AEG: Loaded 37046 existing records from primary storage. [2025-09-17T01:48:22.842721] [INFO ] [MAIN ] AEG: Loaded 37046 existing records. [2025-09-17T01:48:23.021027] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T01:48:23.045244] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:23.048212] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-17T01:48:23.048579] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-17T01:48:23.049446] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-17T01:48:23.049533] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-17T01:48:23.095229] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-17T01:48:23.406548] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:23.890143] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-17T01:48:24.172736] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T01:48:24.447553] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T01:48:24.690180] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-17T01:48:25.489053] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T01:48:25.491601] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-11. [2025-09-17T01:48:26.290185] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-17T01:48:26.695088] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T01:48:27.064506] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T01:48:27.090080] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-17T01:48:27.890136] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-17T01:48:28.666992] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T01:48:28.690084] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-17T01:48:28.728157] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T01:48:29.490205] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-17T01:48:30.035989] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T01:48:30.037285] [INFO ] [REMOTE ] AEFC: Full fetch complete (12510 records). [2025-09-17T01:48:30.037385] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-17T01:48:30.310763] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-17T01:48:30.408301] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-17T01:48:30.408455] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-17T01:48:30.408992] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-17T01:48:30.409148] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-17T01:48:30.410061] [DEBUG] [LOCAL ] AEFC: Trimmed 12510 records to 8704 (keeping 200 days of data) [2025-09-17T01:48:30.483401] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T01:48:30.507172] [DEBUG] [LOCAL ] AEFC: Primary data saved (8704 records). [2025-09-17T01:48:30.507398] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-17T01:48:30.507570] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 22.7s. Estimated remaining: 4h 53m 5s. Rate: 8.0 symbols/min [2025-09-17T01:48:30.676625] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:30.676896] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-09-17T01:48:30.676960] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-09-17T01:48:30.677098] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-17T01:48:30.677211] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-17T01:48:30.677296] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-17T01:48:30.677367] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-17T01:48:31.045341] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:31.090139] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-11. [2025-09-17T01:48:31.721098] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T01:48:31.890188] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-17T01:48:32.690172] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-17T01:48:32.937760] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T01:48:33.490189] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-17T01:48:33.640428] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T01:48:33.802031] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T01:48:34.290175] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-17T01:48:34.915476] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T01:48:35.090104] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-17T01:48:35.890111] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-17T01:48:36.040821] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T01:48:36.690101] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-17T01:48:36.980655] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T01:48:37.150722] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T01:48:37.490144] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-17T01:48:38.179148] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T01:48:38.290141] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-17T01:48:38.572161] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T01:48:38.576147] [INFO ] [REMOTE ] ADX: Full fetch complete (42148 records). [2025-09-17T01:48:38.576297] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-17T01:48:38.957970] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-17T01:48:38.958091] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-17T01:48:38.958559] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-17T01:48:38.958633] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-17T01:48:38.959608] [DEBUG] [LOCAL ] ADX: Trimmed 42148 records to 28110 (keeping 200 days of data) [2025-09-17T01:48:39.090740] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-17T01:48:39.142400] [DEBUG] [LOCAL ] ADX: Primary data saved (28110 records). [2025-09-17T01:48:39.142545] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-17T01:48:39.142728] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. ADX took 35.1s. Estimated remaining: 4h 54m 8s. Rate: 7.9 symbols/min [2025-09-17T01:48:39.315727] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:39.357956] [DEBUG] [LOCAL ] AEO: Loaded 39921 existing records from primary storage. [2025-09-17T01:48:39.358124] [INFO ] [MAIN ] AEO: Loaded 39921 existing records. [2025-09-17T01:48:39.538663] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:39.538895] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-17T01:48:39.538955] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-17T01:48:39.540058] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-17T01:48:39.540124] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-17T01:48:39.894546] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:39.890848] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-17T01:48:40.027175] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T01:48:40.690112] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-17T01:48:40.982187] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T01:48:41.490142] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-11. [2025-09-17T01:48:41.598578] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:48:42.290176] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-17T01:48:42.405350] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T01:48:43.090134] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-17T01:48:43.282176] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T01:48:43.890120] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-17T01:48:43.943960] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T01:48:44.690088] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-17T01:48:44.820105] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T01:48:45.490140] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-17T01:48:45.550364] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T01:48:46.126049] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T01:48:46.290080] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-17T01:48:47.090101] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-17T01:48:47.199021] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T01:48:47.890120] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-17T01:48:48.068601] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:48:48.518381] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T01:48:48.690161] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-17T01:48:49.087509] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T01:48:49.093707] [INFO ] [REMOTE ] AEE: Full fetch complete (72348 records). [2025-09-17T01:48:49.093876] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-17T01:48:49.490883] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-17T01:48:49.537079] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-17T01:48:49.537211] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-17T01:48:49.538095] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-17T01:48:49.538292] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-17T01:48:49.540362] [DEBUG] [LOCAL ] AEE: Trimmed 72348 records to 50355 (keeping 200 days of data) [2025-09-17T01:48:49.862467] [DEBUG] [LOCAL ] AEE: Primary data saved (50355 records). [2025-09-17T01:48:49.862620] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-17T01:48:49.862728] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEE took 43.9s. Estimated remaining: 4h 57m 20s. Rate: 7.8 symbols/min [2025-09-17T01:48:50.290167] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-17T01:48:50.357241] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T01:48:51.090116] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-17T01:48:51.321410] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T01:48:51.890135] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-17T01:48:52.236623] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T01:48:52.242755] [INFO ] [REMOTE ] AEG: Full fetch complete (69928 records). [2025-09-17T01:48:52.242938] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-17T01:48:52.648787] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-17T01:48:52.648958] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-17T01:48:52.649760] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-17T01:48:52.649842] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-17T01:48:52.651576] [DEBUG] [LOCAL ] AEG: Trimmed 69928 records to 49588 (keeping 200 days of data) [2025-09-17T01:48:52.776218] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-17T01:48:52.789854] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-17T01:48:52.992515] [DEBUG] [LOCAL ] AEG: Primary data saved (49588 records). [2025-09-17T01:48:52.992726] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-17T01:48:52.992877] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEG took 30.6s. Estimated remaining: 4h 52m 35s. Rate: 8.0 symbols/min [2025-09-17T01:48:53.757471] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T01:48:53.768663] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-17T01:48:54.845668] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T01:48:54.857054] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-17T01:48:55.657441] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T01:48:55.669060] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-17T01:48:56.816979] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T01:48:56.828128] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-17T01:48:57.300434] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T01:48:57.312038] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-17T01:48:58.837892] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T01:48:58.850571] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-17T01:48:59.177895] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T01:48:59.188756] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-17T01:49:00.707129] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T01:49:00.718830] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-17T01:49:01.526487] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-17T01:49:01.538615] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-17T01:49:02.577931] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T01:49:02.584452] [INFO ] [REMOTE ] AEM: Full fetch complete (76944 records). [2025-09-17T01:49:02.584600] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-17T01:49:02.975158] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-17T01:49:02.975262] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-17T01:49:02.976010] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-17T01:49:02.976077] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-17T01:49:02.977684] [DEBUG] [LOCAL ] AEM: Trimmed 76944 records to 53464 (keeping 200 days of data) [2025-09-17T01:49:03.323845] [DEBUG] [LOCAL ] AEM: Primary data saved (53464 records). [2025-09-17T01:49:03.324042] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-17T01:49:03.324156] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEM took 32.8s. Estimated remaining: 4h 55m 15s. Rate: 7.9 symbols/min [2025-09-17T01:49:03.795787] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-17T01:49:03.807416] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-17T01:49:05.420838] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T01:49:05.427221] [INFO ] [REMOTE ] AEO: Full fetch complete (77287 records). [2025-09-17T01:49:05.427356] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-17T01:49:05.825765] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-17T01:49:05.825868] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-17T01:49:05.826633] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-17T01:49:05.826719] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-17T01:49:05.828283] [DEBUG] [LOCAL ] AEO: Trimmed 77287 records to 53556 (keeping 200 days of data) [2025-09-17T01:49:06.156093] [DEBUG] [LOCAL ] AEO: Primary data saved (53556 records). [2025-09-17T01:49:06.156270] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-17T01:49:06.156384] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AEO took 27.0s. Estimated remaining: 4h 50m 29s. Rate: 8.0 symbols/min [2025-09-17T01:49:06.703986] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.792926] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.813708] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-09-17T01:49:06.795052] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.822483] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-09-17T01:49:06.844751] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-17T01:49:06.848170] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-17T01:49:06.848024] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.848439] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-17T01:49:06.848691] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-17T01:49:06.927078] [DEBUG] [LOCAL ] AFB: Loaded 7923 existing records from primary storage. [2025-09-17T01:49:06.954990] [INFO ] [MAIN ] AFB: Loaded 7923 existing records. [2025-09-17T01:49:07.235609] [DEBUG] [LOCAL ] AES: Loaded 40025 existing records from primary storage. [2025-09-17T01:49:07.254496] [DEBUG] [LOCAL ] AER: Loaded 35913 existing records from primary storage. [2025-09-17T01:49:07.285917] [INFO ] [MAIN ] AES: Loaded 40025 existing records. [2025-09-17T01:49:07.280688] [INFO ] [MAIN ] AER: Loaded 35913 existing records. [2025-09-17T01:49:07.471286] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:07.555989] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-17T01:49:07.637832] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-17T01:49:07.616274] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:07.665474] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-11. [2025-09-17T01:49:07.662142] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-17T01:49:07.665724] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-17T01:49:07.857857] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:07.928483] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-17T01:49:07.934183] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-17T01:49:07.928600] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:07.949814] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-17T01:49:07.974202] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-17T01:49:07.979632] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-17T01:49:08.020634] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-17T01:49:08.029850] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-17T01:49:08.064443] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-17T01:49:08.432686] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:08.469616] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-11. [2025-09-17T01:49:08.929211] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:08.932868] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:08.933232] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-11. [2025-09-17T01:49:08.933775] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-11. [2025-09-17T01:49:09.328949] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:49:09.337557] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-17T01:49:09.426044] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T01:49:09.428264] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-17T01:49:10.039105] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T01:49:10.041955] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-17T01:49:10.581563] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T01:49:10.591358] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-17T01:49:10.659866] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T01:49:10.669354] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-17T01:49:10.701548] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T01:49:10.712142] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-17T01:49:10.859370] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T01:49:10.862527] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-17T01:49:11.576558] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T01:49:11.579746] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-17T01:49:12.163375] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T01:49:12.172356] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-17T01:49:12.253332] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T01:49:12.262585] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-17T01:49:12.431305] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T01:49:12.551699] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T01:49:12.690175] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-17T01:49:13.246419] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T01:49:13.490190] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-17T01:49:13.796191] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T01:49:13.833110] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T01:49:14.128212] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T01:49:14.290347] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-17T01:49:15.090192] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-17T01:49:15.890153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-17T01:49:15.952681] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T01:49:16.397018] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T01:49:16.690197] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-17T01:49:17.100490] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T01:49:17.490255] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-17T01:49:18.290160] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-17T01:49:18.408111] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T01:49:18.907368] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T01:49:19.090144] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-17T01:49:19.890187] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-17T01:49:20.250435] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T01:49:20.690176] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-17T01:49:20.778411] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T01:49:20.813451] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T01:49:21.490214] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-17T01:49:22.290190] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-17T01:49:22.450845] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T01:49:22.896270] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T01:49:23.090142] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-17T01:49:23.242954] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T01:49:23.597492] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T01:49:23.599269] [INFO ] [REMOTE ] AFB: Full fetch complete (16360 records). [2025-09-17T01:49:23.599363] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-17T01:49:23.890125] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-17T01:49:23.974078] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-17T01:49:23.974199] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-17T01:49:23.974604] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-17T01:49:23.974689] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-17T01:49:23.975375] [DEBUG] [LOCAL ] AFB: Trimmed 16360 records to 11419 (keeping 200 days of data) [2025-09-17T01:49:24.044362] [DEBUG] [LOCAL ] AFB: Primary data saved (11419 records). [2025-09-17T01:49:24.044532] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-17T01:49:24.044628] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AFB took 17.9s. Estimated remaining: 5h 0m 12s. Rate: 7.8 symbols/min [2025-09-17T01:49:24.228614] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:24.253128] [DEBUG] [LOCAL ] AFG: Loaded 23723 existing records from primary storage. [2025-09-17T01:49:24.253294] [INFO ] [MAIN ] AFG: Loaded 23723 existing records. [2025-09-17T01:49:24.445062] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:24.445339] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-17T01:49:24.445405] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-17T01:49:24.446130] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-17T01:49:24.446191] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-17T01:49:24.698842] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-17T01:49:24.803584] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:25.490122] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-11. [2025-09-17T01:49:25.696658] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T01:49:26.290148] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-17T01:49:26.407330] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:49:26.857443] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T01:49:27.090133] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-17T01:49:27.890103] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-17T01:49:28.372911] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T01:49:28.480479] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T01:49:28.690134] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-17T01:49:29.295001] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T01:49:29.490117] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-17T01:49:30.290080] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-17T01:49:30.854015] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T01:49:31.049681] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T01:49:31.090097] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-17T01:49:31.890141] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-17T01:49:32.018865] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T01:49:32.640937] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T01:49:32.690123] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-17T01:49:33.490142] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-17T01:49:34.303402] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-17T01:49:34.308961] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T01:49:34.356171] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T01:49:35.005320] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T01:49:35.011445] [INFO ] [REMOTE ] AESI: Full fetch complete (70038 records). [2025-09-17T01:49:35.011597] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-17T01:49:35.095302] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-17T01:49:35.410933] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-17T01:49:35.411053] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-17T01:49:35.411863] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-17T01:49:35.412005] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-17T01:49:35.413521] [DEBUG] [LOCAL ] AESI: Trimmed 70038 records to 49577 (keeping 200 days of data) [2025-09-17T01:49:35.429188] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T01:49:35.739766] [DEBUG] [LOCAL ] AESI: Primary data saved (49577 records). [2025-09-17T01:49:35.740043] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-17T01:49:35.740180] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AESI took 29.6s. Estimated remaining: 5h 3m 44s. Rate: 7.7 symbols/min [2025-09-17T01:49:35.891717] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-17T01:49:35.911825] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:35.912755] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-09-17T01:49:35.912816] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-09-17T01:49:35.912983] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-17T01:49:35.913059] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-17T01:49:35.913154] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-17T01:49:35.913229] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-17T01:49:36.280339] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:36.690156] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-11. [2025-09-17T01:49:36.967981] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-11 (0.28 seconds). [2025-09-17T01:49:37.290893] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-17T01:49:37.319586] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T01:49:37.490136] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-17T01:49:38.290137] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-17T01:49:39.090172] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-17T01:49:39.459943] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:49:39.576820] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T01:49:39.890148] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-17T01:49:40.518780] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T01:49:40.525016] [INFO ] [REMOTE ] AER: Full fetch complete (69330 records). [2025-09-17T01:49:40.525191] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-17T01:49:40.701849] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-17T01:49:40.934258] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-17T01:49:40.934402] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-17T01:49:40.935171] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-17T01:49:40.935229] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-17T01:49:40.936725] [DEBUG] [LOCAL ] AER: Trimmed 69330 records to 48929 (keeping 200 days of data) [2025-09-17T01:49:41.258574] [DEBUG] [LOCAL ] AER: Primary data saved (48929 records). [2025-09-17T01:49:41.258800] [INFO ] [MAIN ] AER: Full history saved. [2025-09-17T01:49:41.259060] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AER took 35.1s. Estimated remaining: 5h 1m 31s. Rate: 7.7 symbols/min [2025-09-17T01:49:41.343498] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T01:49:41.444738] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:41.468844] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T01:49:41.470749] [DEBUG] [LOCAL ] AFGC: Loaded 2047 existing records from primary storage. [2025-09-17T01:49:41.478704] [INFO ] [MAIN ] AFGC: Loaded 2047 existing records. [2025-09-17T01:49:41.500499] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-17T01:49:41.669613] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:41.669881] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-17T01:49:41.669940] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-17T01:49:41.670292] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-17T01:49:41.670368] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-17T01:49:42.037618] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:42.290148] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-17T01:49:43.090154] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-11. [2025-09-17T01:49:43.353937] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T01:49:43.360470] [INFO ] [REMOTE ] AES: Full fetch complete (77586 records). [2025-09-17T01:49:43.360626] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-17T01:49:43.545330] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T01:49:43.772103] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-17T01:49:43.772345] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-17T01:49:43.773285] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-17T01:49:43.773382] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-17T01:49:43.774899] [DEBUG] [LOCAL ] AES: Trimmed 77586 records to 53674 (keeping 200 days of data) [2025-09-17T01:49:43.862269] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T01:49:43.891229] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-17T01:49:44.142668] [DEBUG] [LOCAL ] AES: Primary data saved (53674 records). [2025-09-17T01:49:44.142823] [INFO ] [MAIN ] AES: Full history saved. [2025-09-17T01:49:44.142918] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AES took 38.0s. Estimated remaining: 4h 57m 5s. Rate: 7.8 symbols/min [2025-09-17T01:49:44.303240] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T01:49:44.319938] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:44.325110] [DEBUG] [LOCAL ] AFGD: Loaded 1344 existing records from primary storage. [2025-09-17T01:49:44.325196] [INFO ] [MAIN ] AFGD: Loaded 1344 existing records. [2025-09-17T01:49:44.503310] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:44.503555] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-17T01:49:44.503628] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-17T01:49:44.503892] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-17T01:49:44.503954] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-17T01:49:44.695341] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-17T01:49:44.879186] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:45.248840] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T01:49:45.490139] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-17T01:49:45.788587] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T01:49:46.290126] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-17T01:49:46.733052] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T01:49:47.090136] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-17T01:49:47.890132] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-17T01:49:48.479157] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T01:49:48.499916] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T01:49:48.690128] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-11. [2025-09-17T01:49:49.143433] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T01:49:49.490123] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-17T01:49:50.290125] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-17T01:49:50.861523] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T01:49:50.861397] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T01:49:51.090168] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-17T01:49:51.713991] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T01:49:51.890129] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-17T01:49:52.329130] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T01:49:52.690143] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-17T01:49:53.074328] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T01:49:53.490149] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-17T01:49:54.049635] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T01:49:54.290143] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-17T01:49:55.090182] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-17T01:49:55.552012] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T01:49:55.711841] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T01:49:55.890127] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-17T01:49:56.690163] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-17T01:49:56.988295] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T01:49:57.248777] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T01:49:57.490134] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-17T01:49:58.048938] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T01:49:58.290132] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-17T01:49:58.764232] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T01:49:59.090133] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-17T01:49:59.621752] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T01:49:59.890181] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-17T01:50:00.329693] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T01:50:00.690186] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-17T01:50:01.373797] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T01:50:01.490138] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-17T01:50:02.290135] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-17T01:50:02.647570] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:50:02.651920] [INFO ] [REMOTE ] AFG: Full fetch complete (45431 records). [2025-09-17T01:50:02.652039] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-17T01:50:02.843050] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T01:50:03.042636] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-17T01:50:03.042772] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-17T01:50:03.043326] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-17T01:50:03.043387] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-17T01:50:03.044878] [DEBUG] [LOCAL ] AFG: Trimmed 45431 records to 32732 (keeping 200 days of data) [2025-09-17T01:50:03.104668] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-17T01:50:03.255801] [DEBUG] [LOCAL ] AFG: Primary data saved (32732 records). [2025-09-17T01:50:03.255975] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-17T01:50:03.256087] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AFG took 39.2s. Estimated remaining: 5h 6m 48s. Rate: 7.6 symbols/min [2025-09-17T01:50:03.429301] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:03.429521] [DEBUG] [LOCAL ] AFGE: No existing data file found in primary storage. [2025-09-17T01:50:03.429572] [WARN ] [MAIN ] AFGE: No existing data found, performing full refresh instead. [2025-09-17T01:50:03.429733] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-17T01:50:03.429798] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-17T01:50:03.429851] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-17T01:50:03.429902] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-17T01:50:03.543605] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T01:50:03.805194] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:03.890114] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-11. [2025-09-17T01:50:04.335430] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T01:50:04.690148] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-17T01:50:05.145637] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T01:50:05.490182] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-17T01:50:05.966879] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T01:50:06.290134] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-17T01:50:06.776348] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T01:50:07.090120] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-17T01:50:07.537701] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T01:50:07.890183] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-17T01:50:08.374996] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T01:50:08.690139] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-17T01:50:09.135806] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T01:50:09.490149] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-17T01:50:09.950343] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T01:50:10.290129] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-17T01:50:10.738787] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T01:50:11.090213] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-17T01:50:11.565942] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T01:50:11.890148] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-17T01:50:12.389508] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T01:50:12.690153] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-17T01:50:13.180489] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T01:50:13.490160] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-17T01:50:13.943884] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T01:50:14.290136] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-17T01:50:14.606132] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T01:50:14.607404] [INFO ] [REMOTE ] AFGC: Full fetch complete (3646 records). [2025-09-17T01:50:14.607509] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-17T01:50:14.973989] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-17T01:50:14.974090] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-17T01:50:14.974216] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-17T01:50:14.974262] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-17T01:50:14.974633] [DEBUG] [LOCAL ] AFGC: Trimmed 3646 records to 2528 (keeping 200 days of data) [2025-09-17T01:50:14.990590] [DEBUG] [LOCAL ] AFGC: Primary data saved (2528 records). [2025-09-17T01:50:14.990694] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-17T01:50:14.990788] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 33.7s. Estimated remaining: 5h 9m 53s. Rate: 7.5 symbols/min [2025-09-17T01:50:15.095275] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-17T01:50:15.162390] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:15.206112] [DEBUG] [LOCAL ] AFL: Loaded 39605 existing records from primary storage. [2025-09-17T01:50:15.206301] [INFO ] [MAIN ] AFL: Loaded 39605 existing records. [2025-09-17T01:50:15.384310] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:15.384540] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-17T01:50:15.384604] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-17T01:50:15.386038] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-17T01:50:15.386111] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-17T01:50:15.672208] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T01:50:15.750621] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:15.890121] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-11. [2025-09-17T01:50:16.690155] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-17T01:50:17.356448] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T01:50:17.490145] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-17T01:50:17.685735] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T01:50:17.815673] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T01:50:17.816693] [INFO ] [REMOTE ] AFGD: Full fetch complete (3194 records). [2025-09-17T01:50:17.816777] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-17T01:50:18.182686] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-17T01:50:18.182819] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-17T01:50:18.182979] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-17T01:50:18.183036] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-17T01:50:18.183407] [DEBUG] [LOCAL ] AFGD: Trimmed 3194 records to 1851 (keeping 200 days of data) [2025-09-17T01:50:18.198484] [DEBUG] [LOCAL ] AFGD: Primary data saved (1851 records). [2025-09-17T01:50:18.198611] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-17T01:50:18.198717] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGD took 34.1s. Estimated remaining: 5h 5m 48s. Rate: 7.6 symbols/min [2025-09-17T01:50:18.295203] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-17T01:50:18.384015] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:18.423509] [DEBUG] [LOCAL ] AG: Loaded 39996 existing records from primary storage. [2025-09-17T01:50:18.423739] [INFO ] [MAIN ] AG: Loaded 39996 existing records. [2025-09-17T01:50:18.603260] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:18.603528] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-17T01:50:18.603580] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-17T01:50:18.604539] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-17T01:50:18.604611] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-17T01:50:18.763635] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T01:50:18.851444] [INFO ] [REMOTE ] AFGE: Full fetch complete (3466 records). [2025-09-17T01:50:18.879123] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-17T01:50:19.091285] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-17T01:50:19.116125] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:19.338428] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-17T01:50:19.338558] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-17T01:50:19.338724] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-17T01:50:19.338783] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-17T01:50:19.339157] [DEBUG] [LOCAL ] AFGE: Trimmed 3466 records to 2498 (keeping 200 days of data) [2025-09-17T01:50:19.355631] [DEBUG] [LOCAL ] AFGE: Primary data saved (2498 records). [2025-09-17T01:50:19.355784] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-17T01:50:19.355869] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGE took 16.1s. Estimated remaining: 5h 0m 14s. Rate: 7.7 symbols/min [2025-09-17T01:50:19.530930] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:19.568904] [DEBUG] [LOCAL ] AGCO: Loaded 31416 existing records from primary storage. [2025-09-17T01:50:19.569110] [INFO ] [MAIN ] AGCO: Loaded 31416 existing records. [2025-09-17T01:50:19.758341] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:19.758658] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-17T01:50:19.758722] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-17T01:50:19.759839] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-17T01:50:19.759901] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-17T01:50:19.900973] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-11. [2025-09-17T01:50:20.126472] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:20.690128] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-17T01:50:21.063344] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T01:50:21.168952] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T01:50:21.490156] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-11. [2025-09-17T01:50:21.556579] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:50:22.290144] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-17T01:50:23.090110] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-17T01:50:23.136517] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T01:50:23.806157] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T01:50:23.890166] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-17T01:50:24.690151] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-17T01:50:25.010691] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T01:50:25.235788] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T01:50:25.490170] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-17T01:50:25.806864] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-17T01:50:26.290209] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-17T01:50:26.419367] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T01:50:27.090186] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-17T01:50:27.481993] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T01:50:27.482879] [INFO ] [REMOTE ] AFGB: Full fetch complete (3603 records). [2025-09-17T01:50:27.482979] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-17T01:50:27.842236] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-17T01:50:27.842336] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-17T01:50:27.842463] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-17T01:50:27.842512] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-17T01:50:27.842953] [DEBUG] [LOCAL ] AFGB: Trimmed 3603 records to 2539 (keeping 200 days of data) [2025-09-17T01:50:27.859157] [DEBUG] [LOCAL ] AFGB: Primary data saved (2539 records). [2025-09-17T01:50:27.859249] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-17T01:50:27.859353] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGB took 52.1s. Estimated remaining: 5h 0m 41s. Rate: 7.7 symbols/min [2025-09-17T01:50:27.895251] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-17T01:50:28.040764] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:28.057010] [DEBUG] [LOCAL ] AGD: Loaded 13784 existing records from primary storage. [2025-09-17T01:50:28.057176] [INFO ] [MAIN ] AGD: Loaded 13784 existing records. [2025-09-17T01:50:28.244770] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:28.245370] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-17T01:50:28.245442] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-17T01:50:28.245870] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-17T01:50:28.245948] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-17T01:50:28.453673] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T01:50:28.653045] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:28.690103] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-11. [2025-09-17T01:50:29.490156] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-17T01:50:29.527507] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T01:50:29.542836] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T01:50:30.290110] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-17T01:50:31.090128] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-17T01:50:31.160352] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T01:50:31.462264] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T01:50:31.890134] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-17T01:50:32.609516] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T01:50:32.690112] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-17T01:50:33.490125] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-17T01:50:33.904427] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T01:50:34.165741] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T01:50:34.290127] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-17T01:50:35.066351] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T01:50:35.090085] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-17T01:50:35.890101] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-17T01:50:35.971059] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T01:50:36.355932] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T01:50:36.690152] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-17T01:50:37.490144] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-17T01:50:37.832493] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T01:50:38.290112] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-17T01:50:38.431024] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:50:38.604002] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T01:50:39.090132] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-17T01:50:39.650773] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T01:50:39.890121] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-17T01:50:40.690146] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-17T01:50:40.721318] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T01:50:40.945616] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T01:50:41.490176] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-17T01:50:42.290093] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-17T01:50:42.315148] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T01:50:42.777484] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T01:50:43.090128] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-17T01:50:43.725115] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T01:50:43.890128] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-17T01:50:44.674483] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T01:50:44.690104] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-17T01:50:44.934042] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T01:50:45.490122] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-17T01:50:45.727983] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T01:50:46.290194] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-17T01:50:46.977154] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T01:50:47.090135] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-17T01:50:47.890151] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-17T01:50:47.992025] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T01:50:47.998592] [INFO ] [REMOTE ] AFL: Full fetch complete (76756 records). [2025-09-17T01:50:47.998789] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-17T01:50:48.385380] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-17T01:50:48.385487] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-17T01:50:48.386228] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-17T01:50:48.386292] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-17T01:50:48.387763] [DEBUG] [LOCAL ] AFL: Trimmed 76756 records to 53150 (keeping 200 days of data) [2025-09-17T01:50:48.655444] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T01:50:48.718168] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-17T01:50:48.766605] [DEBUG] [LOCAL ] AFL: Primary data saved (53150 records). [2025-09-17T01:50:48.766789] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-17T01:50:48.766910] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AFL took 33.8s. Estimated remaining: 5h 10m 43s. Rate: 7.5 symbols/min [2025-09-17T01:50:48.937737] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:48.978779] [DEBUG] [LOCAL ] AGI: Loaded 39794 existing records from primary storage. [2025-09-17T01:50:48.978956] [INFO ] [MAIN ] AGI: Loaded 39794 existing records. [2025-09-17T01:50:49.158030] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:49.158358] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-17T01:50:49.158543] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-17T01:50:49.159505] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-17T01:50:49.159589] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-17T01:50:49.461597] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T01:50:49.509958] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-17T01:50:49.572726] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:49.586273] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T01:50:50.290150] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-17T01:50:51.097519] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-17T01:50:51.118225] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T01:50:51.890114] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-17T01:50:52.194903] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T01:50:52.353842] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T01:50:52.690137] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-11. [2025-09-17T01:50:53.286561] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T01:50:53.291906] [INFO ] [REMOTE ] AGCO: Full fetch complete (62086 records). [2025-09-17T01:50:53.292075] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-17T01:50:53.500328] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-17T01:50:53.673890] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-17T01:50:53.673988] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-17T01:50:53.674671] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-17T01:50:53.674740] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-17T01:50:53.676588] [DEBUG] [LOCAL ] AGCO: Trimmed 62086 records to 42801 (keeping 200 days of data) [2025-09-17T01:50:53.943905] [DEBUG] [LOCAL ] AGCO: Primary data saved (42801 records). [2025-09-17T01:50:53.944065] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-17T01:50:53.944167] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGCO took 34.6s. Estimated remaining: 5h 8m 24s. Rate: 7.5 symbols/min [2025-09-17T01:50:54.121432] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:54.169954] [DEBUG] [LOCAL ] AGL: Loaded 39074 existing records from primary storage. [2025-09-17T01:50:54.170141] [INFO ] [MAIN ] AGL: Loaded 39074 existing records. [2025-09-17T01:50:54.290619] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-17T01:50:54.411467] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:54.411986] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-17T01:50:54.412062] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-17T01:50:54.413137] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-17T01:50:54.413233] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-17T01:50:54.554861] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T01:50:54.820012] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:55.090124] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-11. [2025-09-17T01:50:55.147856] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T01:50:55.150945] [INFO ] [REMOTE ] AGD: Full fetch complete (24995 records). [2025-09-17T01:50:55.151044] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-17T01:50:55.548054] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-17T01:50:55.548170] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-17T01:50:55.548517] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-17T01:50:55.548573] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-17T01:50:55.549305] [DEBUG] [LOCAL ] AGD: Trimmed 24995 records to 17535 (keeping 200 days of data) [2025-09-17T01:50:55.663553] [DEBUG] [LOCAL ] AGD: Primary data saved (17535 records). [2025-09-17T01:50:55.663828] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-17T01:50:55.663950] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AGD took 27.8s. Estimated remaining: 5h 3m 37s. Rate: 7.6 symbols/min [2025-09-17T01:50:55.848363] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:55.886795] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-17T01:50:55.898126] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-17T01:50:55.904340] [DEBUG] [LOCAL ] AGM: Loaded 8023 existing records from primary storage. [2025-09-17T01:50:55.904956] [INFO ] [MAIN ] AGM: Loaded 8023 existing records. [2025-09-17T01:50:56.100048] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:56.100342] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-17T01:50:56.100408] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-17T01:50:56.100742] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-17T01:50:56.100802] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-17T01:50:56.466095] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:56.537541] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T01:50:56.690118] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-17T01:50:57.490132] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-11. [2025-09-17T01:50:57.679990] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T01:50:58.290131] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-17T01:50:58.303140] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T01:50:58.368311] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T01:50:59.090136] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-17T01:50:59.890116] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-17T01:51:00.066370] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:51:00.615575] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T01:51:00.690088] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-17T01:51:01.221186] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T01:51:01.489330] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T01:51:01.490852] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-17T01:51:02.290181] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-17T01:51:03.090173] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-17T01:51:03.890198] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-17T01:51:04.710144] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T01:51:04.712008] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-17T01:51:04.947425] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-09-17T01:51:05.467209] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T01:51:05.490140] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-17T01:51:05.570545] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-17T01:51:06.290142] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-17T01:51:06.364866] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T01:51:06.559962] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (4.27 seconds). [2025-09-17T01:51:06.566585] [INFO ] [REMOTE ] AG: Full fetch complete (77427 records). [2025-09-17T01:51:06.566782] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-17T01:51:06.974663] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-17T01:51:06.974800] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-17T01:51:06.975527] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-17T01:51:06.975583] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-17T01:51:06.977045] [DEBUG] [LOCAL ] AG: Trimmed 77427 records to 53641 (keeping 200 days of data) [2025-09-17T01:51:07.090862] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-17T01:51:07.305218] [DEBUG] [LOCAL ] AG: Primary data saved (53641 records). [2025-09-17T01:51:07.305385] [INFO ] [MAIN ] AG: Full history saved. [2025-09-17T01:51:07.305474] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AG took 49.1s. Estimated remaining: 5h 6m 15s. Rate: 7.6 symbols/min [2025-09-17T01:51:07.476227] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:07.496501] [DEBUG] [LOCAL ] AGO: Loaded 20430 existing records from primary storage. [2025-09-17T01:51:07.496670] [INFO ] [MAIN ] AGO: Loaded 20430 existing records. [2025-09-17T01:51:07.679335] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:07.679705] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-17T01:51:07.679848] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-17T01:51:07.685763] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-17T01:51:07.686067] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T01:51:07.686216] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-17T01:51:07.898440] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-17T01:51:08.059803] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:08.153954] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T01:51:08.690165] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-17T01:51:09.023989] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T01:51:09.490151] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-11. [2025-09-17T01:51:10.290118] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-17T01:51:10.321443] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:51:10.630570] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T01:51:11.090190] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-17T01:51:11.890183] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-17T01:51:12.265076] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T01:51:12.383621] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T01:51:12.690194] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-17T01:51:12.745948] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T01:51:13.490131] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-17T01:51:14.290202] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-17T01:51:14.298987] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T01:51:15.090100] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-17T01:51:15.641867] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-17T01:51:15.890141] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-17T01:51:16.440992] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T01:51:16.629082] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T01:51:16.630705] [INFO ] [REMOTE ] AGM: Full fetch complete (12331 records). [2025-09-17T01:51:16.630790] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-17T01:51:16.695877] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-17T01:51:17.001488] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-17T01:51:17.001595] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-17T01:51:17.001927] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-17T01:51:17.002031] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-17T01:51:17.002593] [DEBUG] [LOCAL ] AGM: Trimmed 12331 records to 9795 (keeping 200 days of data) [2025-09-17T01:51:17.071568] [DEBUG] [LOCAL ] AGM: Primary data saved (9795 records). [2025-09-17T01:51:17.071746] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-17T01:51:17.071848] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 21.4s. Estimated remaining: 5h 7m 25s. Rate: 7.5 symbols/min [2025-09-17T01:51:17.239069] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:17.261375] [DEBUG] [LOCAL ] AGRO: Loaded 24149 existing records from primary storage. [2025-09-17T01:51:17.261541] [INFO ] [MAIN ] AGRO: Loaded 24149 existing records. [2025-09-17T01:51:17.439885] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:17.440128] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-17T01:51:17.440183] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-17T01:51:17.440821] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-17T01:51:17.440878] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-17T01:51:17.504056] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-17T01:51:17.799229] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:17.815123] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T01:51:17.853763] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T01:51:18.290200] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-11. [2025-09-17T01:51:19.090179] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-17T01:51:19.245670] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T01:51:19.311631] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T01:51:19.890089] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-17T01:51:20.350255] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T01:51:20.690164] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-17T01:51:21.313214] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T01:51:21.490136] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-17T01:51:22.135932] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T01:51:22.290156] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-17T01:51:23.090184] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-17T01:51:23.218490] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T01:51:23.487074] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T01:51:23.890177] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-17T01:51:24.629014] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T01:51:24.690088] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-17T01:51:25.490143] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-17T01:51:25.669948] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T01:51:26.290181] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-17T01:51:26.545088] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T01:51:26.889001] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T01:51:27.090111] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-17T01:51:27.407544] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T01:51:27.890162] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-17T01:51:28.690161] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-17T01:51:28.730953] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T01:51:28.737733] [INFO ] [REMOTE ] AGI: Full fetch complete (76497 records). [2025-09-17T01:51:28.737907] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-17T01:51:29.139101] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-17T01:51:29.139215] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-17T01:51:29.140013] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-17T01:51:29.140082] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-17T01:51:29.143436] [DEBUG] [LOCAL ] AGI: Trimmed 76497 records to 53412 (keeping 200 days of data) [2025-09-17T01:51:29.277848] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T01:51:29.492201] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-17T01:51:29.506393] [DEBUG] [LOCAL ] AGI: Primary data saved (53412 records). [2025-09-17T01:51:29.506707] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-17T01:51:29.506806] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGI took 40.7s. Estimated remaining: 5h 10m 25s. Rate: 7.5 symbols/min [2025-09-17T01:51:29.676970] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:29.700991] [DEBUG] [LOCAL ] AGX: Loaded 24652 existing records from primary storage. [2025-09-17T01:51:29.701138] [INFO ] [MAIN ] AGX: Loaded 24652 existing records. [2025-09-17T01:51:29.884857] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:29.885262] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-17T01:51:29.885378] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-17T01:51:29.891790] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-17T01:51:29.902786] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-17T01:51:29.903912] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T01:51:30.268815] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:30.290078] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-11. [2025-09-17T01:51:30.847752] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T01:51:31.090188] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-17T01:51:31.451677] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T01:51:31.890162] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-17T01:51:32.341290] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T01:51:32.690145] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-17T01:51:33.007953] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T01:51:33.490157] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-17T01:51:34.125371] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T01:51:34.157928] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T01:51:34.161899] [INFO ] [REMOTE ] AGO: Full fetch complete (39110 records). [2025-09-17T01:51:34.162071] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-17T01:51:34.295314] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-17T01:51:34.563888] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-17T01:51:34.564003] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-17T01:51:34.564628] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-17T01:51:34.564728] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-17T01:51:34.565915] [DEBUG] [LOCAL ] AGO: Trimmed 39110 records to 28268 (keeping 200 days of data) [2025-09-17T01:51:34.747772] [DEBUG] [LOCAL ] AGO: Primary data saved (28268 records). [2025-09-17T01:51:34.748059] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-17T01:51:34.748153] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 27.4s. Estimated remaining: 5h 8m 21s. Rate: 7.5 symbols/min [2025-09-17T01:51:34.933720] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:34.965027] [DEBUG] [LOCAL ] AHH: Loaded 29751 existing records from primary storage. [2025-09-17T01:51:34.965219] [INFO ] [MAIN ] AHH: Loaded 29751 existing records. [2025-09-17T01:51:35.105252] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-17T01:51:35.145081] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:35.145350] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-17T01:51:35.145409] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-17T01:51:35.146202] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-17T01:51:35.146264] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-17T01:51:35.504946] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:35.890147] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-17T01:51:36.144223] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T01:51:36.593851] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T01:51:36.690139] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-17T01:51:37.175094] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T01:51:37.490136] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-17T01:51:38.259395] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T01:51:38.290088] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-17T01:51:39.090114] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-17T01:51:39.475203] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T01:51:39.505892] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T01:51:39.890152] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-17T01:51:40.143666] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T01:51:40.690137] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-11. [2025-09-17T01:51:41.497378] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-17T01:51:41.501238] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T01:51:41.507927] [INFO ] [REMOTE ] AGL: Full fetch complete (75240 records). [2025-09-17T01:51:41.508059] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-17T01:51:41.905746] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-17T01:51:41.905851] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-17T01:51:41.906558] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-17T01:51:41.906613] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-17T01:51:41.908309] [DEBUG] [LOCAL ] AGL: Trimmed 75240 records to 52404 (keeping 200 days of data) [2025-09-17T01:51:42.223970] [DEBUG] [LOCAL ] AGL: Primary data saved (52404 records). [2025-09-17T01:51:42.224795] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T01:51:42.233167] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-17T01:51:42.233286] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGL took 48.3s. Estimated remaining: 5h 7m 52s. Rate: 7.5 symbols/min [2025-09-17T01:51:42.296123] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-17T01:51:42.403772] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:42.403954] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-17T01:51:42.404001] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-17T01:51:42.404104] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-17T01:51:42.404154] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-17T01:51:42.404200] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-17T01:51:42.404242] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-17T01:51:42.770035] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:42.791260] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T01:51:43.090177] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-11. [2025-09-17T01:51:43.297636] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:43.298032] [WARN ] [REMOTE ] AHL: No data returned for month 2024-11 [2025-09-17T01:51:43.890261] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-17T01:51:43.893162] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T01:51:44.690135] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-17T01:51:44.898469] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:44.898826] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-17T01:51:45.006581] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T01:51:45.490163] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-17T01:51:46.290096] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-17T01:51:46.755386] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T01:51:47.090198] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-17T01:51:47.347907] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:47.349312] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:51:47.356126] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-17T01:51:47.890122] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-17T01:51:48.690141] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-17T01:51:48.900541] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:48.900914] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-17T01:51:49.481483] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T01:51:49.490074] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-17T01:51:50.290146] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-17T01:51:50.928174] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T01:51:51.090138] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-17T01:51:51.150544] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T01:51:51.890124] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-17T01:51:52.506087] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T01:51:52.690151] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-17T01:51:53.097150] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T01:51:53.101074] [INFO ] [REMOTE ] AGRO: Full fetch complete (50030 records). [2025-09-17T01:51:53.101185] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-17T01:51:53.487687] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-17T01:51:53.487791] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-17T01:51:53.488314] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-17T01:51:53.488366] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-17T01:51:53.489510] [DEBUG] [LOCAL ] AGRO: Trimmed 50030 records to 34178 (keeping 200 days of data) [2025-09-17T01:51:53.490092] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-17T01:51:53.688809] [DEBUG] [LOCAL ] AGRO: Primary data saved (34178 records). [2025-09-17T01:51:53.688976] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-17T01:51:53.689084] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AGRO took 36.6s. Estimated remaining: 5h 10m 3s. Rate: 7.5 symbols/min [2025-09-17T01:51:53.857561] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:53.895490] [DEBUG] [LOCAL ] AHR: Loaded 36730 existing records from primary storage. [2025-09-17T01:51:53.895690] [INFO ] [MAIN ] AHR: Loaded 36730 existing records. [2025-09-17T01:51:54.079774] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:54.080043] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-17T01:51:54.080105] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-17T01:51:54.081020] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-17T01:51:54.081086] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-17T01:51:54.203521] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:54.260388] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-17T01:51:54.300340] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-17T01:51:54.447802] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:54.469956] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:51:54.605079] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:54.605394] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-17T01:51:55.090200] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-11. [2025-09-17T01:51:55.890158] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-17T01:51:56.399734] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T01:51:56.690132] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-17T01:51:57.361053] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T01:51:57.490129] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-17T01:51:58.290145] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-17T01:51:58.375602] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T01:51:58.990018] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T01:51:59.090135] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-17T01:51:59.630927] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T01:51:59.635700] [INFO ] [REMOTE ] AGX: Full fetch complete (48810 records). [2025-09-17T01:51:59.635841] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-17T01:51:59.895709] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-17T01:52:00.035900] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-17T01:52:00.036035] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-17T01:52:00.036689] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-17T01:52:00.036774] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-17T01:52:00.038376] [DEBUG] [LOCAL ] AGX: Trimmed 48810 records to 33599 (keeping 200 days of data) [2025-09-17T01:52:00.252225] [DEBUG] [LOCAL ] AGX: Primary data saved (33599 records). [2025-09-17T01:52:00.252381] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-17T01:52:00.252498] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AGX took 30.7s. Estimated remaining: 5h 8m 56s. Rate: 7.5 symbols/min [2025-09-17T01:52:00.424004] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:00.430554] [DEBUG] [LOCAL ] AHT: Loaded 4639 existing records from primary storage. [2025-09-17T01:52:00.430700] [INFO ] [MAIN ] AHT: Loaded 4639 existing records. [2025-09-17T01:52:00.610270] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:00.610517] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-17T01:52:00.610589] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-17T01:52:00.610909] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-17T01:52:00.610984] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-17T01:52:00.695262] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-17T01:52:00.990704] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:01.016192] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T01:52:01.313365] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T01:52:01.490089] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-17T01:52:01.903610] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T01:52:02.290192] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-17T01:52:03.071282] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T01:52:03.090132] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-17T01:52:03.383474] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T01:52:03.890161] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-11. [2025-09-17T01:52:04.546183] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T01:52:04.690088] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-17T01:52:04.772148] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T01:52:05.490175] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-17T01:52:05.612169] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T01:52:06.123343] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T01:52:06.290150] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-17T01:52:07.090147] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-17T01:52:07.805798] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T01:52:07.890146] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-17T01:52:08.460889] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T01:52:08.690145] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-17T01:52:09.497159] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-17T01:52:09.515422] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T01:52:09.801280] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T01:52:09.806994] [INFO ] [REMOTE ] AHL: Full fetch complete (15974 records). [2025-09-17T01:52:09.807124] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-17T01:52:09.988059] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 90 unique days, need 200 days [2025-09-17T01:52:09.988362] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:52:09.988418] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:52:09.988470] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-17T01:52:09.988574] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-17T01:52:09.988627] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-17T01:52:09.988708] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-17T01:52:09.988780] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AHL took 27.8s. Estimated remaining: 5h 9m 54s. Rate: 7.5 symbols/min [2025-09-17T01:52:10.161133] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:10.202365] [DEBUG] [LOCAL ] AI: Loaded 40117 existing records from primary storage. [2025-09-17T01:52:10.202566] [INFO ] [MAIN ] AI: Loaded 40117 existing records. [2025-09-17T01:52:10.298936] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-17T01:52:10.409531] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:10.409797] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-17T01:52:10.409856] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-17T01:52:10.410771] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-17T01:52:10.410835] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-17T01:52:10.810885] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:11.044260] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T01:52:11.090228] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-17T01:52:11.656151] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T01:52:11.890186] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-17T01:52:12.566740] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T01:52:12.630356] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T01:52:12.690152] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-11. [2025-09-17T01:52:13.490157] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-17T01:52:14.290163] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-17T01:52:14.650163] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T01:52:14.938416] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-11 (2.25 seconds). [2025-09-17T01:52:15.031595] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T01:52:15.090157] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-17T01:52:15.890187] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-17T01:52:16.690188] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-17T01:52:17.200283] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T01:52:17.204635] [INFO ] [REMOTE ] AHH: Full fetch complete (60468 records). [2025-09-17T01:52:17.204795] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-17T01:52:17.495340] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-17T01:52:17.601924] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-17T01:52:17.602026] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-17T01:52:17.602627] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-17T01:52:17.602698] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-17T01:52:17.603896] [DEBUG] [LOCAL ] AHH: Trimmed 60468 records to 41687 (keeping 200 days of data) [2025-09-17T01:52:17.850208] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-17T01:52:17.894695] [DEBUG] [LOCAL ] AHH: Primary data saved (41687 records). [2025-09-17T01:52:17.894870] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-17T01:52:17.894982] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AHH took 43.1s. Estimated remaining: 5h 9m 41s. Rate: 7.5 symbols/min [2025-09-17T01:52:18.071914] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:18.116618] [DEBUG] [LOCAL ] AIG: Loaded 39844 existing records from primary storage. [2025-09-17T01:52:18.116800] [INFO ] [MAIN ] AIG: Loaded 39844 existing records. [2025-09-17T01:52:18.294009] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-17T01:52:18.294235] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:18.295632] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-17T01:52:18.295874] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-17T01:52:18.297357] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-17T01:52:18.297446] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-17T01:52:18.494017] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T01:52:18.635375] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T01:52:18.719174] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:19.090133] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-17T01:52:19.890144] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-11. [2025-09-17T01:52:20.342023] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T01:52:20.690156] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-17T01:52:20.894929] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-17T01:52:21.490193] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-17T01:52:21.562231] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T01:52:22.290175] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-17T01:52:22.411464] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T01:52:23.090239] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-17T01:52:23.563861] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T01:52:23.693363] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T01:52:23.890154] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-17T01:52:24.537112] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T01:52:24.543248] [INFO ] [REMOTE ] AHR: Full fetch complete (70934 records). [2025-09-17T01:52:24.543444] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-17T01:52:24.695261] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-17T01:52:24.943845] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-17T01:52:24.943972] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-17T01:52:24.944763] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-17T01:52:24.944846] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-17T01:52:24.946353] [DEBUG] [LOCAL ] AHR: Trimmed 70934 records to 49406 (keeping 200 days of data) [2025-09-17T01:52:25.251678] [DEBUG] [LOCAL ] AHR: Primary data saved (49406 records). [2025-09-17T01:52:25.251851] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-17T01:52:25.251950] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHR took 31.6s. Estimated remaining: 5h 9m 7s. Rate: 7.5 symbols/min [2025-09-17T01:52:25.430708] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:25.430940] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-17T01:52:25.430985] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-17T01:52:25.431130] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-17T01:52:25.431175] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-17T01:52:25.431221] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-17T01:52:25.431257] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-17T01:52:25.499012] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-17T01:52:25.788406] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:25.861584] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T01:52:26.268697] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T01:52:26.290153] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-17T01:52:26.536983] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T01:52:27.090146] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-17T01:52:27.890179] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-17T01:52:28.414227] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T01:52:28.497781] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T01:52:28.690120] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-11. [2025-09-17T01:52:28.719418] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:52:28.937741] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:28.938169] [WARN ] [REMOTE ] AII: No data returned for month 2024-11 [2025-09-17T01:52:29.490136] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-17T01:52:29.711068] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:29.711381] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-17T01:52:30.290148] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-17T01:52:30.507152] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:30.507489] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-17T01:52:31.090159] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-17T01:52:31.890169] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-17T01:52:32.111190] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:32.111520] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-17T01:52:32.690167] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-17T01:52:32.969319] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T01:52:33.467455] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T01:52:33.490090] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-17T01:52:34.212831] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T01:52:34.290177] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-17T01:52:35.019178] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T01:52:35.090101] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-17T01:52:35.890149] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-17T01:52:36.549718] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T01:52:36.551120] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T01:52:36.563306] [INFO ] [REMOTE ] AHT: Full fetch complete (9486 records). [2025-09-17T01:52:36.563714] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-17T01:52:36.703816] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-17T01:52:36.926257] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-17T01:52:36.926380] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-17T01:52:36.926679] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-17T01:52:36.926734] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-17T01:52:36.927208] [DEBUG] [LOCAL ] AHT: Trimmed 9486 records to 5923 (keeping 200 days of data) [2025-09-17T01:52:36.966357] [DEBUG] [LOCAL ] AHT: Primary data saved (5923 records). [2025-09-17T01:52:36.966545] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-17T01:52:36.966681] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AHT took 36.7s. Estimated remaining: 5h 11m 13s. Rate: 7.4 symbols/min [2025-09-17T01:52:37.142831] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:37.160408] [DEBUG] [LOCAL ] AIN: Loaded 18026 existing records from primary storage. [2025-09-17T01:52:37.160549] [INFO ] [MAIN ] AIN: Loaded 18026 existing records. [2025-09-17T01:52:37.346539] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:37.346859] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-17T01:52:37.346917] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-17T01:52:37.347533] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-17T01:52:37.347596] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-17T01:52:37.501314] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-17T01:52:37.726843] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:38.290197] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-17T01:52:38.497378] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:38.497782] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-17T01:52:39.090143] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-17T01:52:39.285002] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-17T01:52:39.296833] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:39.297941] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-17T01:52:39.460823] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T01:52:39.890191] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-17T01:52:40.483302] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T01:52:40.690122] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-17T01:52:41.490155] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-17T01:52:41.736530] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T01:52:42.290141] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-11. [2025-09-17T01:52:43.090152] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-17T01:52:43.544781] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T01:52:43.893937] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-17T01:52:43.898070] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T01:52:43.978046] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-17T01:52:44.690135] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-17T01:52:44.794346] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T01:52:45.191766] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T01:52:45.490174] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-17T01:52:46.290128] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-17T01:52:46.353456] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T01:52:46.355942] [INFO ] [REMOTE ] AII: Full fetch complete (9600 records). [2025-09-17T01:52:46.356025] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-17T01:52:46.535614] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 90 unique days, need 200 days [2025-09-17T01:52:46.535897] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:52:46.535946] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:52:46.536000] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-17T01:52:46.536064] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-17T01:52:46.536133] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-17T01:52:46.536191] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-17T01:52:46.536263] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AII took 21.3s. Estimated remaining: 5h 11m 58s. Rate: 7.4 symbols/min [2025-09-17T01:52:46.710595] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:46.721060] [DEBUG] [LOCAL ] AIO: Loaded 9228 existing records from primary storage. [2025-09-17T01:52:46.721213] [INFO ] [MAIN ] AIO: Loaded 9228 existing records. [2025-09-17T01:52:46.902600] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:46.902872] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-17T01:52:46.902932] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-17T01:52:46.903329] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-17T01:52:46.903394] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-17T01:52:47.095281] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-17T01:52:47.261567] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:47.890195] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-17T01:52:48.033385] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:52:48.690157] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-17T01:52:48.990413] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T01:52:49.490172] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-17T01:52:49.835664] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-17T01:52:50.290136] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-17T01:52:50.591024] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T01:52:50.612915] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T01:52:51.090124] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-17T01:52:51.890173] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-11. [2025-09-17T01:52:51.966772] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T01:52:52.690221] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-17T01:52:52.720759] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T01:52:52.896985] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-17T01:52:53.490135] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-17T01:52:53.768050] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T01:52:54.251563] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T01:52:54.290137] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-17T01:52:55.090208] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-17T01:52:55.890175] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-17T01:52:56.223390] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T01:52:56.690201] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-17T01:52:56.990013] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T01:52:57.362894] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-17T01:52:57.369669] [INFO ] [REMOTE ] AI: Full fetch complete (77884 records). [2025-09-17T01:52:57.369816] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-17T01:52:57.495225] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-17T01:52:57.775141] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-17T01:52:57.775249] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-17T01:52:57.776024] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-17T01:52:57.776108] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-17T01:52:57.777705] [DEBUG] [LOCAL ] AI: Trimmed 77884 records to 53749 (keeping 200 days of data) [2025-09-17T01:52:58.101266] [DEBUG] [LOCAL ] AI: Primary data saved (53749 records). [2025-09-17T01:52:58.101427] [INFO ] [MAIN ] AI: Full history saved. [2025-09-17T01:52:58.101540] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AI took 48.1s. Estimated remaining: 5h 13m 52s. Rate: 7.3 symbols/min [2025-09-17T01:52:58.275826] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:58.290095] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-17T01:52:58.297736] [DEBUG] [LOCAL ] AIR: Loaded 19453 existing records from primary storage. [2025-09-17T01:52:58.297829] [INFO ] [MAIN ] AIR: Loaded 19453 existing records. [2025-09-17T01:52:58.459035] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T01:52:58.504592] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:58.504860] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-17T01:52:58.504932] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-17T01:52:58.505500] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-17T01:52:58.505579] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-17T01:52:58.548583] [INFO ] [REMOTE ] AIG: Full fetch complete (77210 records). [2025-09-17T01:52:58.580760] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-17T01:52:59.178350] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:59.194375] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-11. [2025-09-17T01:52:59.265166] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T01:52:59.322720] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-17T01:52:59.325601] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-17T01:52:59.325525] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T01:52:59.330169] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-17T01:52:59.334237] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-17T01:52:59.336014] [DEBUG] [LOCAL ] AIG: Trimmed 77210 records to 53477 (keeping 200 days of data) [2025-09-17T01:52:59.671350] [DEBUG] [LOCAL ] AIG: Primary data saved (53477 records). [2025-09-17T01:52:59.671515] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-17T01:52:59.671662] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AIG took 41.8s. Estimated remaining: 5h 9m 53s. Rate: 7.4 symbols/min [2025-09-17T01:52:59.842485] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:59.863309] [DEBUG] [LOCAL ] AIT: Loaded 20432 existing records from primary storage. [2025-09-17T01:52:59.863451] [INFO ] [MAIN ] AIT: Loaded 20432 existing records. [2025-09-17T01:52:59.895239] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-17T01:53:00.049398] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:00.049890] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-17T01:53:00.050010] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-17T01:53:00.055948] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-17T01:53:00.062288] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-17T01:53:00.063188] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T01:53:00.419111] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:00.515866] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T01:53:00.690109] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-11. [2025-09-17T01:53:01.490132] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-17T01:53:01.958892] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:53:02.290173] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-17T01:53:02.714758] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T01:53:03.090178] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-17T01:53:03.260161] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T01:53:03.890189] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-17T01:53:04.077220] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T01:53:04.690152] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-17T01:53:04.755597] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T01:53:05.490157] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-17T01:53:05.691746] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T01:53:05.694754] [INFO ] [REMOTE ] AIN: Full fetch complete (33143 records). [2025-09-17T01:53:05.694865] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-17T01:53:06.078099] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-17T01:53:06.078237] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-17T01:53:06.078656] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-17T01:53:06.078706] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-17T01:53:06.080042] [DEBUG] [LOCAL ] AIN: Trimmed 33143 records to 24660 (keeping 200 days of data) [2025-09-17T01:53:06.237342] [DEBUG] [LOCAL ] AIN: Primary data saved (24660 records). [2025-09-17T01:53:06.237518] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-17T01:53:06.237669] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIN took 29.3s. Estimated remaining: 5h 8m 54s. Rate: 7.5 symbols/min [2025-09-17T01:53:06.300469] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-17T01:53:06.410960] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:06.438927] [DEBUG] [LOCAL ] AIV: Loaded 29849 existing records from primary storage. [2025-09-17T01:53:06.439092] [INFO ] [MAIN ] AIV: Loaded 29849 existing records. [2025-09-17T01:53:06.617013] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:06.617310] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-17T01:53:06.617379] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-17T01:53:06.618146] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-17T01:53:06.618217] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-17T01:53:07.020285] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:07.035770] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T01:53:07.090079] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-17T01:53:07.444384] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T01:53:07.890136] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-17T01:53:08.181560] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T01:53:08.690163] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-17T01:53:09.199058] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T01:53:09.490178] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-11. [2025-09-17T01:53:09.830622] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T01:53:10.290151] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-17T01:53:10.980445] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T01:53:11.090115] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-17T01:53:11.635492] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T01:53:11.890126] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-17T01:53:12.559590] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T01:53:12.690086] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-17T01:53:12.793870] [DEBUG] [REMOTE ] AIV: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T01:53:12.794081] [WARN ] [REMOTE ] AIV: No data returned for month 2025-01 [2025-09-17T01:53:12.855277] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T01:53:13.490198] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-17T01:53:14.290156] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-17T01:53:14.889455] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T01:53:14.906120] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T01:53:15.090154] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-17T01:53:15.890152] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-17T01:53:16.042272] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T01:53:16.690177] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-17T01:53:17.404419] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T01:53:17.490098] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-17T01:53:17.863125] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T01:53:18.290160] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-17T01:53:18.745089] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T01:53:18.896301] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T01:53:19.090130] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-17T01:53:19.890105] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-17T01:53:20.160804] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T01:53:20.690185] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-17T01:53:20.823864] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T01:53:21.490161] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-17T01:53:21.542433] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T01:53:22.290137] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-17T01:53:22.869442] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T01:53:23.090102] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-17T01:53:23.766155] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T01:53:23.784192] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:53:23.786103] [INFO ] [REMOTE ] AIO: Full fetch complete (20236 records). [2025-09-17T01:53:23.786203] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-17T01:53:23.892481] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-17T01:53:24.170195] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-17T01:53:24.170294] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-17T01:53:24.170631] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-17T01:53:24.170723] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-17T01:53:24.171359] [DEBUG] [LOCAL ] AIO: Trimmed 20236 records to 13435 (keeping 200 days of data) [2025-09-17T01:53:24.259279] [DEBUG] [LOCAL ] AIO: Primary data saved (13435 records). [2025-09-17T01:53:24.259452] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-17T01:53:24.259572] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIO took 37.7s. Estimated remaining: 5h 14m 23s. Rate: 7.3 symbols/min [2025-09-17T01:53:24.439851] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:24.440064] [DEBUG] [LOCAL ] AIZ: No existing data file found in primary storage. [2025-09-17T01:53:24.440114] [WARN ] [MAIN ] AIZ: No existing data found, performing full refresh instead. [2025-09-17T01:53:24.440219] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-17T01:53:24.440261] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-17T01:53:24.440318] [DEBUG] [LOCAL ] AIZ: No primary data file found to delete. [2025-09-17T01:53:24.440383] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-17T01:53:24.695181] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-17T01:53:24.813469] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:25.246115] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T01:53:25.490128] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-11. [2025-09-17T01:53:26.214868] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T01:53:26.290084] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-17T01:53:26.807026] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T01:53:27.090175] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-17T01:53:27.433497] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T01:53:27.890169] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-17T01:53:28.643279] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T01:53:28.690140] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-17T01:53:29.215791] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T01:53:29.490179] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-17T01:53:29.740443] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T01:53:30.290199] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-17T01:53:30.910580] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T01:53:31.090143] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-17T01:53:31.171256] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T01:53:31.890160] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-17T01:53:32.184000] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T01:53:32.690191] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-17T01:53:33.208633] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T01:53:33.490207] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-17T01:53:34.044926] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T01:53:34.290174] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-17T01:53:34.666193] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T01:53:34.669684] [INFO ] [REMOTE ] AIR: Full fetch complete (36942 records). [2025-09-17T01:53:34.669811] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-17T01:53:35.056316] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-17T01:53:35.056448] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-17T01:53:35.056976] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-17T01:53:35.057058] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-17T01:53:35.058170] [DEBUG] [LOCAL ] AIR: Trimmed 36942 records to 26867 (keeping 200 days of data) [2025-09-17T01:53:35.110576] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-17T01:53:35.221153] [DEBUG] [LOCAL ] AIR: Primary data saved (26867 records). [2025-09-17T01:53:35.221322] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-17T01:53:35.221418] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 37.1s. Estimated remaining: 5h 15m 47s. Rate: 7.3 symbols/min [2025-09-17T01:53:35.388835] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:35.393114] [DEBUG] [LOCAL ] AIZN: Loaded 2643 existing records from primary storage. [2025-09-17T01:53:35.393230] [INFO ] [MAIN ] AIZN: Loaded 2643 existing records. [2025-09-17T01:53:35.572402] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:35.572605] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-17T01:53:35.572680] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-17T01:53:35.572926] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-17T01:53:35.572984] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-17T01:53:35.894497] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-17T01:53:35.936778] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:35.956935] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T01:53:36.690128] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-17T01:53:36.816762] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T01:53:37.230003] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T01:53:37.490118] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-11. [2025-09-17T01:53:37.799097] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T01:53:38.109354] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T01:53:38.290167] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-17T01:53:39.090123] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-17T01:53:39.450069] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:53:39.455744] [INFO ] [REMOTE ] AIV: Full fetch complete (51925 records). [2025-09-17T01:53:39.455905] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-17T01:53:39.645800] [WARN ] [VALIDATOR ] AIV: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T01:53:39.646382] [FATAL] [MAIN ] AIV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:53:39.646451] [WARN ] [MAIN ] AIV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:53:39.646500] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-17T01:53:39.646573] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-09-17T01:53:39.646614] [INFO ] [LOCAL ] AIV: Starting deletion of derivative data. [2025-09-17T01:53:39.647066] [DEBUG] [LOCAL ] AIV: Deleted derivative data file. [2025-09-17T01:53:39.647168] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIV took 33.4s. Estimated remaining: 5h 13m 33s. Rate: 7.3 symbols/min [2025-09-17T01:53:39.815515] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:39.852435] [DEBUG] [LOCAL ] AJG: Loaded 34554 existing records from primary storage. [2025-09-17T01:53:39.852596] [INFO ] [MAIN ] AJG: Loaded 34554 existing records. [2025-09-17T01:53:39.895187] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-17T01:53:40.035206] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:40.035440] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-17T01:53:40.035499] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-17T01:53:40.036480] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-17T01:53:40.036553] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-17T01:53:40.397505] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:40.418432] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T01:53:40.541394] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T01:53:40.690096] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-11. [2025-09-17T01:53:41.490156] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-17T01:53:42.081736] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T01:53:42.168783] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T01:53:42.290120] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-17T01:53:43.090123] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-17T01:53:43.253318] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T01:53:43.256350] [INFO ] [REMOTE ] AIT: Full fetch complete (39649 records). [2025-09-17T01:53:43.256480] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-17T01:53:43.643513] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-17T01:53:43.643659] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-17T01:53:43.644153] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-17T01:53:43.644216] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-17T01:53:43.645319] [DEBUG] [LOCAL ] AIT: Trimmed 39649 records to 28542 (keeping 200 days of data) [2025-09-17T01:53:43.827521] [DEBUG] [LOCAL ] AIT: Primary data saved (28542 records). [2025-09-17T01:53:43.827698] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-17T01:53:43.827789] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIT took 44.2s. Estimated remaining: 5h 11m 16s. Rate: 7.4 symbols/min [2025-09-17T01:53:43.895221] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-17T01:53:44.013500] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:44.013788] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-17T01:53:44.013855] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-17T01:53:44.013985] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-17T01:53:44.014044] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-17T01:53:44.014101] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-17T01:53:44.014148] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-17T01:53:44.381971] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:44.403019] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T01:53:44.690136] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-17T01:53:45.010747] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T01:53:45.490149] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-17T01:53:45.794615] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T01:53:46.100373] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T01:53:46.290129] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-11. [2025-09-17T01:53:46.783689] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T01:53:47.090135] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-17T01:53:47.890145] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-17T01:53:48.690137] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-17T01:53:48.946557] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T01:53:49.140033] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T01:53:49.261065] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T01:53:49.490124] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-17T01:53:50.290137] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-17T01:53:51.090120] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-17T01:53:51.287127] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T01:53:51.316475] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T01:53:51.679428] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T01:53:51.890117] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-17T01:53:52.690095] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-17T01:53:52.799043] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T01:53:52.802630] [INFO ] [REMOTE ] AIZ: Full fetch complete (42961 records). [2025-09-17T01:53:52.802775] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-17T01:53:53.182656] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-17T01:53:53.182756] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-17T01:53:53.183226] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-17T01:53:53.183278] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-17T01:53:53.184268] [DEBUG] [LOCAL ] AIZ: Trimmed 42961 records to 30481 (keeping 200 days of data) [2025-09-17T01:53:53.285473] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T01:53:53.391378] [DEBUG] [LOCAL ] AIZ: Primary data saved (30481 records). [2025-09-17T01:53:53.391553] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-17T01:53:53.391655] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZ took 29.1s. Estimated remaining: 5h 11m 53s. Rate: 7.4 symbols/min [2025-09-17T01:53:53.491322] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-17T01:53:53.564203] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:53.598984] [DEBUG] [LOCAL ] AKR: Loaded 34176 existing records from primary storage. [2025-09-17T01:53:53.599172] [INFO ] [MAIN ] AKR: Loaded 34176 existing records. [2025-09-17T01:53:53.775776] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:53.776018] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-17T01:53:53.776075] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-17T01:53:53.776936] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-17T01:53:53.777001] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-17T01:53:54.128269] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:54.131563] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T01:53:54.290139] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-17T01:53:55.090137] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-17T01:53:55.564217] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T01:53:55.814301] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T01:53:55.890118] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-17T01:53:56.690129] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-17T01:53:57.162388] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T01:53:57.490119] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-11. [2025-09-17T01:53:57.805632] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:53:58.290134] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-17T01:53:58.601510] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T01:53:59.074055] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T01:53:59.090072] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-17T01:53:59.890141] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-17T01:54:00.242984] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T01:54:00.468730] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T01:54:00.690186] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-17T01:54:01.490181] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-17T01:54:02.290180] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-17T01:54:03.074490] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-17T01:54:03.090072] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-17T01:54:03.890133] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-17T01:54:04.299119] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T01:54:04.690243] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-17T01:54:05.121295] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T01:54:05.195880] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T01:54:05.466967] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (3.98 seconds). [2025-09-17T01:54:05.491695] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-17T01:54:05.503913] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-17T01:54:05.854892] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T01:54:06.290191] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-17T01:54:07.090178] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-17T01:54:07.652058] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T01:54:07.898039] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-17T01:54:07.917006] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T01:54:08.259563] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T01:54:08.260636] [INFO ] [REMOTE ] AIZN: Full fetch complete (5705 records). [2025-09-17T01:54:08.260748] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-17T01:54:08.631352] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-17T01:54:08.631552] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-17T01:54:08.631743] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-17T01:54:08.631794] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-17T01:54:08.632211] [DEBUG] [LOCAL ] AIZN: Trimmed 5705 records to 3961 (keeping 200 days of data) [2025-09-17T01:54:08.656815] [DEBUG] [LOCAL ] AIZN: Primary data saved (3961 records). [2025-09-17T01:54:08.656985] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-17T01:54:08.657085] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZN took 33.4s. Estimated remaining: 5h 15m 29s. Rate: 7.3 symbols/min [2025-09-17T01:54:08.695213] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-17T01:54:08.833672] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:08.867089] [DEBUG] [LOCAL ] AL: Loaded 32517 existing records from primary storage. [2025-09-17T01:54:08.867272] [INFO ] [MAIN ] AL: Loaded 32517 existing records. [2025-09-17T01:54:09.044886] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:09.045164] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-17T01:54:09.045225] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-17T01:54:09.046152] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-17T01:54:09.046215] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-17T01:54:09.408043] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:09.490133] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-17T01:54:10.290160] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-17T01:54:10.359199] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T01:54:10.663233] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T01:54:11.090204] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-11. [2025-09-17T01:54:11.266349] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T01:54:11.890218] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-17T01:54:12.355901] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:54:12.690200] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-17T01:54:13.038895] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T01:54:13.039746] [INFO ] [REMOTE ] AKA: Full fetch complete (2476 records). [2025-09-17T01:54:13.039856] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-17T01:54:13.220574] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T01:54:13.220813] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:54:13.220882] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:54:13.220945] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-17T01:54:13.221044] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-17T01:54:13.221108] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-17T01:54:13.221183] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-17T01:54:13.221278] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 29.4s. Estimated remaining: 5h 13m 27s. Rate: 7.3 symbols/min [2025-09-17T01:54:13.388007] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:13.428725] [DEBUG] [LOCAL ] ALB: Loaded 39803 existing records from primary storage. [2025-09-17T01:54:13.428916] [INFO ] [MAIN ] ALB: Loaded 39803 existing records. [2025-09-17T01:54:13.495243] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-17T01:54:13.615330] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:13.615775] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-17T01:54:13.615854] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-17T01:54:13.616925] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-17T01:54:13.616994] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-17T01:54:14.034959] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:14.028309] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T01:54:14.290182] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-17T01:54:15.090195] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-17T01:54:15.789332] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-17T01:54:15.890128] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-17T01:54:16.690137] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-11. [2025-09-17T01:54:16.753784] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-17T01:54:17.405833] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T01:54:17.490117] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-17T01:54:17.538339] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-17T01:54:18.290193] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-17T01:54:18.871995] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-17T01:54:18.963854] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T01:54:19.090152] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-17T01:54:19.790189] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T01:54:19.796159] [INFO ] [REMOTE ] AJG: Full fetch complete (69527 records). [2025-09-17T01:54:19.796337] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-17T01:54:19.895226] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-17T01:54:20.196257] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-17T01:54:20.196381] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-17T01:54:20.197096] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-17T01:54:20.197200] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-17T01:54:20.198867] [DEBUG] [LOCAL ] AJG: Trimmed 69527 records to 47178 (keeping 200 days of data) [2025-09-17T01:54:20.456611] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T01:54:20.536931] [DEBUG] [LOCAL ] AJG: Primary data saved (47178 records). [2025-09-17T01:54:20.537090] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-17T01:54:20.537180] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 40.9s. Estimated remaining: 5h 12m 52s. Rate: 7.3 symbols/min [2025-09-17T01:54:20.703515] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-17T01:54:20.706428] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:20.747880] [DEBUG] [LOCAL ] ALC: Loaded 37854 existing records from primary storage. [2025-09-17T01:54:20.748092] [INFO ] [MAIN ] ALC: Loaded 37854 existing records. [2025-09-17T01:54:20.929694] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:20.929960] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-17T01:54:20.930023] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-17T01:54:20.930911] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-17T01:54:20.930974] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-17T01:54:21.293493] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:21.497988] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-17T01:54:21.515558] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T01:54:22.176426] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T01:54:22.290179] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-17T01:54:23.090113] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-11. [2025-09-17T01:54:23.460895] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T01:54:23.890135] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-17T01:54:23.995710] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T01:54:24.690151] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-17T01:54:24.746225] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:54:25.490162] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-17T01:54:25.952532] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T01:54:26.054399] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T01:54:26.290133] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-17T01:54:27.090142] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-17T01:54:27.195481] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T01:54:27.890171] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-17T01:54:28.132702] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T01:54:28.698819] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-17T01:54:28.704072] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T01:54:29.240980] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T01:54:29.490136] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-17T01:54:29.920880] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T01:54:29.926461] [INFO ] [REMOTE ] AKR: Full fetch complete (65075 records). [2025-09-17T01:54:29.926689] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-17T01:54:30.292225] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-17T01:54:30.322093] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-17T01:54:30.322190] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-17T01:54:30.322868] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-17T01:54:30.322938] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-17T01:54:30.324458] [DEBUG] [LOCAL ] AKR: Trimmed 65075 records to 45615 (keeping 200 days of data) [2025-09-17T01:54:30.596697] [DEBUG] [LOCAL ] AKR: Primary data saved (45615 records). [2025-09-17T01:54:30.596867] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-17T01:54:30.596978] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 37.2s. Estimated remaining: 5h 13m 40s. Rate: 7.3 symbols/min [2025-09-17T01:54:30.770029] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:30.791950] [DEBUG] [LOCAL ] ALE: Loaded 22661 existing records from primary storage. [2025-09-17T01:54:30.792107] [INFO ] [MAIN ] ALE: Loaded 22661 existing records. [2025-09-17T01:54:30.970342] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:30.970922] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-17T01:54:30.971049] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-17T01:54:30.971803] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-17T01:54:30.971870] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-17T01:54:31.093216] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-17T01:54:31.276230] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T01:54:31.368427] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:31.890110] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-11. [2025-09-17T01:54:32.380445] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T01:54:32.690168] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-17T01:54:32.880590] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T01:54:32.992467] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T01:54:33.490214] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-17T01:54:34.290201] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-17T01:54:34.541435] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T01:54:35.073028] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T01:54:35.090082] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-17T01:54:35.514721] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T01:54:35.890154] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-17T01:54:36.603798] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T01:54:36.690113] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-17T01:54:37.490184] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-17T01:54:38.023567] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T01:54:38.290184] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-17T01:54:38.504683] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T01:54:38.651996] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:54:38.658216] [INFO ] [REMOTE ] AL: Full fetch complete (61520 records). [2025-09-17T01:54:38.658364] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-17T01:54:39.049023] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-17T01:54:39.049153] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-17T01:54:39.049877] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-17T01:54:39.049971] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-17T01:54:39.051340] [DEBUG] [LOCAL ] AL: Trimmed 61520 records to 43858 (keeping 200 days of data) [2025-09-17T01:54:39.107637] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-17T01:54:39.318241] [DEBUG] [LOCAL ] AL: Primary data saved (43858 records). [2025-09-17T01:54:39.318406] [INFO ] [MAIN ] AL: Full history saved. [2025-09-17T01:54:39.318529] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AL took 30.7s. Estimated remaining: 5h 13m 47s. Rate: 7.3 symbols/min [2025-09-17T01:54:39.586929] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T01:54:39.890196] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-17T01:54:40.690231] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-17T01:54:40.830983] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T01:54:41.490117] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-17T01:54:41.778919] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T01:54:41.868508] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T01:54:42.290127] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-17T01:54:43.061936] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T01:54:43.090072] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-17T01:54:43.452472] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T01:54:43.890142] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-17T01:54:44.523410] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T01:54:44.690140] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-17T01:54:45.281880] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T01:54:45.490141] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-17T01:54:46.290164] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-17T01:54:46.452498] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T01:54:46.752882] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T01:54:47.090186] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-17T01:54:47.890149] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-17T01:54:48.402339] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T01:54:48.428563] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T01:54:48.690140] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-17T01:54:49.490186] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-17T01:54:49.712459] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T01:54:50.290149] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-17T01:54:50.886681] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T01:54:51.049799] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T01:54:51.090074] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-17T01:54:51.890113] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-17T01:54:51.969865] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T01:54:51.976141] [INFO ] [REMOTE ] ALC: Full fetch complete (72294 records). [2025-09-17T01:54:51.976274] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-17T01:54:52.364635] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-17T01:54:52.364786] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-17T01:54:52.365555] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-17T01:54:52.365635] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-17T01:54:52.367271] [DEBUG] [LOCAL ] ALC: Trimmed 72294 records to 50818 (keeping 200 days of data) [2025-09-17T01:54:52.669405] [DEBUG] [LOCAL ] ALC: Primary data saved (50818 records). [2025-09-17T01:54:52.669567] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-17T01:54:52.669706] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALC took 32.1s. Estimated remaining: 5h 16m 10s. Rate: 7.2 symbols/min [2025-09-17T01:54:52.873989] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T01:54:52.882068] [INFO ] [REMOTE ] ALB: Full fetch complete (76627 records). [2025-09-17T01:54:52.882243] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-17T01:54:53.269387] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-17T01:54:53.269496] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-17T01:54:53.270264] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-17T01:54:53.270329] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-17T01:54:53.271819] [DEBUG] [LOCAL ] ALB: Trimmed 76627 records to 53258 (keeping 200 days of data) [2025-09-17T01:54:53.396668] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T01:54:53.406693] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-17T01:54:53.636252] [DEBUG] [LOCAL ] ALB: Primary data saved (53258 records). [2025-09-17T01:54:53.636418] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-17T01:54:53.636518] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALB took 40.4s. Estimated remaining: 5h 12m 30s. Rate: 7.3 symbols/min [2025-09-17T01:54:54.740606] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T01:54:54.745058] [INFO ] [REMOTE ] ALE: Full fetch complete (41520 records). [2025-09-17T01:54:54.745223] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-17T01:54:55.118049] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-17T01:54:55.118173] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-17T01:54:55.118744] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-17T01:54:55.118813] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-17T01:54:55.119813] [DEBUG] [LOCAL ] ALE: Trimmed 41520 records to 29897 (keeping 200 days of data) [2025-09-17T01:54:55.303540] [DEBUG] [LOCAL ] ALE: Primary data saved (29897 records). [2025-09-17T01:54:55.303728] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-17T01:54:55.303827] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALE took 24.7s. Estimated remaining: 5h 9m 15s. Rate: 7.4 symbols/min [2025-09-17T01:54:55.895797] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:55.936103] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:56.015991] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:56.014116] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:56.016391] [DEBUG] [LOCAL ] ALK: No existing data file found in primary storage. [2025-09-17T01:54:56.016820] [WARN ] [MAIN ] ALK: No existing data found, performing full refresh instead. [2025-09-17T01:54:56.017120] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-17T01:54:56.017228] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-17T01:54:56.017392] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-17T01:54:56.017455] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-17T01:54:56.167145] [DEBUG] [LOCAL ] ALEX: Loaded 22072 existing records from primary storage. [2025-09-17T01:54:56.161369] [DEBUG] [LOCAL ] ALG: Loaded 7360 existing records from primary storage. [2025-09-17T01:54:56.211767] [INFO ] [MAIN ] ALEX: Loaded 22072 existing records. [2025-09-17T01:54:56.233094] [INFO ] [MAIN ] ALG: Loaded 7360 existing records. [2025-09-17T01:54:56.435209] [DEBUG] [LOCAL ] ALIT: Loaded 39226 existing records from primary storage. [2025-09-17T01:54:56.508168] [INFO ] [MAIN ] ALIT: Loaded 39226 existing records. [2025-09-17T01:54:56.833041] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:56.827810] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:56.874673] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-11. [2025-09-17T01:54:56.903120] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-17T01:54:56.921249] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:56.939191] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-17T01:54:56.926746] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-17T01:54:56.961394] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-17T01:54:56.972079] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-17T01:54:57.002174] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:57.002678] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-17T01:54:57.002240] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-17T01:54:57.002744] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-17T01:54:57.002983] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-17T01:54:57.002913] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-17T01:54:57.087427] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-17T01:54:57.127432] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-17T01:54:57.981290] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:58.013200] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:58.024744] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-11. [2025-09-17T01:54:58.024963] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-11. [2025-09-17T01:54:58.104418] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:58.104770] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-11. [2025-09-17T01:54:58.780167] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T01:54:58.790230] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-17T01:54:58.960702] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T01:54:58.963542] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-17T01:54:59.297978] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:54:59.303870] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-17T01:54:59.499000] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T01:54:59.509403] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-17T01:55:00.049899] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T01:55:00.053395] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-17T01:55:00.441667] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T01:55:00.576465] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T01:55:00.690085] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-17T01:55:00.797765] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T01:55:01.459810] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T01:55:01.490185] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-17T01:55:02.290147] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-17T01:55:02.606587] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T01:55:03.090150] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-17T01:55:03.273828] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:55:03.318696] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T01:55:03.890171] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-17T01:55:04.690130] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-17T01:55:04.861782] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T01:55:05.490095] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-17T01:55:05.590154] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T01:55:05.615800] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T01:55:06.290149] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-17T01:55:07.090228] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-17T01:55:07.405638] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T01:55:07.890191] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-17T01:55:08.075212] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T01:55:08.101461] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T01:55:08.690131] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-17T01:55:09.490193] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-17T01:55:09.893307] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T01:55:10.128083] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T01:55:10.290150] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-17T01:55:10.493314] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T01:55:11.090148] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-17T01:55:11.890149] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-17T01:55:11.953355] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T01:55:12.162722] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T01:55:12.690192] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-17T01:55:13.360694] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T01:55:13.490097] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-17T01:55:13.573507] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T01:55:14.290189] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-17T01:55:14.824022] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T01:55:15.090158] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-17T01:55:15.890128] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-17T01:55:16.009339] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T01:55:16.434476] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T01:55:16.690132] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-17T01:55:17.296677] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T01:55:17.324152] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T01:55:17.490163] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-17T01:55:18.290136] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-17T01:55:19.090222] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-17T01:55:19.115041] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T01:55:19.212147] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T01:55:19.890190] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-17T01:55:20.670019] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T01:55:20.690078] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-17T01:55:21.086139] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T01:55:21.197773] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T01:55:21.200209] [INFO ] [REMOTE ] ALG: Full fetch complete (15835 records). [2025-09-17T01:55:21.200319] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-17T01:55:21.497781] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-17T01:55:21.589673] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-17T01:55:21.589784] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-17T01:55:21.590293] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-17T01:55:21.590383] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-17T01:55:21.591093] [DEBUG] [LOCAL ] ALG: Trimmed 15835 records to 10846 (keeping 200 days of data) [2025-09-17T01:55:21.663602] [DEBUG] [LOCAL ] ALG: Primary data saved (10846 records). [2025-09-17T01:55:21.663781] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-17T01:55:21.663885] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALG took 26.4s. Estimated remaining: 5h 17m 42s. Rate: 7.2 symbols/min [2025-09-17T01:55:21.841168] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:21.884789] [DEBUG] [LOCAL ] ALL: Loaded 37086 existing records from primary storage. [2025-09-17T01:55:21.884978] [INFO ] [MAIN ] ALL: Loaded 37086 existing records. [2025-09-17T01:55:22.070201] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:22.070467] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-17T01:55:22.070528] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-17T01:55:22.071805] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-17T01:55:22.071883] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-17T01:55:22.298387] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-17T01:55:22.482041] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:22.899325] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T01:55:23.090146] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-11. [2025-09-17T01:55:23.729197] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T01:55:23.890128] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-17T01:55:24.690124] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-17T01:55:24.800421] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T01:55:25.293504] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T01:55:25.490293] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-17T01:55:26.290284] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-17T01:55:26.482764] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T01:55:26.730321] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T01:55:27.090167] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-17T01:55:27.890135] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-17T01:55:28.005673] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T01:55:28.620396] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T01:55:28.690089] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-17T01:55:29.007984] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T01:55:29.011900] [INFO ] [REMOTE ] ALEX: Full fetch complete (44192 records). [2025-09-17T01:55:29.012002] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-17T01:55:29.381629] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-17T01:55:29.381747] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-17T01:55:29.382223] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-17T01:55:29.382277] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-17T01:55:29.384345] [DEBUG] [LOCAL ] ALEX: Trimmed 44192 records to 31541 (keeping 200 days of data) [2025-09-17T01:55:29.490388] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-17T01:55:29.582058] [DEBUG] [LOCAL ] ALEX: Primary data saved (31541 records). [2025-09-17T01:55:29.582245] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-17T01:55:29.582352] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALEX took 34.3s. Estimated remaining: 5h 17m 23s. Rate: 7.2 symbols/min [2025-09-17T01:55:29.750457] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:29.787820] [DEBUG] [LOCAL ] ALLE: Loaded 33163 existing records from primary storage. [2025-09-17T01:55:29.787982] [INFO ] [MAIN ] ALLE: Loaded 33163 existing records. [2025-09-17T01:55:29.965755] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:29.965966] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-17T01:55:29.966022] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-17T01:55:29.967128] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-17T01:55:29.967192] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-17T01:55:30.296371] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-17T01:55:30.323562] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:30.425166] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T01:55:30.431527] [INFO ] [REMOTE ] ALK: Full fetch complete (76545 records). [2025-09-17T01:55:30.431680] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-17T01:55:30.822746] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-17T01:55:30.822847] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-17T01:55:30.823589] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-17T01:55:30.823664] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-17T01:55:30.825255] [DEBUG] [LOCAL ] ALK: Trimmed 76545 records to 53061 (keeping 200 days of data) [2025-09-17T01:55:31.096444] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-11. [2025-09-17T01:55:31.141133] [DEBUG] [LOCAL ] ALK: Primary data saved (53061 records). [2025-09-17T01:55:31.141281] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-17T01:55:31.141395] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALK took 35.8s. Estimated remaining: 5h 14m 8s. Rate: 7.3 symbols/min [2025-09-17T01:55:31.311066] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:31.348742] [DEBUG] [LOCAL ] ALLY: Loaded 39603 existing records from primary storage. [2025-09-17T01:55:31.348902] [INFO ] [MAIN ] ALLY: Loaded 39603 existing records. [2025-09-17T01:55:31.531973] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:31.532298] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-17T01:55:31.532454] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-17T01:55:31.542342] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-17T01:55:31.558614] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-17T01:55:31.640407] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T01:55:31.906349] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-17T01:55:31.946946] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:31.965866] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T01:55:31.973636] [INFO ] [REMOTE ] ALIT: Full fetch complete (76240 records). [2025-09-17T01:55:31.973840] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-17T01:55:32.384186] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-17T01:55:32.384348] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-17T01:55:32.385212] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-17T01:55:32.385286] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-17T01:55:32.386858] [DEBUG] [LOCAL ] ALIT: Trimmed 76240 records to 52733 (keeping 200 days of data) [2025-09-17T01:55:32.518518] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T01:55:32.703059] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-17T01:55:32.748576] [DEBUG] [LOCAL ] ALIT: Primary data saved (52733 records). [2025-09-17T01:55:32.748740] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-17T01:55:32.748844] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALIT took 37.4s. Estimated remaining: 5h 10m 59s. Rate: 7.3 symbols/min [2025-09-17T01:55:32.924368] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:32.957294] [DEBUG] [LOCAL ] ALSN: Loaded 31728 existing records from primary storage. [2025-09-17T01:55:32.957468] [INFO ] [MAIN ] ALSN: Loaded 31728 existing records. [2025-09-17T01:55:33.133521] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:33.133825] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-17T01:55:33.133886] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-17T01:55:33.134833] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-17T01:55:33.134901] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-17T01:55:33.498386] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-11. [2025-09-17T01:55:33.502756] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:33.936508] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T01:55:34.062237] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T01:55:34.290172] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-11. [2025-09-17T01:55:35.041710] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T01:55:35.090157] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-17T01:55:35.853175] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T01:55:35.890117] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-17T01:55:36.656695] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T01:55:36.690109] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-17T01:55:37.423116] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T01:55:37.490131] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-17T01:55:38.290127] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-17T01:55:38.559856] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T01:55:38.881501] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T01:55:39.090130] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-17T01:55:39.859447] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T01:55:39.890086] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-17T01:55:40.413312] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T01:55:40.690155] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-17T01:55:41.495553] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-17T01:55:41.497902] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T01:55:42.040437] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T01:55:42.290212] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-17T01:55:42.854602] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T01:55:43.090118] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-17T01:55:43.890205] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-17T01:55:44.116325] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T01:55:44.690112] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-17T01:55:44.771515] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T01:55:45.490120] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-17T01:55:45.550188] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T01:55:46.290140] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-17T01:55:46.686593] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T01:55:46.991245] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T01:55:47.090105] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-17T01:55:47.797957] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T01:55:47.890116] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-17T01:55:48.552893] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T01:55:48.690088] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-17T01:55:49.490148] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-17T01:55:49.654679] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T01:55:50.290124] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-17T01:55:50.389892] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T01:55:50.912955] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T01:55:51.090126] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-17T01:55:51.824545] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T01:55:51.890099] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-17T01:55:52.315161] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T01:55:52.690121] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-17T01:55:53.490167] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-17T01:55:53.704812] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T01:55:54.290146] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-17T01:55:54.589778] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T01:55:55.090158] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-17T01:55:55.202449] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T01:55:55.667335] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T01:55:55.673302] [INFO ] [REMOTE ] ALLE: Full fetch complete (64926 records). [2025-09-17T01:55:55.673457] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-17T01:55:55.897259] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-17T01:55:56.076661] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-17T01:55:56.076782] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-17T01:55:56.077428] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-17T01:55:56.077484] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-17T01:55:56.079091] [DEBUG] [LOCAL ] ALLE: Trimmed 64926 records to 45257 (keeping 200 days of data) [2025-09-17T01:55:56.372818] [DEBUG] [LOCAL ] ALLE: Primary data saved (45257 records). [2025-09-17T01:55:56.372998] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-17T01:55:56.373096] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALLE took 26.8s. Estimated remaining: 5h 17m 46s. Rate: 7.2 symbols/min [2025-09-17T01:55:56.542587] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:56.559552] [DEBUG] [LOCAL ] ALTG: Loaded 17512 existing records from primary storage. [2025-09-17T01:55:56.559725] [INFO ] [MAIN ] ALTG: Loaded 17512 existing records. [2025-09-17T01:55:56.698136] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-17T01:55:56.738320] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:56.738513] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-17T01:55:56.738596] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-17T01:55:56.739087] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-17T01:55:56.739146] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-17T01:55:57.114040] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:57.151113] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T01:55:57.303987] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T01:55:57.490126] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-17T01:55:58.290177] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-17T01:55:58.401395] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T01:55:59.057744] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T01:55:59.090226] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-17T01:55:59.890238] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-11. [2025-09-17T01:55:59.997193] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T01:56:00.004479] [INFO ] [REMOTE ] ALLY: Full fetch complete (76711 records). [2025-09-17T01:56:00.004757] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-17T01:56:00.416801] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-17T01:56:00.416982] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-17T01:56:00.418020] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-17T01:56:00.418107] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-17T01:56:00.420437] [DEBUG] [LOCAL ] ALLY: Trimmed 76711 records to 53217 (keeping 200 days of data) [2025-09-17T01:56:00.583906] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T01:56:00.692221] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-17T01:56:00.806798] [DEBUG] [LOCAL ] ALLY: Primary data saved (53217 records). [2025-09-17T01:56:00.806981] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-17T01:56:00.807087] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALLY took 29.7s. Estimated remaining: 5h 15m 54s. Rate: 7.2 symbols/min [2025-09-17T01:56:00.979342] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:00.989296] [DEBUG] [LOCAL ] ALUR: Loaded 7366 existing records from primary storage. [2025-09-17T01:56:00.989443] [INFO ] [MAIN ] ALUR: Loaded 7366 existing records. [2025-09-17T01:56:01.128582] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T01:56:01.199194] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:01.199490] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-17T01:56:01.199586] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-17T01:56:01.200045] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-17T01:56:01.200121] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-17T01:56:01.495214] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-17T01:56:01.564048] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:02.290133] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-17T01:56:02.404853] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T01:56:02.410930] [INFO ] [REMOTE ] ALL: Full fetch complete (72307 records). [2025-09-17T01:56:02.411107] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-17T01:56:02.799652] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-17T01:56:02.799763] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-17T01:56:02.800474] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-17T01:56:02.800533] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-17T01:56:02.803775] [DEBUG] [LOCAL ] ALL: Trimmed 72307 records to 50196 (keeping 200 days of data) [2025-09-17T01:56:03.094689] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-11. [2025-09-17T01:56:03.127812] [DEBUG] [LOCAL ] ALL: Primary data saved (50196 records). [2025-09-17T01:56:03.127924] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-17T01:56:03.128009] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALL took 41.5s. Estimated remaining: 5h 13m 9s. Rate: 7.3 symbols/min [2025-09-17T01:56:03.297314] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:03.333774] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T01:56:03.335442] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T01:56:03.379459] [DEBUG] [LOCAL ] ALV: Loaded 31077 existing records from primary storage. [2025-09-17T01:56:03.379629] [INFO ] [MAIN ] ALV: Loaded 31077 existing records. [2025-09-17T01:56:03.568262] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:03.568494] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-17T01:56:03.568553] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-17T01:56:03.569693] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-17T01:56:03.569774] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-17T01:56:03.894751] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-17T01:56:03.923438] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:03.936815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T01:56:04.690149] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-11. [2025-09-17T01:56:05.490116] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-17T01:56:05.574686] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T01:56:06.290816] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-17T01:56:06.296859] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T01:56:06.878422] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:56:07.090129] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-17T01:56:07.876051] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T01:56:07.890084] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-17T01:56:08.266393] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T01:56:08.690134] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-17T01:56:09.290380] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T01:56:09.296150] [INFO ] [REMOTE ] ALSN: Full fetch complete (61646 records). [2025-09-17T01:56:09.296297] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-17T01:56:09.506756] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-17T01:56:09.548991] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T01:56:09.722105] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-17T01:56:09.722235] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-17T01:56:09.722918] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-17T01:56:09.722979] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-17T01:56:09.724353] [DEBUG] [LOCAL ] ALSN: Trimmed 61646 records to 43400 (keeping 200 days of data) [2025-09-17T01:56:09.997835] [DEBUG] [LOCAL ] ALSN: Primary data saved (43400 records). [2025-09-17T01:56:09.998130] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-17T01:56:09.998226] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 37.2s. Estimated remaining: 5h 12m 25s. Rate: 7.3 symbols/min [2025-09-17T01:56:10.166500] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:10.173228] [DEBUG] [LOCAL ] ALX: Loaded 5247 existing records from primary storage. [2025-09-17T01:56:10.173341] [INFO ] [MAIN ] ALX: Loaded 5247 existing records. [2025-09-17T01:56:10.295301] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-17T01:56:10.351588] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:10.351906] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-17T01:56:10.351964] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-17T01:56:10.352423] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-17T01:56:10.352481] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-17T01:56:10.712403] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:11.045446] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T01:56:11.090141] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-17T01:56:11.491908] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T01:56:11.890182] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-17T01:56:12.655216] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T01:56:12.690093] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-17T01:56:13.228140] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T01:56:13.490164] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-11. [2025-09-17T01:56:13.850108] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T01:56:14.290149] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-17T01:56:14.465991] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T01:56:15.090126] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-17T01:56:15.597977] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T01:56:15.890120] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-17T01:56:16.517374] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T01:56:16.646971] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T01:56:16.690110] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-17T01:56:17.490168] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-17T01:56:17.727061] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T01:56:18.290129] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-17T01:56:19.081039] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T01:56:19.090069] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-17T01:56:19.348849] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:56:19.890140] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-17T01:56:20.669614] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T01:56:20.690073] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-17T01:56:20.728014] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T01:56:21.490157] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-17T01:56:22.290209] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-17T01:56:22.421239] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T01:56:22.477045] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T01:56:23.090166] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-17T01:56:23.152009] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T01:56:23.890161] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-17T01:56:24.575728] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T01:56:24.690122] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-17T01:56:25.162040] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T01:56:25.490148] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-17T01:56:25.854184] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T01:56:25.905849] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T01:56:26.290159] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-17T01:56:27.090140] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-17T01:56:27.130097] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T01:56:27.890089] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-17T01:56:27.989280] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T01:56:28.690121] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-17T01:56:28.876378] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T01:56:29.490141] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-17T01:56:30.083959] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T01:56:30.089173] [INFO ] [REMOTE ] ALV: Full fetch complete (61879 records). [2025-09-17T01:56:30.089335] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-17T01:56:30.298123] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-17T01:56:30.502754] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-17T01:56:30.502893] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-17T01:56:30.503557] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-17T01:56:30.503618] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-17T01:56:30.505114] [DEBUG] [LOCAL ] ALV: Trimmed 61879 records to 42973 (keeping 200 days of data) [2025-09-17T01:56:30.612128] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T01:56:30.617238] [INFO ] [REMOTE ] ALTG: Full fetch complete (33529 records). [2025-09-17T01:56:30.620387] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-17T01:56:30.832871] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T01:56:31.111783] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-17T01:56:31.166820] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-17T01:56:31.169034] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-17T01:56:31.173485] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-17T01:56:31.175917] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-17T01:56:31.196752] [DEBUG] [LOCAL ] ALTG: Trimmed 33529 records to 24291 (keeping 200 days of data) [2025-09-17T01:56:31.200765] [DEBUG] [LOCAL ] ALV: Primary data saved (42973 records). [2025-09-17T01:56:31.201135] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-17T01:56:31.201235] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALV took 28.1s. Estimated remaining: 5h 17m 50s. Rate: 7.2 symbols/min [2025-09-17T01:56:31.466525] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:31.516162] [DEBUG] [LOCAL ] ALTG: Primary data saved (24291 records). [2025-09-17T01:56:31.516340] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-17T01:56:31.516445] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALTG took 35.1s. Estimated remaining: 5h 14m 18s. Rate: 7.3 symbols/min [2025-09-17T01:56:31.642775] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T01:56:31.714569] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:31.715414] [DEBUG] [LOCAL ] AM: Loaded 38636 existing records from primary storage. [2025-09-17T01:56:31.715554] [INFO ] [MAIN ] AM: Loaded 38636 existing records. [2025-09-17T01:56:31.715593] [DEBUG] [LOCAL ] AMBC: No existing data file found in primary storage. [2025-09-17T01:56:31.757458] [WARN ] [MAIN ] AMBC: No existing data found, performing full refresh instead. [2025-09-17T01:56:31.804409] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-17T01:56:31.814926] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-17T01:56:31.815019] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-09-17T01:56:31.815309] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-17T01:56:31.896325] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-17T01:56:31.977092] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:31.994407] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-17T01:56:31.994586] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-17T01:56:32.000754] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-17T01:56:32.021568] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-17T01:56:32.512963] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:32.535396] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T01:56:32.638691] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:32.690120] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-11. [2025-09-17T01:56:33.490137] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-17T01:56:34.268901] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T01:56:34.290138] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-17T01:56:34.505790] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T01:56:34.848142] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T01:56:34.849360] [INFO ] [REMOTE ] ALUR: Full fetch complete (21853 records). [2025-09-17T01:56:34.849446] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-17T01:56:35.095309] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-17T01:56:35.220224] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-17T01:56:35.220326] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-17T01:56:35.220745] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-17T01:56:35.220826] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-17T01:56:35.221421] [DEBUG] [LOCAL ] ALUR: Trimmed 21853 records to 11175 (keeping 200 days of data) [2025-09-17T01:56:35.284544] [DEBUG] [LOCAL ] ALUR: Primary data saved (11175 records). [2025-09-17T01:56:35.284694] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-17T01:56:35.284789] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALUR took 34.5s. Estimated remaining: 5h 12m 16s. Rate: 7.3 symbols/min [2025-09-17T01:56:35.458760] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:35.490337] [DEBUG] [LOCAL ] AMBP: Loaded 33802 existing records from primary storage. [2025-09-17T01:56:35.490509] [INFO ] [MAIN ] AMBP: Loaded 33802 existing records. [2025-09-17T01:56:35.671786] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:35.672071] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-17T01:56:35.672147] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-17T01:56:35.672971] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-17T01:56:35.673039] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-17T01:56:35.782147] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T01:56:35.895290] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-11. [2025-09-17T01:56:36.051110] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:36.690169] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-11. [2025-09-17T01:56:37.320387] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T01:56:37.490166] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-17T01:56:38.265048] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T01:56:38.290090] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-17T01:56:38.344827] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T01:56:39.090168] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-17T01:56:39.890151] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-17T01:56:40.119796] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T01:56:40.318569] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T01:56:40.690146] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-17T01:56:41.490172] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-17T01:56:41.559102] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T01:56:42.290092] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-17T01:56:42.330853] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T01:56:42.430239] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T01:56:43.090142] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-17T01:56:43.653599] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T01:56:43.890163] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-17T01:56:44.638454] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T01:56:44.690090] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-17T01:56:45.340258] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T01:56:45.490080] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-17T01:56:46.108447] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T01:56:46.290140] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-17T01:56:47.090133] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-17T01:56:47.198181] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T01:56:47.348118] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:56:47.550338] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T01:56:47.890125] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-17T01:56:48.690190] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-17T01:56:48.893694] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T01:56:49.490156] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-17T01:56:49.548443] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T01:56:50.290152] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-17T01:56:51.090157] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-17T01:56:51.413478] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:56:51.802223] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T01:56:51.890325] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-17T01:56:52.647478] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T01:56:52.690088] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-17T01:56:53.455187] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T01:56:53.490113] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-17T01:56:53.659989] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T01:56:54.023992] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T01:56:54.290146] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-17T01:56:55.090146] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-17T01:56:55.350690] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T01:56:55.354703] [INFO ] [REMOTE ] AMBC: Full fetch complete (50978 records). [2025-09-17T01:56:55.354812] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-17T01:56:55.737355] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-17T01:56:55.737459] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-17T01:56:55.738005] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-17T01:56:55.738073] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-17T01:56:55.739226] [DEBUG] [LOCAL ] AMBC: Trimmed 50978 records to 37826 (keeping 200 days of data) [2025-09-17T01:56:55.893143] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-17T01:56:55.954991] [DEBUG] [LOCAL ] AMBC: Primary data saved (37826 records). [2025-09-17T01:56:55.955186] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-17T01:56:55.955283] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. AMBC took 24.4s. Estimated remaining: 5h 17m 16s. Rate: 7.2 symbols/min [2025-09-17T01:56:56.125955] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:56.126187] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-17T01:56:56.126241] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-17T01:56:56.126356] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-17T01:56:56.126429] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-17T01:56:56.126478] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-17T01:56:56.126518] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-17T01:56:56.493111] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:56.702928] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-17T01:56:56.705787] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T01:56:57.266304] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T01:56:57.490159] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-17T01:56:57.623290] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T01:56:58.290181] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-17T01:56:59.090193] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-17T01:56:59.225416] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:56:59.737082] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T01:56:59.738535] [INFO ] [REMOTE ] ALX: Full fetch complete (6564 records). [2025-09-17T01:56:59.738618] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-17T01:56:59.894591] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-11. [2025-09-17T01:57:00.105838] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-17T01:57:00.105992] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-17T01:57:00.106235] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-17T01:57:00.106301] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-17T01:57:00.107031] [DEBUG] [LOCAL ] ALX: Trimmed 6564 records to 5730 (keeping 200 days of data) [2025-09-17T01:57:00.166487] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T01:57:00.183799] [DEBUG] [LOCAL ] ALX: Primary data saved (5730 records). [2025-09-17T01:57:00.183940] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-17T01:57:00.184055] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALX took 50.2s. Estimated remaining: 5h 15m 27s. Rate: 7.2 symbols/min [2025-09-17T01:57:00.249054] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:00.266115] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-11 [2025-09-17T01:57:00.357810] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:00.398502] [DEBUG] [LOCAL ] AMC: Loaded 40123 existing records from primary storage. [2025-09-17T01:57:00.398708] [INFO ] [MAIN ] AMC: Loaded 40123 existing records. [2025-09-17T01:57:00.581393] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:00.581677] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-17T01:57:00.581740] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-17T01:57:00.582743] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-17T01:57:00.582809] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-17T01:57:00.695206] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-17T01:57:00.963184] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:01.490165] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-11. [2025-09-17T01:57:02.290154] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-17T01:57:02.735515] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T01:57:03.090163] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-17T01:57:03.393032] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:03.393403] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-17T01:57:03.890145] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-17T01:57:04.258787] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:04.270912] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-17T01:57:04.272335] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-11 (2.78 seconds). [2025-09-17T01:57:04.690169] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-17T01:57:05.500977] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-17T01:57:05.506896] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T01:57:05.734793] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:05.735120] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-17T01:57:06.290184] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-17T01:57:07.090130] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-17T01:57:07.280479] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-17T01:57:07.890133] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-17T01:57:08.001781] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T01:57:08.425267] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T01:57:08.690134] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-17T01:57:09.490148] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-17T01:57:09.723237] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:09.723586] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-17T01:57:09.917180] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T01:57:10.295927] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-17T01:57:10.321658] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T01:57:10.541346] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:10.541708] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-17T01:57:11.090133] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-17T01:57:11.302426] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:11.302803] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-17T01:57:11.890158] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-17T01:57:12.690160] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-17T01:57:13.311572] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T01:57:13.317053] [INFO ] [REMOTE ] AMBP: Full fetch complete (65862 records). [2025-09-17T01:57:13.317245] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-17T01:57:13.498034] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-17T01:57:13.717625] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-17T01:57:13.717764] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-17T01:57:13.718417] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-17T01:57:13.718473] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-17T01:57:13.719755] [DEBUG] [LOCAL ] AMBP: Trimmed 65862 records to 45373 (keeping 200 days of data) [2025-09-17T01:57:13.813365] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:13.814718] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-17T01:57:13.981761] [DEBUG] [LOCAL ] AMBP: Primary data saved (45373 records). [2025-09-17T01:57:13.981923] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-17T01:57:13.982016] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBP took 38.7s. Estimated remaining: 5h 17m 31s. Rate: 7.2 symbols/min [2025-09-17T01:57:14.154772] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:14.191568] [DEBUG] [LOCAL ] AMCR: Loaded 40022 existing records from primary storage. [2025-09-17T01:57:14.191764] [INFO ] [MAIN ] AMCR: Loaded 40022 existing records. [2025-09-17T01:57:14.296221] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-17T01:57:14.382309] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:14.382607] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-17T01:57:14.382693] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-17T01:57:14.383717] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-17T01:57:14.383780] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-17T01:57:14.746160] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:14.774482] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T01:57:14.944457] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T01:57:15.090145] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-17T01:57:15.890147] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-17T01:57:16.088970] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T01:57:16.690131] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-17T01:57:17.395040] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T01:57:17.401541] [INFO ] [REMOTE ] AM: Full fetch complete (75445 records). [2025-09-17T01:57:17.401741] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-17T01:57:17.495197] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-17T01:57:17.810109] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-17T01:57:17.810245] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-17T01:57:17.810994] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-17T01:57:17.811053] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-17T01:57:17.812613] [DEBUG] [LOCAL ] AM: Trimmed 75445 records to 52184 (keeping 200 days of data) [2025-09-17T01:57:18.130452] [DEBUG] [LOCAL ] AM: Primary data saved (52184 records). [2025-09-17T01:57:18.130662] [INFO ] [MAIN ] AM: Full history saved. [2025-09-17T01:57:18.131738] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AM took 46.9s. Estimated remaining: 5h 15m 42s. Rate: 7.2 symbols/min [2025-09-17T01:57:18.301771] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-11. [2025-09-17T01:57:18.304347] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:18.346443] [DEBUG] [LOCAL ] AME: Loaded 36016 existing records from primary storage. [2025-09-17T01:57:18.346594] [INFO ] [MAIN ] AME: Loaded 36016 existing records. [2025-09-17T01:57:18.526902] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:18.527313] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-17T01:57:18.527460] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-17T01:57:18.535570] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-17T01:57:18.536125] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-17T01:57:18.536425] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T01:57:18.614087] [INFO ] [REMOTE ] AMBQ: Full fetch complete (6990 records). [2025-09-17T01:57:18.637947] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-17T01:57:18.999052] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 34 unique days, need 200 days [2025-09-17T01:57:18.999562] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:57:19.010152] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:57:19.020489] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-17T01:57:19.051601] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-17T01:57:19.079444] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:19.079527] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-17T01:57:19.079955] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-17T01:57:19.080052] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBQ took 23.1s. Estimated remaining: 5h 12m 39s. Rate: 7.3 symbols/min [2025-09-17T01:57:19.111819] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-11. [2025-09-17T01:57:19.255063] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:19.270851] [DEBUG] [LOCAL ] AMG: Loaded 14556 existing records from primary storage. [2025-09-17T01:57:19.270991] [INFO ] [MAIN ] AMG: Loaded 14556 existing records. [2025-09-17T01:57:19.453065] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:19.453352] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-17T01:57:19.453440] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-17T01:57:19.454003] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-17T01:57:19.454073] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-17T01:57:19.828060] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:19.858780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-09-17T01:57:19.890099] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-17T01:57:20.351257] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T01:57:20.569423] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T01:57:20.690105] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-17T01:57:21.490110] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-17T01:57:22.290121] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-11. [2025-09-17T01:57:22.382631] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T01:57:22.423419] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T01:57:22.865624] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T01:57:23.090164] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-17T01:57:23.138102] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T01:57:23.890152] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-17T01:57:24.279948] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:57:24.690123] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-17T01:57:25.490160] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-17T01:57:25.566458] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T01:57:26.290101] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-17T01:57:26.591077] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T01:57:26.888905] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T01:57:27.090171] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-17T01:57:27.804223] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T01:57:27.836742] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T01:57:27.890131] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-17T01:57:28.690142] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-17T01:57:29.490138] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-17T01:57:29.695593] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T01:57:30.290119] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-17T01:57:30.554221] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:57:30.997737] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T01:57:31.090144] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-17T01:57:31.890136] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-17T01:57:32.165094] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T01:57:32.690083] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-17T01:57:33.101474] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T01:57:33.490198] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-17T01:57:33.541354] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T01:57:34.290184] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-17T01:57:34.324074] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:57:34.723939] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T01:57:35.090139] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-17T01:57:35.890220] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-17T01:57:36.239234] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T01:57:36.690208] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-17T01:57:36.982386] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T01:57:37.460209] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T01:57:37.490082] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-17T01:57:38.290180] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-17T01:57:38.872455] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T01:57:38.879065] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-17T01:57:38.879226] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-17T01:57:39.106765] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-17T01:57:39.273917] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-17T01:57:39.274115] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-17T01:57:39.274969] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-17T01:57:39.275067] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-17T01:57:39.276726] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53757 (keeping 200 days of data) [2025-09-17T01:57:39.406307] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:57:39.629884] [DEBUG] [LOCAL ] AMC: Primary data saved (53757 records). [2025-09-17T01:57:39.630081] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-17T01:57:39.630892] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMC took 39.4s. Estimated remaining: 5h 17m 18s. Rate: 7.2 symbols/min [2025-09-17T01:57:39.802036] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:39.846051] [DEBUG] [LOCAL ] AMH: Loaded 38458 existing records from primary storage. [2025-09-17T01:57:39.846221] [INFO ] [MAIN ] AMH: Loaded 38458 existing records. [2025-09-17T01:57:39.910093] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-17T01:57:40.069183] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:40.069424] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-17T01:57:40.069481] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-17T01:57:40.071116] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-17T01:57:40.071180] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-17T01:57:40.436146] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:40.481567] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-17T01:57:40.482611] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T01:57:40.690187] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-17T01:57:41.365413] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T01:57:41.490132] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-17T01:57:42.290115] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-17T01:57:42.619442] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T01:57:42.920685] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T01:57:43.083598] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T01:57:43.092844] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-17T01:57:43.890126] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-17T01:57:44.690159] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-11. [2025-09-17T01:57:45.129869] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T01:57:45.490179] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-17T01:57:45.709955] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T01:57:46.295940] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-17T01:57:46.314011] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T01:57:47.090131] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-17T01:57:47.316612] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T01:57:47.323001] [INFO ] [REMOTE ] AMCR: Full fetch complete (77513 records). [2025-09-17T01:57:47.323145] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-17T01:57:47.722967] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-17T01:57:47.723072] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-17T01:57:47.723831] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-17T01:57:47.723888] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-17T01:57:47.725503] [DEBUG] [LOCAL ] AMCR: Trimmed 77513 records to 53669 (keeping 200 days of data) [2025-09-17T01:57:47.908518] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-17T01:57:48.060734] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-17T01:57:48.061016] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-17T01:57:48.061196] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMCR took 34.1s. Estimated remaining: 5h 17m 11s. Rate: 7.2 symbols/min [2025-09-17T01:57:48.231932] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:48.262749] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:57:48.300670] [DEBUG] [LOCAL ] AMN: Loaded 31354 existing records from primary storage. [2025-09-17T01:57:48.300841] [INFO ] [MAIN ] AMN: Loaded 31354 existing records. [2025-09-17T01:57:48.484971] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:48.485266] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-17T01:57:48.485354] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-17T01:57:48.486184] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-17T01:57:48.486261] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-17T01:57:48.699241] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-17T01:57:48.856047] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:48.895206] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T01:57:48.901507] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T01:57:49.490134] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-17T01:57:50.290179] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-17T01:57:50.392930] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T01:57:50.401886] [INFO ] [REMOTE ] AME: Full fetch complete (69438 records). [2025-09-17T01:57:50.402244] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-17T01:57:50.746541] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T01:57:50.848344] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-17T01:57:50.848514] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-17T01:57:50.849481] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-17T01:57:50.849547] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-17T01:57:50.851746] [DEBUG] [LOCAL ] AME: Trimmed 69438 records to 48589 (keeping 200 days of data) [2025-09-17T01:57:51.090187] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-17T01:57:51.184496] [DEBUG] [LOCAL ] AME: Primary data saved (48589 records). [2025-09-17T01:57:51.184700] [INFO ] [MAIN ] AME: Full history saved. [2025-09-17T01:57:51.184815] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AME took 33.1s. Estimated remaining: 5h 15m 2s. Rate: 7.2 symbols/min [2025-09-17T01:57:51.358155] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:51.383358] [DEBUG] [LOCAL ] AMP: Loaded 23302 existing records from primary storage. [2025-09-17T01:57:51.383524] [INFO ] [MAIN ] AMP: Loaded 23302 existing records. [2025-09-17T01:57:51.559029] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:51.559320] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-17T01:57:51.559401] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-17T01:57:51.560253] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-17T01:57:51.560328] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-17T01:57:51.926184] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T01:57:51.928215] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:51.897416] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-11. [2025-09-17T01:57:51.932601] [INFO ] [REMOTE ] AMG: Full fetch complete (29469 records). [2025-09-17T01:57:51.932793] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-17T01:57:52.262785] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T01:57:52.365874] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-17T01:57:52.366013] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-17T01:57:52.366428] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-17T01:57:52.366496] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-17T01:57:52.367778] [DEBUG] [LOCAL ] AMG: Trimmed 29469 records to 20806 (keeping 200 days of data) [2025-09-17T01:57:52.507596] [DEBUG] [LOCAL ] AMG: Primary data saved (20806 records). [2025-09-17T01:57:52.507761] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-17T01:57:52.507855] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMG took 33.4s. Estimated remaining: 5h 12m 15s. Rate: 7.3 symbols/min [2025-09-17T01:57:52.677988] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:52.690154] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-11. [2025-09-17T01:57:52.722849] [DEBUG] [LOCAL ] AMPX: Loaded 39038 existing records from primary storage. [2025-09-17T01:57:52.723051] [INFO ] [MAIN ] AMPX: Loaded 39038 existing records. [2025-09-17T01:57:52.903997] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:52.904287] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-17T01:57:52.904364] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-17T01:57:52.905343] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-17T01:57:52.905406] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-17T01:57:53.257805] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:53.495234] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-11. [2025-09-17T01:57:53.510072] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T01:57:54.135801] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T01:57:54.290126] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-17T01:57:54.787256] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T01:57:55.090193] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-17T01:57:55.551505] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T01:57:55.890150] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-17T01:57:56.579276] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T01:57:56.690084] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-17T01:57:57.490164] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-17T01:57:57.556741] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T01:57:58.190111] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T01:57:58.290154] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-17T01:57:59.090196] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-17T01:57:59.213980] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T01:57:59.376731] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T01:57:59.890162] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-17T01:58:00.690200] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-17T01:58:01.010246] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T01:58:01.050434] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T01:58:01.490168] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-17T01:58:01.836148] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T01:58:02.290146] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-17T01:58:02.922327] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T01:58:03.090165] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-17T01:58:03.890177] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-17T01:58:04.042091] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T01:58:04.691127] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-17T01:58:04.695834] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:58:05.405841] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T01:58:05.490132] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-17T01:58:05.953066] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T01:58:06.290137] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-17T01:58:06.681082] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T01:58:07.090148] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-17T01:58:07.895916] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-17T01:58:07.910581] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T01:58:08.690164] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-17T01:58:08.775667] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T01:58:09.302131] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T01:58:09.490152] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-17T01:58:09.763759] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T01:58:10.290143] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-17T01:58:11.090109] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-17T01:58:11.142751] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T01:58:11.757279] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T01:58:11.890139] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-17T01:58:12.452994] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T01:58:12.690134] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-17T01:58:13.490120] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-17T01:58:13.690175] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T01:58:14.250709] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T01:58:14.256983] [INFO ] [REMOTE ] AMH: Full fetch complete (74475 records). [2025-09-17T01:58:14.257129] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-17T01:58:14.299840] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-17T01:58:14.656312] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-17T01:58:14.656427] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-17T01:58:14.657169] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-17T01:58:14.657229] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-17T01:58:14.658673] [DEBUG] [LOCAL ] AMH: Trimmed 74475 records to 51703 (keeping 200 days of data) [2025-09-17T01:58:14.934990] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T01:58:15.014397] [DEBUG] [LOCAL ] AMH: Primary data saved (51703 records). [2025-09-17T01:58:15.014564] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-17T01:58:15.014679] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMH took 35.4s. Estimated remaining: 5h 17m 27s. Rate: 7.1 symbols/min [2025-09-17T01:58:15.095339] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-17T01:58:15.188307] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:15.214978] [DEBUG] [LOCAL ] AMPY: Loaded 27915 existing records from primary storage. [2025-09-17T01:58:15.215139] [INFO ] [MAIN ] AMPY: Loaded 27915 existing records. [2025-09-17T01:58:15.397617] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:15.397887] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-17T01:58:15.397945] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-17T01:58:15.398731] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-17T01:58:15.398797] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-17T01:58:15.751737] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:15.890118] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-11. [2025-09-17T01:58:16.049245] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T01:58:16.302100] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T01:58:16.690117] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-17T01:58:17.114588] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T01:58:17.490130] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-17T01:58:18.186911] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T01:58:18.290120] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-17T01:58:18.777135] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T01:58:19.090139] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-17T01:58:19.890202] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-17T01:58:20.279336] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:58:20.320009] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T01:58:20.690144] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-17T01:58:20.879608] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T01:58:21.490171] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-17T01:58:21.536028] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T01:58:22.290205] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-17T01:58:23.090146] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-17T01:58:23.708959] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T01:58:23.874697] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T01:58:23.890074] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-17T01:58:24.540487] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T01:58:24.690133] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-17T01:58:25.177976] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T01:58:25.490127] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-17T01:58:26.060866] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T01:58:26.290144] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-17T01:58:27.044604] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T01:58:27.051270] [INFO ] [REMOTE ] AMPX: Full fetch complete (74284 records). [2025-09-17T01:58:27.051435] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-17T01:58:27.095704] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-17T01:58:27.479697] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-17T01:58:27.479919] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-17T01:58:27.480852] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-17T01:58:27.481048] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-17T01:58:27.491403] [DEBUG] [LOCAL ] AMPX: Trimmed 74284 records to 52052 (keeping 200 days of data) [2025-09-17T01:58:27.507635] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T01:58:27.813039] [DEBUG] [LOCAL ] AMPX: Primary data saved (52052 records). [2025-09-17T01:58:27.813215] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-17T01:58:27.813317] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMPX took 35.3s. Estimated remaining: 5h 18m 56s. Rate: 7.1 symbols/min [2025-09-17T01:58:27.895256] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-17T01:58:27.992349] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:28.014430] [DEBUG] [LOCAL ] AMR: Loaded 21471 existing records from primary storage. [2025-09-17T01:58:28.014578] [INFO ] [MAIN ] AMR: Loaded 21471 existing records. [2025-09-17T01:58:28.192485] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:28.192766] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-17T01:58:28.192829] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-17T01:58:28.193499] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-17T01:58:28.193570] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-17T01:58:28.549410] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:28.568824] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T01:58:28.690134] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-11. [2025-09-17T01:58:29.414070] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T01:58:29.490158] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-17T01:58:29.704847] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T01:58:30.290137] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-17T01:58:30.803412] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T01:58:30.808922] [INFO ] [REMOTE ] AMN: Full fetch complete (60476 records). [2025-09-17T01:58:30.809062] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-17T01:58:31.097979] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-17T01:58:31.202922] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-17T01:58:31.203029] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-17T01:58:31.203677] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-17T01:58:31.203734] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-17T01:58:31.205017] [DEBUG] [LOCAL ] AMN: Trimmed 60476 records to 42235 (keeping 200 days of data) [2025-09-17T01:58:31.430843] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T01:58:31.467450] [DEBUG] [LOCAL ] AMN: Primary data saved (42235 records). [2025-09-17T01:58:31.467607] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-17T01:58:31.467711] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMN took 43.4s. Estimated remaining: 5h 17m 2s. Rate: 7.1 symbols/min [2025-09-17T01:58:31.638192] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:31.666504] [DEBUG] [LOCAL ] AMRC: Loaded 27742 existing records from primary storage. [2025-09-17T01:58:31.666677] [INFO ] [MAIN ] AMRC: Loaded 27742 existing records. [2025-09-17T01:58:31.844696] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:31.844934] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-17T01:58:31.844995] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-17T01:58:31.845734] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-17T01:58:31.845797] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-17T01:58:31.900623] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-17T01:58:32.234464] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:32.283949] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T01:58:32.288163] [INFO ] [REMOTE ] AMP: Full fetch complete (47407 records). [2025-09-17T01:58:32.288294] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-17T01:58:32.691527] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-11. [2025-09-17T01:58:32.692148] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-17T01:58:32.692945] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-17T01:58:32.693486] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-17T01:58:32.693544] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-17T01:58:32.694761] [DEBUG] [LOCAL ] AMP: Trimmed 47407 records to 32856 (keeping 200 days of data) [2025-09-17T01:58:32.904594] [DEBUG] [LOCAL ] AMP: Primary data saved (32856 records). [2025-09-17T01:58:32.904773] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-17T01:58:32.904876] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMP took 41.7s. Estimated remaining: 5h 14m 22s. Rate: 7.2 symbols/min [2025-09-17T01:58:33.073318] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:33.073525] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-17T01:58:33.073575] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-17T01:58:33.073699] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-17T01:58:33.073745] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-17T01:58:33.073796] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-17T01:58:33.073834] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-17T01:58:33.430957] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:33.490084] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-11. [2025-09-17T01:58:33.544522] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T01:58:33.699541] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:33.699894] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-11 [2025-09-17T01:58:34.031467] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T01:58:34.290132] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-17T01:58:35.090145] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-17T01:58:35.303876] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:35.304197] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-17T01:58:35.622361] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T01:58:35.890141] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-17T01:58:36.104160] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:36.104515] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-17T01:58:36.690127] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-17T01:58:37.490163] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-17T01:58:37.659141] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T01:58:38.290164] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-17T01:58:38.512196] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:38.512511] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-17T01:58:38.935619] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T01:58:39.090136] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-17T01:58:39.890136] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-17T01:58:40.443755] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T01:58:40.690423] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-17T01:58:41.082842] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T01:58:41.086785] [INFO ] [REMOTE ] AMPY: Full fetch complete (49631 records). [2025-09-17T01:58:41.086918] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-17T01:58:41.468604] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-17T01:58:41.468720] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-17T01:58:41.469419] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-17T01:58:41.469473] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-17T01:58:41.470599] [DEBUG] [LOCAL ] AMPY: Trimmed 49631 records to 37324 (keeping 200 days of data) [2025-09-17T01:58:41.518539] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-17T01:58:41.682526] [DEBUG] [LOCAL ] AMPY: Primary data saved (37324 records). [2025-09-17T01:58:41.682706] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-17T01:58:41.682795] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPY took 26.7s. Estimated remaining: 5h 14m 24s. Rate: 7.2 symbols/min [2025-09-17T01:58:41.863543] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:41.879246] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:58:41.919707] [DEBUG] [LOCAL ] AMT: Loaded 38959 existing records from primary storage. [2025-09-17T01:58:41.919882] [INFO ] [MAIN ] AMT: Loaded 38959 existing records. [2025-09-17T01:58:42.098019] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:42.098386] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-17T01:58:42.098463] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-17T01:58:42.100543] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-17T01:58:42.100659] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-17T01:58:42.294099] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-17T01:58:42.518254] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:42.579917] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:42.580742] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-17T01:58:42.581408] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:58:43.090141] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-17T01:58:43.890149] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-17T01:58:44.099149] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:44.099526] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-17T01:58:44.246672] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T01:58:44.690137] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-17T01:58:45.490138] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-17T01:58:45.863270] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T01:58:46.290132] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-17T01:58:46.492635] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:46.492989] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-17T01:58:46.966100] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T01:58:47.090141] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-17T01:58:47.890133] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-17T01:58:48.075455] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T01:58:48.690180] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-11. [2025-09-17T01:58:49.104137] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T01:58:49.490129] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-17T01:58:50.290118] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-17T01:58:50.533421] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T01:58:51.090127] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-17T01:58:51.323383] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:58:51.829230] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T01:58:51.890089] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-17T01:58:52.670947] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T01:58:52.690082] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-17T01:58:52.870400] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T01:58:53.490141] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-17T01:58:54.290183] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-17T01:58:54.665597] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T01:58:55.083591] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T01:58:55.093996] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-17T01:58:55.890152] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-17T01:58:56.010518] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T01:58:56.429952] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T01:58:56.690146] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-17T01:58:57.013337] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T01:58:57.490214] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-17T01:58:57.906611] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T01:58:57.912947] [INFO ] [REMOTE ] AMRZ: Full fetch complete (22645 records). [2025-09-17T01:58:57.913049] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-17T01:58:58.100089] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 60 unique days, need 200 days [2025-09-17T01:58:58.100504] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:58:58.100598] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:58:58.100698] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-17T01:58:58.100801] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-17T01:58:58.100914] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-17T01:58:58.101039] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-17T01:58:58.101126] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRZ took 25.2s. Estimated remaining: 5h 17m 8s. Rate: 7.1 symbols/min [2025-09-17T01:58:58.272353] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:58.288189] [DEBUG] [LOCAL ] AMTB: Loaded 15340 existing records from primary storage. [2025-09-17T01:58:58.288342] [INFO ] [MAIN ] AMTB: Loaded 15340 existing records. [2025-09-17T01:58:58.299427] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-17T01:58:58.466141] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:58.466363] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-17T01:58:58.466420] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-17T01:58:58.467152] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-17T01:58:58.467216] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-17T01:58:58.803077] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T01:58:58.849731] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:59.090134] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-17T01:58:59.768393] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T01:58:59.773441] [INFO ] [REMOTE ] AMRC: Full fetch complete (51974 records). [2025-09-17T01:58:59.773570] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-17T01:58:59.895218] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-17T01:59:00.156390] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-17T01:59:00.156495] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-17T01:59:00.157056] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-17T01:59:00.157121] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-17T01:59:00.158254] [DEBUG] [LOCAL ] AMRC: Trimmed 51974 records to 38785 (keeping 200 days of data) [2025-09-17T01:59:00.382912] [DEBUG] [LOCAL ] AMRC: Primary data saved (38785 records). [2025-09-17T01:59:00.383071] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-17T01:59:00.383168] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMRC took 28.9s. Estimated remaining: 5h 14m 50s. Rate: 7.2 symbols/min [2025-09-17T01:59:00.557153] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:00.561921] [DEBUG] [LOCAL ] AMTD: Loaded 2906 existing records from primary storage. [2025-09-17T01:59:00.562025] [INFO ] [MAIN ] AMTD: Loaded 2906 existing records. [2025-09-17T01:59:00.690200] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-11. [2025-09-17T01:59:00.744941] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:00.746060] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-17T01:59:00.746148] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-17T01:59:00.746482] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-17T01:59:00.746552] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-17T01:59:01.113890] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T01:59:01.142209] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:01.264055] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T01:59:01.490172] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-11. [2025-09-17T01:59:02.091714] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T01:59:02.173362] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T01:59:02.290138] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-17T01:59:03.090176] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-17T01:59:03.890156] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-17T01:59:04.205352] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T01:59:04.306406] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T01:59:04.690153] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-17T01:59:04.969045] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T01:59:05.490131] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-17T01:59:05.839852] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T01:59:06.290209] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-17T01:59:06.573001] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T01:59:07.090136] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-17T01:59:07.890157] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-17T01:59:08.188396] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T01:59:08.203473] [INFO ] [REMOTE ] AMR: Full fetch complete (39138 records). [2025-09-17T01:59:08.222321] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-17T01:59:08.224101] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T01:59:08.618412] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-17T01:59:08.618532] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-17T01:59:08.619011] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-17T01:59:08.619074] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-17T01:59:08.620091] [DEBUG] [LOCAL ] AMR: Trimmed 39138 records to 29397 (keeping 200 days of data) [2025-09-17T01:59:08.708427] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-17T01:59:08.802411] [DEBUG] [LOCAL ] AMR: Primary data saved (29397 records). [2025-09-17T01:59:08.802595] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-17T01:59:08.802715] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMR took 41.0s. Estimated remaining: 5h 14m 43s. Rate: 7.2 symbols/min [2025-09-17T01:59:08.970252] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:08.982581] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T01:59:09.020341] [DEBUG] [LOCAL ] AMTM: Loaded 37550 existing records from primary storage. [2025-09-17T01:59:09.020507] [INFO ] [MAIN ] AMTM: Loaded 37550 existing records. [2025-09-17T01:59:09.200518] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:09.200810] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-17T01:59:09.200881] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-17T01:59:09.202014] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-17T01:59:09.202077] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-17T01:59:09.495262] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-17T01:59:09.555496] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:10.106744] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T01:59:10.199552] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T01:59:10.290112] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-17T01:59:10.966203] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T01:59:11.090129] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-11. [2025-09-17T01:59:11.890136] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-17T01:59:12.693303] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-17T01:59:12.695250] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T01:59:12.942996] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T01:59:13.305859] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T01:59:13.490131] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-17T01:59:13.936902] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T01:59:14.290141] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-17T01:59:15.090161] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-17T01:59:15.208129] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T01:59:15.563472] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T01:59:15.890142] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-17T01:59:16.434872] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T01:59:16.690143] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-17T01:59:17.490171] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-17T01:59:18.249704] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T01:59:18.290109] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-17T01:59:18.463929] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T01:59:19.090145] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-17T01:59:19.718146] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T01:59:19.890107] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-17T01:59:20.003266] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:59:20.248183] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T01:59:20.690167] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-17T01:59:21.358628] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T01:59:21.359939] [INFO ] [REMOTE ] AMTD: Full fetch complete (5508 records). [2025-09-17T01:59:21.360023] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-17T01:59:21.499210] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-17T01:59:21.725683] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-17T01:59:21.725796] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-17T01:59:21.725977] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-17T01:59:21.726029] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-17T01:59:21.726439] [DEBUG] [LOCAL ] AMTD: Trimmed 5508 records to 3497 (keeping 200 days of data) [2025-09-17T01:59:21.747037] [DEBUG] [LOCAL ] AMTD: Primary data saved (3497 records). [2025-09-17T01:59:21.747135] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-17T01:59:21.747220] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMTD took 21.4s. Estimated remaining: 5h 16m 10s. Rate: 7.1 symbols/min [2025-09-17T01:59:21.914264] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:21.914492] [DEBUG] [LOCAL ] AMWL: No existing data file found in primary storage. [2025-09-17T01:59:21.914533] [WARN ] [MAIN ] AMWL: No existing data found, performing full refresh instead. [2025-09-17T01:59:21.917815] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-17T01:59:21.917925] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-17T01:59:21.917980] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-09-17T01:59:21.918025] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-17T01:59:22.273923] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:22.290085] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-11. [2025-09-17T01:59:23.067252] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T01:59:23.090083] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-17T01:59:23.330442] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T01:59:23.689108] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T01:59:23.890186] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-17T01:59:24.690172] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-17T01:59:24.954026] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:59:25.490187] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-17T01:59:26.290195] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-17T01:59:26.374237] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T01:59:26.634729] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T01:59:26.933849] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T01:59:27.090146] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-17T01:59:27.890155] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-17T01:59:28.209043] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T01:59:28.690127] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-17T01:59:28.735758] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T01:59:29.490148] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-17T01:59:30.290171] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-17T01:59:30.608807] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T01:59:30.658925] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:59:31.090198] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-17T01:59:31.890173] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-17T01:59:31.979116] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T01:59:32.342343] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T01:59:32.442015] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T01:59:32.448485] [INFO ] [REMOTE ] AMT: Full fetch complete (75850 records). [2025-09-17T01:59:32.448668] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-17T01:59:32.696029] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-17T01:59:32.840554] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-17T01:59:32.840679] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-17T01:59:32.841398] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-17T01:59:32.841453] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-17T01:59:32.844705] [DEBUG] [LOCAL ] AMT: Trimmed 75850 records to 52460 (keeping 200 days of data) [2025-09-17T01:59:33.178459] [DEBUG] [LOCAL ] AMT: Primary data saved (52460 records). [2025-09-17T01:59:33.178689] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-17T01:59:33.178829] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMT took 51.5s. Estimated remaining: 5h 17m 4s. Rate: 7.1 symbols/min [2025-09-17T01:59:33.350281] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:33.389429] [DEBUG] [LOCAL ] AMX: Loaded 36405 existing records from primary storage. [2025-09-17T01:59:33.389605] [INFO ] [MAIN ] AMX: Loaded 36405 existing records. [2025-09-17T01:59:33.491242] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-17T01:59:33.516704] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T01:59:33.584546] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:33.584826] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-17T01:59:33.584888] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-17T01:59:33.585962] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-17T01:59:33.586038] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-17T01:59:33.949027] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:34.290153] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-11. [2025-09-17T01:59:34.426909] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T01:59:34.429244] [INFO ] [REMOTE ] AMTB: Full fetch complete (30353 records). [2025-09-17T01:59:34.429333] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-17T01:59:34.797029] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-17T01:59:34.797135] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-17T01:59:34.797498] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-17T01:59:34.797550] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-17T01:59:34.798575] [DEBUG] [LOCAL ] AMTB: Trimmed 30353 records to 20592 (keeping 200 days of data) [2025-09-17T01:59:34.929380] [DEBUG] [LOCAL ] AMTB: Primary data saved (20592 records). [2025-09-17T01:59:34.929538] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-17T01:59:34.929635] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMTB took 36.8s. Estimated remaining: 5h 14m 40s. Rate: 7.2 symbols/min [2025-09-17T01:59:35.096914] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-17T01:59:35.100660] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:35.125781] [DEBUG] [LOCAL ] AN: Loaded 23233 existing records from primary storage. [2025-09-17T01:59:35.125939] [INFO ] [MAIN ] AN: Loaded 23233 existing records. [2025-09-17T01:59:35.306817] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:35.307094] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-17T01:59:35.307176] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-17T01:59:35.308209] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-17T01:59:35.308313] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-17T01:59:35.668343] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:35.890094] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-17T01:59:35.921905] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T01:59:35.954711] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T01:59:36.690128] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-11. [2025-09-17T01:59:37.490132] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-17T01:59:37.682805] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T01:59:37.751216] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T01:59:38.019960] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T01:59:38.290149] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-17T01:59:39.090203] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-17T01:59:39.691797] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T01:59:39.890136] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-17T01:59:39.903549] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T01:59:40.690131] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-17T01:59:41.162684] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T01:59:41.490137] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-17T01:59:42.290110] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-17T01:59:42.402703] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T01:59:43.091528] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-17T01:59:43.092339] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T01:59:43.196058] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T01:59:43.890205] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-17T01:59:44.450885] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T01:59:44.477954] [INFO ] [REMOTE ] AMWL: Full fetch complete (13945 records). [2025-09-17T01:59:44.478718] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-17T01:59:44.479694] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T01:59:44.697549] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-17T01:59:44.863109] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-17T01:59:44.863208] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-17T01:59:44.863476] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-17T01:59:44.863525] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-17T01:59:44.864118] [DEBUG] [LOCAL ] AMWL: Trimmed 13945 records to 8606 (keeping 200 days of data) [2025-09-17T01:59:44.912317] [DEBUG] [LOCAL ] AMWL: Primary data saved (8606 records). [2025-09-17T01:59:44.912457] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-17T01:59:44.912555] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMWL took 23.2s. Estimated remaining: 5h 15m 4s. Rate: 7.2 symbols/min [2025-09-17T01:59:45.079418] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:45.118075] [DEBUG] [LOCAL ] ANET: Loaded 40116 existing records from primary storage. [2025-09-17T01:59:45.118257] [INFO ] [MAIN ] ANET: Loaded 40116 existing records. [2025-09-17T01:59:45.295028] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:45.295269] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-17T01:59:45.295320] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-17T01:59:45.296518] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-17T01:59:45.296583] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-17T01:59:45.497734] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-17T01:59:45.655869] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:46.290137] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-17T01:59:46.330728] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:59:47.096503] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-17T01:59:47.097985] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T01:59:47.890162] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-17T01:59:48.028385] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T01:59:48.690177] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-11. [2025-09-17T01:59:48.780686] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T01:59:49.312036] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T01:59:49.490137] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-17T01:59:50.290136] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-17T01:59:50.501378] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T01:59:51.090199] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-17T01:59:51.195114] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T01:59:51.824079] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T01:59:51.890084] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-17T01:59:52.678909] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T01:59:52.690100] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-17T01:59:53.267814] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T01:59:53.490190] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-17T01:59:54.290099] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-17T01:59:54.526345] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T01:59:54.645242] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T01:59:55.090151] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-17T01:59:55.890192] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-17T01:59:56.032625] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T01:59:56.476519] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T01:59:56.690146] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-17T01:59:57.490158] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-17T01:59:57.937430] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T01:59:58.287959] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-17T01:59:58.297769] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-17T01:59:58.453237] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T01:59:59.090171] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-17T01:59:59.785480] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T01:59:59.890108] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-17T02:00:00.690144] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-17T02:00:01.173092] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T02:00:01.490185] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-17T02:00:01.618070] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-17T02:00:02.290158] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-17T02:00:02.923789] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T02:00:03.090189] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-17T02:00:03.890214] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-17T02:00:05.244799] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (3.75 seconds). [2025-09-17T02:00:05.249066] [INFO ] [REMOTE ] AN: Full fetch complete (47849 records). [2025-09-17T02:00:05.249216] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-17T02:00:05.627588] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-17T02:00:05.627738] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-17T02:00:05.628331] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-17T02:00:05.628432] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-17T02:00:05.629685] [DEBUG] [LOCAL ] AN: Trimmed 47849 records to 32970 (keeping 200 days of data) [2025-09-17T02:00:05.842249] [DEBUG] [LOCAL ] AN: Primary data saved (32970 records). [2025-09-17T02:00:05.842542] [INFO ] [MAIN ] AN: Full history saved. [2025-09-17T02:00:05.842764] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AN took 30.9s. Estimated remaining: 5h 19m 7s. Rate: 7.1 symbols/min [2025-09-17T02:00:06.012785] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:06.055450] [DEBUG] [LOCAL ] ANF: Loaded 38799 existing records from primary storage. [2025-09-17T02:00:06.055670] [INFO ] [MAIN ] ANF: Loaded 38799 existing records. [2025-09-17T02:00:06.237690] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:06.237989] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-17T02:00:06.238058] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-17T02:00:06.239175] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-17T02:00:06.239252] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-17T02:00:06.611418] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:06.611877] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-11. [2025-09-17T02:00:06.629903] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-17T02:00:06.637147] [INFO ] [REMOTE ] AMTM: Full fetch complete (73734 records). [2025-09-17T02:00:06.637838] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-17T02:00:07.053138] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-17T02:00:07.053320] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-17T02:00:07.054097] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-17T02:00:07.054187] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-17T02:00:07.056546] [DEBUG] [LOCAL ] AMTM: Trimmed 73734 records to 50733 (keeping 200 days of data) [2025-09-17T02:00:07.174907] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (4.88 seconds). [2025-09-17T02:00:07.197077] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-17T02:00:07.413020] [DEBUG] [LOCAL ] AMTM: Primary data saved (50733 records). [2025-09-17T02:00:07.413226] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-17T02:00:07.413361] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AMTM took 58.6s. Estimated remaining: 5h 16m 41s. Rate: 7.1 symbols/min [2025-09-17T02:00:07.604390] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:07.604709] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-17T02:00:07.605172] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-17T02:00:07.605542] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-17T02:00:07.605680] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-17T02:00:07.605784] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-17T02:00:07.605871] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-17T02:00:07.837598] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (4.75 seconds). [2025-09-17T02:00:07.961910] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-17T02:00:08.029301] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:08.029612] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-11. [2025-09-17T02:00:08.250754] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:08.251087] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-11 [2025-09-17T02:00:08.251533] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-17T02:00:08.477987] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:08.478970] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-17T02:00:08.690299] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-17T02:00:08.871187] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-11 (2.26 seconds). [2025-09-17T02:00:08.925944] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:08.926303] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-17T02:00:09.339772] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T02:00:09.490157] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-17T02:00:09.600798] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T02:00:09.608702] [INFO ] [REMOTE ] AMX: Full fetch complete (70662 records). [2025-09-17T02:00:09.608866] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-17T02:00:10.018868] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-17T02:00:10.019025] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-17T02:00:10.020057] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-17T02:00:10.020125] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-17T02:00:10.021850] [DEBUG] [LOCAL ] AMX: Trimmed 70662 records to 49004 (keeping 200 days of data) [2025-09-17T02:00:10.298506] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-17T02:00:10.340252] [DEBUG] [LOCAL ] AMX: Primary data saved (49004 records). [2025-09-17T02:00:10.340419] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-17T02:00:10.340611] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMX took 37.2s. Estimated remaining: 5h 14m 45s. Rate: 7.2 symbols/min [2025-09-17T02:00:10.517421] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:10.533890] [DEBUG] [LOCAL ] ANRO: Loaded 13497 existing records from primary storage. [2025-09-17T02:00:10.534043] [INFO ] [MAIN ] ANRO: Loaded 13497 existing records. [2025-09-17T02:00:10.716454] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:10.716796] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-17T02:00:10.716938] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-17T02:00:10.717369] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-17T02:00:10.717447] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-17T02:00:11.074504] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:11.090079] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-11. [2025-09-17T02:00:11.155950] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:00:11.890133] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-17T02:00:12.045751] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:00:12.690133] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-17T02:00:12.746810] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-17T02:00:13.490208] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-17T02:00:13.831543] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T02:00:13.862075] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:00:14.290160] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-17T02:00:15.090167] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-17T02:00:15.498564] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:15.498926] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-17T02:00:15.890134] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-17T02:00:16.054955] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-17T02:00:16.308657] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T02:00:16.690151] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-17T02:00:17.079330] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:17.079675] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-17T02:00:17.490135] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-17T02:00:17.695400] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:17.695751] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-17T02:00:18.290139] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-17T02:00:19.090143] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-17T02:00:19.304261] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:19.304622] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-17T02:00:19.409496] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-17T02:00:19.890142] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-17T02:00:20.224942] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T02:00:20.690130] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-17T02:00:20.847749] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T02:00:21.490175] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-17T02:00:22.295615] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-17T02:00:22.303785] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:00:22.538385] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:00:23.090154] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-17T02:00:23.890136] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-17T02:00:24.108254] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:24.108588] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-17T02:00:24.251533] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T02:00:24.690156] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-17T02:00:25.010177] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T02:00:25.490203] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-17T02:00:26.290210] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-17T02:00:26.606604] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:26.607041] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-17T02:00:26.630416] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T02:00:26.638227] [INFO ] [REMOTE ] ANET: Full fetch complete (77681 records). [2025-09-17T02:00:26.638487] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-17T02:00:27.119443] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-17T02:00:27.156094] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-17T02:00:27.174637] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-17T02:00:27.176839] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:00:27.178047] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-17T02:00:27.184574] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-17T02:00:27.187840] [DEBUG] [LOCAL ] ANET: Trimmed 77681 records to 53766 (keeping 200 days of data) [2025-09-17T02:00:27.389116] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:27.417358] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-17T02:00:27.554826] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-17T02:00:27.555048] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-17T02:00:27.555164] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANET took 42.6s. Estimated remaining: 5h 17m 28s. Rate: 7.1 symbols/min [2025-09-17T02:00:27.734611] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:27.753910] [DEBUG] [LOCAL ] ANVS: Loaded 17667 existing records from primary storage. [2025-09-17T02:00:27.754131] [INFO ] [MAIN ] ANVS: Loaded 17667 existing records. [2025-09-17T02:00:27.895670] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-17T02:00:27.936243] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:27.936556] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-17T02:00:27.936618] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-17T02:00:27.937314] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-17T02:00:27.937390] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-17T02:00:28.292231] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:28.690137] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-11. [2025-09-17T02:00:28.852035] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T02:00:28.854998] [INFO ] [REMOTE ] ANGX: Full fetch complete (1325 records). [2025-09-17T02:00:28.855181] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-17T02:00:29.042480] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-17T02:00:29.042711] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:00:29.042760] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:00:29.042803] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-17T02:00:29.042872] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-17T02:00:29.042915] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-17T02:00:29.042977] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-17T02:00:29.043050] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. ANGX took 21.6s. Estimated remaining: 5h 15m 6s. Rate: 7.1 symbols/min [2025-09-17T02:00:29.490132] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-17T02:00:29.777602] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:00:30.290162] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-17T02:00:31.090191] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-17T02:00:31.306831] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:00:31.443760] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T02:00:31.890111] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-17T02:00:32.290112] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T02:00:32.690187] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-17T02:00:33.490156] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-17T02:00:33.769735] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T02:00:33.901456] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T02:00:34.290141] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-17T02:00:34.405805] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T02:00:35.090185] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-17T02:00:35.155165] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:00:35.890203] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-17T02:00:36.536680] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:00:36.690128] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-17T02:00:37.490169] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-17T02:00:37.820615] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:00:37.846238] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T02:00:38.290134] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-17T02:00:38.542743] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T02:00:39.090122] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-17T02:00:39.438969] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T02:00:39.890155] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-17T02:00:40.006776] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T02:00:40.691576] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-17T02:00:41.490130] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-17T02:00:41.657868] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T02:00:41.676138] [INFO ] [REMOTE ] ANF: Full fetch complete (75544 records). [2025-09-17T02:00:41.678301] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-17T02:00:41.679360] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T02:00:42.075979] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-17T02:00:42.076093] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-17T02:00:42.076832] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-17T02:00:42.076899] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-17T02:00:42.078387] [DEBUG] [LOCAL ] ANF: Trimmed 75544 records to 52297 (keeping 200 days of data) [2025-09-17T02:00:42.292777] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-17T02:00:42.295117] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T02:00:42.297864] [INFO ] [REMOTE ] ANRO: Full fetch complete (31113 records). [2025-09-17T02:00:42.298697] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-17T02:00:42.701225] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-17T02:00:42.702098] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-17T02:00:42.703310] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-17T02:00:42.704115] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-17T02:00:42.707785] [DEBUG] [LOCAL ] ANRO: Trimmed 31113 records to 20465 (keeping 200 days of data) [2025-09-17T02:00:42.884121] [DEBUG] [LOCAL ] ANF: Primary data saved (52297 records). [2025-09-17T02:00:42.885830] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-17T02:00:42.890099] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANF took 37.0s. Estimated remaining: 5h 16m 41s. Rate: 7.1 symbols/min [2025-09-17T02:00:42.901783] [DEBUG] [LOCAL ] ANRO: Primary data saved (20465 records). [2025-09-17T02:00:42.901930] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-17T02:00:42.902014] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANRO took 32.6s. Estimated remaining: 5h 13m 54s. Rate: 7.2 symbols/min [2025-09-17T02:00:43.775725] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T02:00:43.782460] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-17T02:00:44.655253] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:00:44.661033] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-17T02:00:45.776003] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:00:45.780895] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-17T02:00:46.686325] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T02:00:46.688913] [INFO ] [REMOTE ] ANVS: Full fetch complete (37184 records). [2025-09-17T02:00:46.689019] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-17T02:00:47.056255] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-17T02:00:47.056364] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-17T02:00:47.057004] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-17T02:00:47.057060] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-17T02:00:47.057926] [DEBUG] [LOCAL ] ANVS: Trimmed 37184 records to 23544 (keeping 200 days of data) [2025-09-17T02:00:47.186560] [DEBUG] [LOCAL ] ANVS: Primary data saved (23544 records). [2025-09-17T02:00:47.186732] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-17T02:00:47.186821] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANVS took 19.6s. Estimated remaining: 5h 12m 29s. Rate: 7.2 symbols/min [2025-09-17T02:00:47.727666] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.901488] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.904252] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.854573] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.905161] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-17T02:00:47.905416] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-17T02:00:47.905828] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-17T02:00:47.905930] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-17T02:00:47.907060] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-17T02:00:47.907150] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-17T02:00:48.023064] [DEBUG] [LOCAL ] AOMR: Loaded 12747 existing records from primary storage. [2025-09-17T02:00:48.051270] [DEBUG] [LOCAL ] AOD: Loaded 22340 existing records from primary storage. [2025-09-17T02:00:48.087743] [INFO ] [MAIN ] AOMR: Loaded 12747 existing records. [2025-09-17T02:00:48.098799] [INFO ] [MAIN ] AOD: Loaded 22340 existing records. [2025-09-17T02:00:48.358871] [DEBUG] [LOCAL ] AON: Loaded 33740 existing records from primary storage. [2025-09-17T02:00:48.400024] [INFO ] [MAIN ] AON: Loaded 33740 existing records. [2025-09-17T02:00:48.745284] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:48.761465] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:48.781295] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-17T02:00:48.787012] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-17T02:00:48.770682] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:48.799590] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-17T02:00:48.800424] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-17T02:00:48.800224] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-11. [2025-09-17T02:00:48.821677] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-17T02:00:48.858027] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-17T02:00:48.864176] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-17T02:00:48.866054] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-17T02:00:48.886232] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:48.934459] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-17T02:00:49.007583] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-17T02:00:49.075661] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-17T02:00:49.124755] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-17T02:00:49.146914] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:49.275429] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-11 [2025-09-17T02:00:49.359265] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-17T02:00:49.819302] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:49.830047] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:49.876994] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-17T02:00:49.943033] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-11. [2025-09-17T02:00:49.943288] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-17T02:00:49.954308] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:49.960820] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-11. [2025-09-17T02:00:50.101127] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:50.101459] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-11. [2025-09-17T02:00:50.234201] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:50.234625] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-17T02:00:50.290106] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-17T02:00:50.504738] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:50.505082] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-17T02:00:50.775625] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T02:00:51.028024] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T02:00:51.090120] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-17T02:00:51.372467] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T02:00:51.890145] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-17T02:00:51.987715] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:00:52.690130] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-17T02:00:53.184521] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:00:53.490134] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-17T02:00:53.569870] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T02:00:54.290152] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-17T02:00:54.844333] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T02:00:55.090164] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-17T02:00:55.304112] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:55.304691] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-17T02:00:55.890137] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-17T02:00:56.061018] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T02:00:56.690144] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-17T02:00:56.821714] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T02:00:56.911905] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:56.912272] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-17T02:00:57.490145] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-17T02:00:57.913488] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T02:00:58.290154] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-17T02:00:58.853908] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T02:00:59.090178] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-17T02:00:59.890189] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-17T02:01:00.306121] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T02:01:00.360421] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T02:01:00.690136] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-17T02:01:01.490185] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-17T02:01:01.717552] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T02:01:02.290148] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-17T02:01:03.090159] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-17T02:01:03.198475] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:01:03.265215] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:01:03.890144] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-17T02:01:04.082780] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:01:04.690150] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-17T02:01:05.452507] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:01:05.490131] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-17T02:01:06.063059] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:01:06.290137] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-17T02:01:06.744313] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:01:07.090147] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-17T02:01:07.321360] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:01:07.458309] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:01:07.459376] [INFO ] [REMOTE ] AOMD: Full fetch complete (1684 records). [2025-09-17T02:01:07.459467] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-17T02:01:07.688365] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 78 unique days, need 200 days [2025-09-17T02:01:07.688691] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:01:07.689277] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:01:07.689361] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-17T02:01:07.689457] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-17T02:01:07.689514] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-17T02:01:07.689606] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-17T02:01:07.689787] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 20.5s. Estimated remaining: 5h 16m 6s. Rate: 7.1 symbols/min [2025-09-17T02:01:07.878677] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:07.895059] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-17T02:01:07.907189] [DEBUG] [LOCAL ] AORT: Loaded 21726 existing records from primary storage. [2025-09-17T02:01:07.907397] [INFO ] [MAIN ] AORT: Loaded 21726 existing records. [2025-09-17T02:01:08.084231] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:08.084511] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-17T02:01:08.084575] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-17T02:01:08.085539] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-17T02:01:08.085607] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-17T02:01:08.434236] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:08.690172] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-17T02:01:08.976713] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:01:09.490149] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-17T02:01:09.954723] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:01:10.290154] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-11. [2025-09-17T02:01:10.542807] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:01:11.090129] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-17T02:01:11.383083] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:01:11.890158] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-17T02:01:12.690108] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-17T02:01:12.945817] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T02:01:13.062299] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T02:01:13.490183] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-17T02:01:13.766163] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:01:14.290147] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-17T02:01:15.090177] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-17T02:01:15.120360] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:01:15.176720] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T02:01:15.890162] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-17T02:01:16.427133] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T02:01:16.690132] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-17T02:01:17.490148] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-17T02:01:17.644656] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:01:17.721858] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T02:01:18.290144] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-17T02:01:18.937997] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:01:19.090157] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-17T02:01:19.890169] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-17T02:01:20.060755] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T02:01:20.096981] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T02:01:20.101305] [INFO ] [REMOTE ] AOD: Full fetch complete (44047 records). [2025-09-17T02:01:20.101432] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-17T02:01:20.477211] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-17T02:01:20.477321] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-17T02:01:20.477832] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-17T02:01:20.477888] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-17T02:01:20.479567] [DEBUG] [LOCAL ] AOD: Trimmed 44047 records to 30403 (keeping 200 days of data) [2025-09-17T02:01:20.659447] [DEBUG] [LOCAL ] AOD: Primary data saved (30403 records). [2025-09-17T02:01:20.659616] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-17T02:01:20.659739] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOD took 33.5s. Estimated remaining: 5h 17m 21s. Rate: 7.1 symbols/min [2025-09-17T02:01:20.695247] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-17T02:01:20.836578] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:20.873029] [DEBUG] [LOCAL ] AOS: Loaded 36605 existing records from primary storage. [2025-09-17T02:01:20.873221] [INFO ] [MAIN ] AOS: Loaded 36605 existing records. [2025-09-17T02:01:21.057435] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:21.057728] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-17T02:01:21.057785] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-17T02:01:21.059348] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-17T02:01:21.059417] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-17T02:01:21.413739] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:21.439578] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:01:21.490082] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-11. [2025-09-17T02:01:22.290156] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-17T02:01:22.446216] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:01:22.841739] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T02:01:23.095208] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-17T02:01:23.111204] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:01:23.890089] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-17T02:01:24.208110] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:01:24.690125] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-17T02:01:25.310615] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T02:01:25.490173] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-17T02:01:25.918046] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T02:01:26.290201] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-17T02:01:26.456553] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:01:26.459410] [INFO ] [REMOTE ] AOMR: Full fetch complete (22997 records). [2025-09-17T02:01:26.459548] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-17T02:01:26.899628] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-17T02:01:26.899767] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-17T02:01:26.900150] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-17T02:01:26.900207] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-17T02:01:26.901034] [DEBUG] [LOCAL ] AOMR: Trimmed 22997 records to 17073 (keeping 200 days of data) [2025-09-17T02:01:27.005158] [DEBUG] [LOCAL ] AOMR: Primary data saved (17073 records). [2025-09-17T02:01:27.005341] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-17T02:01:27.005443] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. AOMR took 39.8s. Estimated remaining: 5h 16m 34s. Rate: 7.1 symbols/min [2025-09-17T02:01:27.095339] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-17T02:01:27.184769] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:27.191944] [DEBUG] [LOCAL ] AP: Loaded 5815 existing records from primary storage. [2025-09-17T02:01:27.192075] [INFO ] [MAIN ] AP: Loaded 5815 existing records. [2025-09-17T02:01:27.370087] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:27.370359] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-17T02:01:27.370418] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-17T02:01:27.371125] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-17T02:01:27.371188] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-17T02:01:27.727481] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:27.746222] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T02:01:27.890139] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-17T02:01:28.604701] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T02:01:28.610155] [INFO ] [REMOTE ] AON: Full fetch complete (64683 records). [2025-09-17T02:01:28.610310] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-17T02:01:28.695322] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-17T02:01:29.000783] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-17T02:01:29.000890] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-17T02:01:29.001606] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-17T02:01:29.001686] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-17T02:01:29.003072] [DEBUG] [LOCAL ] AON: Trimmed 64683 records to 45693 (keeping 200 days of data) [2025-09-17T02:01:29.146930] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:01:29.324011] [DEBUG] [LOCAL ] AON: Primary data saved (45693 records). [2025-09-17T02:01:29.324200] [INFO ] [MAIN ] AON: Full history saved. [2025-09-17T02:01:29.324335] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AON took 42.1s. Estimated remaining: 5h 14m 34s. Rate: 7.1 symbols/min [2025-09-17T02:01:29.494567] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-11. [2025-09-17T02:01:29.496056] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:29.496246] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-09-17T02:01:29.497072] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-09-17T02:01:29.497232] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-17T02:01:29.497306] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-17T02:01:29.497382] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-17T02:01:29.497441] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-17T02:01:29.857958] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:30.161002] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T02:01:30.222011] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:01:30.290146] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-11. [2025-09-17T02:01:31.090138] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-17T02:01:31.722812] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:01:31.890139] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-17T02:01:32.657696] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:01:32.690165] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-17T02:01:33.100124] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:01:33.490187] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-17T02:01:33.790730] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T02:01:34.290181] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-17T02:01:34.574040] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T02:01:35.090148] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-17T02:01:35.469027] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T02:01:35.634508] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T02:01:35.890127] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-17T02:01:36.542065] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T02:01:36.690154] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-17T02:01:37.348734] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T02:01:37.490137] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-17T02:01:37.902995] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T02:01:38.290150] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-17T02:01:38.908520] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T02:01:39.090153] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-17T02:01:39.890085] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-17T02:01:40.283993] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:01:40.288133] [INFO ] [REMOTE ] AORT: Full fetch complete (41306 records). [2025-09-17T02:01:40.288289] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-17T02:01:40.665058] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-17T02:01:40.665176] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-17T02:01:40.665683] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-17T02:01:40.665752] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-17T02:01:40.667127] [DEBUG] [LOCAL ] AORT: Trimmed 41306 records to 29976 (keeping 200 days of data) [2025-09-17T02:01:40.721909] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-17T02:01:40.848139] [DEBUG] [LOCAL ] AORT: Primary data saved (29976 records). [2025-09-17T02:01:40.848318] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-17T02:01:40.848457] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AORT took 33.2s. Estimated remaining: 5h 15m 22s. Rate: 7.1 symbols/min [2025-09-17T02:01:40.995183] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T02:01:41.027491] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:41.064500] [DEBUG] [LOCAL ] APD: Loaded 33341 existing records from primary storage. [2025-09-17T02:01:41.064716] [INFO ] [MAIN ] APD: Loaded 33341 existing records. [2025-09-17T02:01:41.244681] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:41.244945] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-17T02:01:41.245007] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-17T02:01:41.246359] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-17T02:01:41.246441] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-17T02:01:41.497849] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-17T02:01:41.610350] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:42.290150] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-11. [2025-09-17T02:01:42.366491] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:01:42.623972] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T02:01:43.090145] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-17T02:01:43.718775] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:01:43.890123] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-17T02:01:44.512231] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:01:44.690130] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-17T02:01:45.490118] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-17T02:01:45.669322] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T02:01:46.290097] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:01:46.290312] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-17T02:01:46.498546] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T02:01:47.090132] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-17T02:01:47.697905] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:01:47.890126] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-17T02:01:48.690134] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-17T02:01:48.750530] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T02:01:48.955428] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:01:49.490126] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-17T02:01:50.072121] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:01:50.290082] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-17T02:01:50.855949] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:01:51.090093] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-17T02:01:51.457121] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:01:51.890118] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-17T02:01:52.566746] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:01:52.690148] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-17T02:01:53.490853] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-17T02:01:53.502010] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T02:01:54.176329] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T02:01:54.290188] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-17T02:01:54.554830] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T02:01:54.689352] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T02:01:54.690756] [INFO ] [REMOTE ] AP: Full fetch complete (8594 records). [2025-09-17T02:01:54.690850] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-17T02:01:55.067240] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-17T02:01:55.067350] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-17T02:01:55.067584] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-17T02:01:55.067636] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-17T02:01:55.068108] [DEBUG] [LOCAL ] AP: Trimmed 8594 records to 6759 (keeping 200 days of data) [2025-09-17T02:01:55.095623] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-17T02:01:55.110343] [DEBUG] [LOCAL ] AP: Primary data saved (6759 records). [2025-09-17T02:01:55.110631] [INFO ] [MAIN ] AP: Full history saved. [2025-09-17T02:01:55.110763] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AP took 28.1s. Estimated remaining: 5h 16m 57s. Rate: 7.1 symbols/min [2025-09-17T02:01:55.280175] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:55.317701] [DEBUG] [LOCAL ] APG: Loaded 37860 existing records from primary storage. [2025-09-17T02:01:55.317886] [INFO ] [MAIN ] APG: Loaded 37860 existing records. [2025-09-17T02:01:55.496042] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:55.496312] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-17T02:01:55.496372] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-17T02:01:55.497727] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-17T02:01:55.497792] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-17T02:01:55.851260] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:55.890111] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-11. [2025-09-17T02:01:56.690162] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-17T02:01:56.915739] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:01:57.084417] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:01:57.490160] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-17T02:01:58.141181] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T02:01:58.290141] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-17T02:01:59.095251] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-17T02:01:59.109359] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T02:01:59.891073] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-17T02:01:59.893622] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T02:02:00.686824] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T02:02:00.695958] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-17T02:02:01.450998] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T02:02:01.490127] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-17T02:02:02.064905] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:02:02.290173] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-17T02:02:02.903948] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:02:03.090166] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-17T02:02:03.502316] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:02:03.890143] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-17T02:02:04.695426] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-17T02:02:04.724515] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:02:04.999862] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:02:05.005983] [INFO ] [REMOTE ] AOS: Full fetch complete (70557 records). [2025-09-17T02:02:05.006164] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-17T02:02:05.397620] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-17T02:02:05.397761] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-17T02:02:05.398542] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-17T02:02:05.398620] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-17T02:02:05.400187] [DEBUG] [LOCAL ] AOS: Trimmed 70557 records to 49470 (keeping 200 days of data) [2025-09-17T02:02:05.492453] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-17T02:02:05.710134] [DEBUG] [LOCAL ] AOS: Primary data saved (49470 records). [2025-09-17T02:02:05.710305] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-17T02:02:05.710407] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AOS took 45.1s. Estimated remaining: 5h 17m 26s. Rate: 7.1 symbols/min [2025-09-17T02:02:05.885812] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:05.925119] [DEBUG] [LOCAL ] APH: Loaded 40041 existing records from primary storage. [2025-09-17T02:02:05.925286] [INFO ] [MAIN ] APH: Loaded 40041 existing records. [2025-09-17T02:02:06.129127] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:06.130327] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T02:02:06.130750] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-17T02:02:06.135176] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-17T02:02:06.135406] [INFO ] [REMOTE ] APAM: Full fetch complete (51566 records). [2025-09-17T02:02:06.135594] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-17T02:02:06.167989] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-17T02:02:06.201408] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-17T02:02:06.297815] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-17T02:02:06.917449] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-17T02:02:06.949021] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:06.949468] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-17T02:02:06.950306] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-17T02:02:06.950428] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-17T02:02:06.951842] [DEBUG] [LOCAL ] APAM: Trimmed 51566 records to 36872 (keeping 200 days of data) [2025-09-17T02:02:07.075991] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T02:02:07.092775] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-11. [2025-09-17T02:02:07.228960] [DEBUG] [LOCAL ] APAM: Primary data saved (36872 records). [2025-09-17T02:02:07.229164] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-17T02:02:07.229256] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. APAM took 37.9s. Estimated remaining: 5h 15m 16s. Rate: 7.1 symbols/min [2025-09-17T02:02:07.398112] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:07.439750] [DEBUG] [LOCAL ] APLE: Loaded 38699 existing records from primary storage. [2025-09-17T02:02:07.439937] [INFO ] [MAIN ] APLE: Loaded 38699 existing records. [2025-09-17T02:02:07.625953] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:07.626223] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-17T02:02:07.626281] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-17T02:02:07.627906] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-17T02:02:07.627993] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-17T02:02:07.897416] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-17T02:02:07.991785] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:08.022276] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:02:08.656339] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:02:08.690170] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-17T02:02:09.490163] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-11. [2025-09-17T02:02:09.618678] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:02:10.290153] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-17T02:02:10.518255] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T02:02:10.820796] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:02:11.090133] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-17T02:02:11.579402] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:02:11.890138] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-17T02:02:12.690102] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-17T02:02:12.793146] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:02:13.233731] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T02:02:13.239065] [INFO ] [REMOTE ] APD: Full fetch complete (66394 records). [2025-09-17T02:02:13.239224] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-17T02:02:13.502017] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-17T02:02:13.641899] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-17T02:02:13.642022] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-17T02:02:13.642820] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-17T02:02:13.642897] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-17T02:02:13.644772] [DEBUG] [LOCAL ] APD: Trimmed 66394 records to 45559 (keeping 200 days of data) [2025-09-17T02:02:13.939803] [DEBUG] [LOCAL ] APD: Primary data saved (45559 records). [2025-09-17T02:02:13.939973] [INFO ] [MAIN ] APD: Full history saved. [2025-09-17T02:02:13.940091] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APD took 33.1s. Estimated remaining: 5h 14m 37s. Rate: 7.1 symbols/min [2025-09-17T02:02:14.109810] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:14.151512] [DEBUG] [LOCAL ] APO: Loaded 39757 existing records from primary storage. [2025-09-17T02:02:14.151706] [INFO ] [MAIN ] APO: Loaded 39757 existing records. [2025-09-17T02:02:14.291590] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-17T02:02:14.331226] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:14.332373] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-17T02:02:14.332495] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-17T02:02:14.334471] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-17T02:02:14.334685] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-17T02:02:14.654790] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T02:02:14.736878] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:15.090138] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-17T02:02:15.290572] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:02:15.890135] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-17T02:02:16.075189] [DEBUG] [REMOTE ] APG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-17T02:02:16.075559] [WARN ] [REMOTE ] APG: No data returned for month 2025-06 [2025-09-17T02:02:16.113424] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:02:16.622786] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T02:02:16.690103] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-17T02:02:17.490128] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-17T02:02:18.290152] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-17T02:02:18.661281] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T02:02:18.988441] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:02:19.090163] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-17T02:02:19.890100] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-11. [2025-09-17T02:02:19.963512] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T02:02:20.690136] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-17T02:02:20.801484] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T02:02:21.490146] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-17T02:02:21.693203] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:02:22.290139] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-17T02:02:22.520373] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:02:22.940607] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:02:22.947014] [INFO ] [REMOTE ] APG: Full fetch complete (63798 records). [2025-09-17T02:02:22.947154] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-17T02:02:23.097113] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-17T02:02:23.140418] [WARN ] [VALIDATOR ] APG: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T02:02:23.141719] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:02:23.141773] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:02:23.141822] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-17T02:02:23.141884] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-17T02:02:23.141989] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-09-17T02:02:23.142377] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-09-17T02:02:23.142503] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APG took 28.0s. Estimated remaining: 5h 14m 42s. Rate: 7.1 symbols/min [2025-09-17T02:02:23.328994] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:23.336495] [DEBUG] [LOCAL ] APOS: Loaded 5235 existing records from primary storage. [2025-09-17T02:02:23.336664] [INFO ] [MAIN ] APOS: Loaded 5235 existing records. [2025-09-17T02:02:23.512472] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:23.512758] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-17T02:02:23.512818] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-17T02:02:23.513125] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-17T02:02:23.513180] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-17T02:02:23.900082] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-17T02:02:23.905448] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:24.328680] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T02:02:24.690168] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-11. [2025-09-17T02:02:24.736786] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:02:25.446329] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T02:02:25.490092] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-17T02:02:25.863639] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T02:02:26.290138] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-17T02:02:26.993172] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T02:02:27.090129] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-17T02:02:27.890138] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-17T02:02:28.187031] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T02:02:28.654790] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T02:02:28.690155] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-17T02:02:29.046272] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T02:02:29.490170] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-17T02:02:30.110252] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T02:02:30.290425] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-17T02:02:30.293510] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T02:02:31.090151] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-17T02:02:31.890154] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-17T02:02:32.022281] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:02:32.690130] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-17T02:02:33.137022] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T02:02:33.294433] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T02:02:33.490097] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-17T02:02:34.290135] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-17T02:02:34.573017] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T02:02:34.990543] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T02:02:35.090149] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-17T02:02:35.434616] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T02:02:35.890136] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-17T02:02:36.551952] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T02:02:36.690142] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-17T02:02:37.018757] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:02:37.470347] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T02:02:37.490131] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-17T02:02:38.038750] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T02:02:38.290126] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-17T02:02:39.078707] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:02:39.090234] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-17T02:02:39.890171] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-17T02:02:40.690195] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-17T02:02:41.227467] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T02:02:41.490173] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-17T02:02:41.986677] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T02:02:42.015254] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:02:42.023822] [INFO ] [REMOTE ] APLE: Full fetch complete (74032 records). [2025-09-17T02:02:42.024011] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-17T02:02:42.297208] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-17T02:02:42.419272] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-17T02:02:42.419380] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-17T02:02:42.420148] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-17T02:02:42.420215] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-17T02:02:42.421679] [DEBUG] [LOCAL ] APLE: Trimmed 74032 records to 52087 (keeping 200 days of data) [2025-09-17T02:02:42.743259] [DEBUG] [LOCAL ] APLE: Primary data saved (52087 records). [2025-09-17T02:02:42.743451] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-17T02:02:42.743607] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APLE took 35.5s. Estimated remaining: 5h 17m 45s. Rate: 7.0 symbols/min [2025-09-17T02:02:42.872196] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T02:02:42.924400] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:42.963524] [DEBUG] [LOCAL ] APTV: Loaded 38716 existing records from primary storage. [2025-09-17T02:02:42.963705] [INFO ] [MAIN ] APTV: Loaded 38716 existing records. [2025-09-17T02:02:43.103011] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-17T02:02:43.143451] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:43.143675] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-17T02:02:43.143739] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-17T02:02:43.145373] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-17T02:02:43.145451] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-17T02:02:43.512787] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:43.548124] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T02:02:43.821829] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T02:02:43.890145] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-17T02:02:44.690138] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-11. [2025-09-17T02:02:45.490142] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-17T02:02:45.759563] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T02:02:46.118577] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:02:46.121042] [INFO ] [REMOTE ] APOS: Full fetch complete (10425 records). [2025-09-17T02:02:46.121204] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-17T02:02:46.298509] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-17T02:02:46.601075] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:02:46.727601] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-17T02:02:46.727795] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-17T02:02:46.728348] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-17T02:02:46.728441] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-17T02:02:46.729535] [DEBUG] [LOCAL ] APOS: Trimmed 10425 records to 7511 (keeping 200 days of data) [2025-09-17T02:02:46.807320] [DEBUG] [LOCAL ] APOS: Primary data saved (7511 records). [2025-09-17T02:02:46.810629] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-17T02:02:46.812925] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APOS took 23.7s. Estimated remaining: 5h 16m 21s. Rate: 7.1 symbols/min [2025-09-17T02:02:47.089439] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:47.090155] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-17T02:02:47.145890] [DEBUG] [LOCAL ] AQN: Loaded 38517 existing records from primary storage. [2025-09-17T02:02:47.146095] [INFO ] [MAIN ] AQN: Loaded 38517 existing records. [2025-09-17T02:02:47.337154] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:47.337441] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-17T02:02:47.337521] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-17T02:02:47.338985] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-17T02:02:47.339080] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-17T02:02:47.720499] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:47.890146] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-17T02:02:48.406156] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T02:02:48.690131] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-17T02:02:48.860313] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T02:02:49.490112] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-11. [2025-09-17T02:02:49.824293] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T02:02:49.833690] [INFO ] [REMOTE ] APH: Full fetch complete (77519 records). [2025-09-17T02:02:49.833901] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-17T02:02:50.238324] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-17T02:02:50.238527] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-17T02:02:50.239409] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-17T02:02:50.239589] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-17T02:02:50.241444] [DEBUG] [LOCAL ] APH: Trimmed 77519 records to 53691 (keeping 200 days of data) [2025-09-17T02:02:50.316322] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-17T02:02:50.373253] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T02:02:50.638614] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-17T02:02:50.638812] [INFO ] [MAIN ] APH: Full history saved. [2025-09-17T02:02:50.638932] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APH took 44.9s. Estimated remaining: 5h 14m 54s. Rate: 7.1 symbols/min [2025-09-17T02:02:50.809920] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:50.815834] [DEBUG] [LOCAL ] AQNB: Loaded 2917 existing records from primary storage. [2025-09-17T02:02:50.815989] [INFO ] [MAIN ] AQNB: Loaded 2917 existing records. [2025-09-17T02:02:50.994251] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:50.994526] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-17T02:02:50.994620] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-17T02:02:50.995052] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-17T02:02:50.995124] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-17T02:02:51.095252] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-17T02:02:51.360133] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:51.389673] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T02:02:51.890137] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-11. [2025-09-17T02:02:52.003227] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T02:02:52.230913] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T02:02:52.381777] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T02:02:52.391692] [INFO ] [REMOTE ] APO: Full fetch complete (77122 records). [2025-09-17T02:02:52.391912] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-17T02:02:52.695257] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-17T02:02:52.831608] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-17T02:02:52.831754] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-17T02:02:52.832592] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-17T02:02:52.832697] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-17T02:02:52.834416] [DEBUG] [LOCAL ] APO: Trimmed 77122 records to 53385 (keeping 200 days of data) [2025-09-17T02:02:53.192365] [DEBUG] [LOCAL ] APO: Primary data saved (53385 records). [2025-09-17T02:02:53.192544] [INFO ] [MAIN ] APO: Full history saved. [2025-09-17T02:02:53.197776] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 39.3s. Estimated remaining: 5h 13m 7s. Rate: 7.1 symbols/min [2025-09-17T02:02:53.366406] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:53.411407] [DEBUG] [LOCAL ] AR: Loaded 39952 existing records from primary storage. [2025-09-17T02:02:53.411632] [INFO ] [MAIN ] AR: Loaded 39952 existing records. [2025-09-17T02:02:53.495233] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-17T02:02:53.604962] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:53.605253] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-17T02:02:53.605312] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-17T02:02:53.606932] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-17T02:02:53.607005] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-17T02:02:53.976551] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:54.264203] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:02:54.290092] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-17T02:02:54.424134] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:02:54.618290] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T02:02:55.090157] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-17T02:02:55.890139] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-17T02:02:56.352422] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:02:56.495890] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:02:56.690132] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-11. [2025-09-17T02:02:57.490133] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-17T02:02:57.835424] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T02:02:58.290143] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-17T02:02:58.418241] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:02:59.090165] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-17T02:02:59.890141] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-17T02:03:00.078821] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:03:00.349316] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:03:00.690162] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-17T02:03:01.490121] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-17T02:03:01.638364] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T02:03:02.290176] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-17T02:03:02.880469] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T02:03:03.090142] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-17T02:03:03.890132] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-17T02:03:04.655407] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (3.17 seconds). [2025-09-17T02:03:04.678384] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T02:03:04.690072] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-17T02:03:05.490178] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-17T02:03:05.591908] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T02:03:06.290117] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-17T02:03:06.425851] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-17T02:03:06.644443] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (3.55 seconds). [2025-09-17T02:03:06.778375] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:03:06.910005] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:03:07.090179] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-17T02:03:07.890140] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-17T02:03:08.690159] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-17T02:03:08.776893] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:03:09.281433] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T02:03:09.342583] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:03:09.490131] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-17T02:03:10.290131] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-17T02:03:11.042171] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:03:11.090120] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-17T02:03:11.769809] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:03:11.890133] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-17T02:03:12.421107] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T02:03:12.690125] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-17T02:03:12.756673] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T02:03:13.030665] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T02:03:13.031933] [INFO ] [REMOTE ] AQNB: Full fetch complete (5972 records). [2025-09-17T02:03:13.032034] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-17T02:03:13.410949] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-17T02:03:13.411122] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-17T02:03:13.411454] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-17T02:03:13.411530] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-17T02:03:13.412100] [DEBUG] [LOCAL ] AQNB: Trimmed 5972 records to 4213 (keeping 200 days of data) [2025-09-17T02:03:13.441923] [DEBUG] [LOCAL ] AQNB: Primary data saved (4213 records). [2025-09-17T02:03:13.442174] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-17T02:03:13.442302] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. AQNB took 22.8s. Estimated remaining: 5h 16m 15s. Rate: 7.1 symbols/min [2025-09-17T02:03:13.499691] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-17T02:03:13.620570] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:13.652289] [DEBUG] [LOCAL ] ARCO: Loaded 33170 existing records from primary storage. [2025-09-17T02:03:13.652483] [INFO ] [MAIN ] ARCO: Loaded 33170 existing records. [2025-09-17T02:03:13.827847] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:13.828127] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-17T02:03:13.828194] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-17T02:03:13.829163] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-17T02:03:13.829232] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-17T02:03:14.179225] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:14.290145] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-17T02:03:15.090179] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-17T02:03:15.492129] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T02:03:15.890152] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-11. [2025-09-17T02:03:16.139529] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T02:03:16.690153] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-17T02:03:16.736912] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:03:16.744189] [INFO ] [REMOTE ] APTV: Full fetch complete (75954 records). [2025-09-17T02:03:16.744337] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-17T02:03:17.151789] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-17T02:03:17.151893] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-17T02:03:17.152631] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-17T02:03:17.152708] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-17T02:03:17.154167] [DEBUG] [LOCAL ] APTV: Trimmed 75954 records to 52269 (keeping 200 days of data) [2025-09-17T02:03:17.406317] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:03:17.492716] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-17T02:03:17.501905] [DEBUG] [LOCAL ] APTV: Primary data saved (52269 records). [2025-09-17T02:03:17.502087] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-17T02:03:17.502197] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. APTV took 34.8s. Estimated remaining: 5h 14m 53s. Rate: 7.1 symbols/min [2025-09-17T02:03:17.670326] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:17.682131] [DEBUG] [LOCAL ] ARDC: Loaded 10395 existing records from primary storage. [2025-09-17T02:03:17.682278] [INFO ] [MAIN ] ARDC: Loaded 10395 existing records. [2025-09-17T02:03:17.859665] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:17.859927] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-17T02:03:17.859992] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-17T02:03:17.860628] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-17T02:03:17.860712] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-17T02:03:18.219967] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:18.249768] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:03:18.290086] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-11. [2025-09-17T02:03:18.873553] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:03:19.090174] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-17T02:03:19.152714] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T02:03:19.890131] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-17T02:03:20.690169] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-17T02:03:21.464575] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-17T02:03:21.490086] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-17T02:03:21.559826] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:03:21.780520] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T02:03:22.290130] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-17T02:03:22.790035] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T02:03:23.090115] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-17T02:03:23.890136] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-17T02:03:24.067529] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T02:03:24.690126] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-17T02:03:24.856902] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:03:25.412446] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T02:03:25.490304] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T02:03:25.490470] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-17T02:03:26.290129] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-17T02:03:26.921443] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T02:03:26.928387] [INFO ] [REMOTE ] AQN: Full fetch complete (75081 records). [2025-09-17T02:03:26.928568] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-17T02:03:27.090928] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-17T02:03:27.265891] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T02:03:27.356230] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-17T02:03:27.356348] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-17T02:03:27.357183] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-17T02:03:27.357257] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-17T02:03:27.359138] [DEBUG] [LOCAL ] AQN: Trimmed 75081 records to 51986 (keeping 200 days of data) [2025-09-17T02:03:27.665692] [DEBUG] [LOCAL ] AQN: Primary data saved (51986 records). [2025-09-17T02:03:27.665854] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-17T02:03:27.665949] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQN took 40.9s. Estimated remaining: 5h 15m 13s. Rate: 7.1 symbols/min [2025-09-17T02:03:27.837992] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:27.857788] [DEBUG] [LOCAL ] ARDT: Loaded 20016 existing records from primary storage. [2025-09-17T02:03:27.857930] [INFO ] [MAIN ] ARDT: Loaded 20016 existing records. [2025-09-17T02:03:27.900037] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-17T02:03:28.037488] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:28.037739] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-17T02:03:28.037798] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-17T02:03:28.038538] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-17T02:03:28.038598] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-17T02:03:28.396184] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:28.690187] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-17T02:03:28.735844] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:03:29.490143] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-17T02:03:29.763353] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T02:03:29.789506] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:03:30.290131] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-11. [2025-09-17T02:03:31.059337] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:03:31.090106] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-17T02:03:31.246916] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:03:31.890139] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-17T02:03:32.653668] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:03:32.690086] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-17T02:03:33.490096] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-17T02:03:33.609962] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T02:03:33.862702] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:03:34.290100] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-17T02:03:34.314705] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:03:35.090125] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-17T02:03:35.111077] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T02:03:35.890133] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-17T02:03:36.351032] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T02:03:36.690154] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-17T02:03:36.916135] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T02:03:37.490125] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-17T02:03:37.960805] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T02:03:38.295497] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-17T02:03:38.298156] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T02:03:39.090203] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-17T02:03:39.890278] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-17T02:03:40.271770] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T02:03:40.619012] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:03:40.690097] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-17T02:03:40.773267] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T02:03:41.490152] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-17T02:03:42.147502] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T02:03:42.290125] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-17T02:03:42.367917] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:03:42.370231] [INFO ] [REMOTE ] ARDC: Full fetch complete (20227 records). [2025-09-17T02:03:42.370353] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-17T02:03:42.740273] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-17T02:03:42.740379] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-17T02:03:42.740718] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-17T02:03:42.740773] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-17T02:03:42.741381] [DEBUG] [LOCAL ] ARDC: Trimmed 20227 records to 14850 (keeping 200 days of data) [2025-09-17T02:03:42.833526] [DEBUG] [LOCAL ] ARDC: Primary data saved (14850 records). [2025-09-17T02:03:42.833717] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-17T02:03:42.833809] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. ARDC took 25.3s. Estimated remaining: 5h 16m 52s. Rate: 7.0 symbols/min [2025-09-17T02:03:43.008471] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:43.047125] [DEBUG] [LOCAL ] ARE: Loaded 37881 existing records from primary storage. [2025-09-17T02:03:43.047298] [INFO ] [MAIN ] ARE: Loaded 37881 existing records. [2025-09-17T02:03:43.095258] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-17T02:03:43.238098] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:43.238386] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-17T02:03:43.238460] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-17T02:03:43.240016] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-17T02:03:43.240091] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-17T02:03:43.615880] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:43.890137] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-11. [2025-09-17T02:03:43.989116] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T02:03:43.997139] [INFO ] [REMOTE ] AR: Full fetch complete (77353 records). [2025-09-17T02:03:43.997320] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-17T02:03:44.397351] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-17T02:03:44.397473] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-17T02:03:44.398287] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-17T02:03:44.398348] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-17T02:03:44.399943] [DEBUG] [LOCAL ] AR: Trimmed 77353 records to 53586 (keeping 200 days of data) [2025-09-17T02:03:44.693700] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-17T02:03:44.723119] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:03:44.749729] [DEBUG] [LOCAL ] AR: Primary data saved (53586 records). [2025-09-17T02:03:44.750520] [INFO ] [MAIN ] AR: Full history saved. [2025-09-17T02:03:44.751872] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. AR took 51.6s. Estimated remaining: 5h 14m 58s. Rate: 7.1 symbols/min [2025-09-17T02:03:44.921406] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:44.961111] [DEBUG] [LOCAL ] ARES: Loaded 36531 existing records from primary storage. [2025-09-17T02:03:44.961281] [INFO ] [MAIN ] ARES: Loaded 36531 existing records. [2025-09-17T02:03:45.145072] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:45.145406] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-17T02:03:45.145469] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-17T02:03:45.147013] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-17T02:03:45.147078] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-17T02:03:45.495058] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-17T02:03:45.499718] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:45.594004] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:03:46.290128] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-17T02:03:46.356078] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:03:46.431942] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T02:03:47.090132] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-17T02:03:47.890097] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-11. [2025-09-17T02:03:48.065847] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:03:48.268145] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:03:48.690155] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-17T02:03:49.490140] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-17T02:03:49.559576] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T02:03:49.632675] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T02:03:50.290134] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-17T02:03:50.644902] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T02:03:50.650258] [INFO ] [REMOTE ] ARCO: Full fetch complete (65819 records). [2025-09-17T02:03:50.650404] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-17T02:03:51.029944] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-17T02:03:51.030055] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-17T02:03:51.030780] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-17T02:03:51.030864] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-17T02:03:51.032202] [DEBUG] [LOCAL ] ARCO: Trimmed 65819 records to 44788 (keeping 200 days of data) [2025-09-17T02:03:51.091842] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-17T02:03:51.293491] [DEBUG] [LOCAL ] ARCO: Primary data saved (44788 records). [2025-09-17T02:03:51.293680] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-17T02:03:51.293832] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. ARCO took 37.9s. Estimated remaining: 5h 14m 19s. Rate: 7.1 symbols/min [2025-09-17T02:03:51.464563] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:51.496236] [DEBUG] [LOCAL ] ARI: Loaded 32069 existing records from primary storage. [2025-09-17T02:03:51.496415] [INFO ] [MAIN ] ARI: Loaded 32069 existing records. [2025-09-17T02:03:51.674722] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:51.675001] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-17T02:03:51.675074] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-17T02:03:51.676286] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-17T02:03:51.676368] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-17T02:03:51.912266] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-17T02:03:52.043802] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:03:52.062559] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:52.690131] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-11. [2025-09-17T02:03:52.750223] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T02:03:53.490105] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-17T02:03:53.780581] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:03:54.061985] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:03:54.290184] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-17T02:03:55.090097] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-17T02:03:55.180493] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T02:03:55.879716] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T02:03:55.890064] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-17T02:03:55.988445] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T02:03:56.690131] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-17T02:03:57.150141] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T02:03:57.490096] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-17T02:03:57.811511] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T02:03:57.815365] [INFO ] [REMOTE ] ARDT: Full fetch complete (40949 records). [2025-09-17T02:03:57.815612] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-17T02:03:58.205200] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-17T02:03:58.205327] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-17T02:03:58.205957] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-17T02:03:58.206042] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-17T02:03:58.207440] [DEBUG] [LOCAL ] ARDT: Trimmed 40949 records to 28796 (keeping 200 days of data) [2025-09-17T02:03:58.291928] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-17T02:03:58.381256] [DEBUG] [LOCAL ] ARDT: Primary data saved (28796 records). [2025-09-17T02:03:58.381437] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-17T02:03:58.381559] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARDT took 30.7s. Estimated remaining: 5h 13m 48s. Rate: 7.1 symbols/min [2025-09-17T02:03:58.557054] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:58.557283] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-09-17T02:03:58.557333] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-09-17T02:03:58.557449] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-17T02:03:58.557503] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-17T02:03:58.557570] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-17T02:03:58.557616] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-17T02:03:58.962821] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:58.990397] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:03:59.090101] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-11. [2025-09-17T02:03:59.890170] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-17T02:04:00.078527] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:04:00.542677] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T02:04:00.690149] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-17T02:04:01.490124] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-17T02:04:01.597107] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:04:02.036213] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T02:04:02.290144] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-17T02:04:03.090117] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-17T02:04:03.265952] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:04:03.890153] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-17T02:04:04.211555] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:04:04.412205] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T02:04:04.690158] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-17T02:04:05.490144] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-17T02:04:05.708453] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:04:05.863051] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T02:04:06.290128] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-17T02:04:07.090137] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-17T02:04:07.126367] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:04:07.881204] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T02:04:07.890264] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-17T02:04:08.690152] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-17T02:04:08.846152] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T02:04:09.142883] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T02:04:09.490153] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-17T02:04:10.290159] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-17T02:04:10.509047] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:04:11.090273] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-17T02:04:11.093699] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:04:11.564360] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T02:04:11.890136] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-17T02:04:12.690126] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-17T02:04:12.760591] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T02:04:13.213385] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T02:04:13.490130] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-17T02:04:14.268820] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T02:04:14.290081] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-17T02:04:15.090134] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-17T02:04:15.328550] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:04:15.629962] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T02:04:15.890156] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-17T02:04:16.503740] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:04:16.690133] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-17T02:04:17.341441] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:04:17.490159] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-17T02:04:17.950202] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T02:04:18.290156] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-17T02:04:18.738085] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:04:19.090139] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-17T02:04:19.876206] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:04:19.883099] [INFO ] [REMOTE ] ARES: Full fetch complete (70335 records). [2025-09-17T02:04:19.883285] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-17T02:04:19.895923] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-17T02:04:20.297755] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-17T02:04:20.297874] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-17T02:04:20.298583] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-17T02:04:20.298664] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-17T02:04:20.300361] [DEBUG] [LOCAL ] ARES: Trimmed 70335 records to 49727 (keeping 200 days of data) [2025-09-17T02:04:20.620558] [DEBUG] [LOCAL ] ARES: Primary data saved (49727 records). [2025-09-17T02:04:20.620753] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-17T02:04:20.621891] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARES took 35.9s. Estimated remaining: 5h 17m 16s. Rate: 7.0 symbols/min [2025-09-17T02:04:20.700572] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-17T02:04:20.812065] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:20.850305] [DEBUG] [LOCAL ] ARLO: Loaded 32647 existing records from primary storage. [2025-09-17T02:04:20.850493] [INFO ] [MAIN ] ARLO: Loaded 32647 existing records. [2025-09-17T02:04:21.038139] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:21.038526] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-17T02:04:21.038606] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-17T02:04:21.049214] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-17T02:04:21.067060] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-17T02:04:21.148898] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T02:04:21.442777] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:21.490169] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-11. [2025-09-17T02:04:21.560616] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:04:21.685780] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T02:04:21.690773] [INFO ] [REMOTE ] ARI: Full fetch complete (62475 records). [2025-09-17T02:04:21.690900] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-17T02:04:22.088109] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-17T02:04:22.088236] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-17T02:04:22.089057] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-17T02:04:22.089127] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-17T02:04:22.090499] [DEBUG] [LOCAL ] ARI: Trimmed 62475 records to 43268 (keeping 200 days of data) [2025-09-17T02:04:22.300052] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-17T02:04:22.353511] [DEBUG] [LOCAL ] ARI: Primary data saved (43268 records). [2025-09-17T02:04:22.353691] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-17T02:04:22.353808] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARI took 31.1s. Estimated remaining: 5h 15m 22s. Rate: 7.1 symbols/min [2025-09-17T02:04:22.524346] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:22.560424] [DEBUG] [LOCAL ] ARMK: Loaded 37405 existing records from primary storage. [2025-09-17T02:04:22.560607] [INFO ] [MAIN ] ARMK: Loaded 37405 existing records. [2025-09-17T02:04:22.744879] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:22.745217] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-17T02:04:22.745296] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-17T02:04:22.746890] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-17T02:04:22.746971] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-17T02:04:23.109662] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:23.109857] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-17T02:04:23.139602] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:04:23.890151] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-11. [2025-09-17T02:04:24.039485] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T02:04:24.483355] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T02:04:24.690170] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-17T02:04:25.281164] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T02:04:25.490146] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-17T02:04:26.064295] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T02:04:26.290165] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-17T02:04:27.052888] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T02:04:27.058865] [INFO ] [REMOTE ] ARE: Full fetch complete (72548 records). [2025-09-17T02:04:27.059044] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-17T02:04:27.095186] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-17T02:04:27.463287] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-17T02:04:27.463403] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-17T02:04:27.464137] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-17T02:04:27.464194] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-17T02:04:27.465655] [DEBUG] [LOCAL ] ARE: Trimmed 72548 records to 50602 (keeping 200 days of data) [2025-09-17T02:04:27.803012] [DEBUG] [LOCAL ] ARE: Primary data saved (50602 records). [2025-09-17T02:04:27.804365] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T02:04:27.812721] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-17T02:04:27.813303] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARE took 45.0s. Estimated remaining: 5h 14m 26s. Rate: 7.1 symbols/min [2025-09-17T02:04:27.895218] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-17T02:04:27.991996] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:28.026939] [DEBUG] [LOCAL ] AROC: Loaded 36147 existing records from primary storage. [2025-09-17T02:04:28.027118] [INFO ] [MAIN ] AROC: Loaded 36147 existing records. [2025-09-17T02:04:28.208097] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:28.208368] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-17T02:04:28.208426] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-17T02:04:28.209717] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-17T02:04:28.209784] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-17T02:04:28.574099] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:28.690106] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-11. [2025-09-17T02:04:28.785468] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T02:04:29.150561] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:04:29.490167] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-17T02:04:30.302359] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-17T02:04:30.308398] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:04:30.918012] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:04:31.090188] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-17T02:04:31.675302] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T02:04:31.687826] [INFO ] [REMOTE ] ARIS: Full fetch complete (59258 records). [2025-09-17T02:04:31.688104] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-17T02:04:31.909158] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-17T02:04:32.253092] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-17T02:04:32.253267] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-17T02:04:32.254054] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-17T02:04:32.254128] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-17T02:04:32.255953] [DEBUG] [LOCAL ] ARIS: Trimmed 59258 records to 42003 (keeping 200 days of data) [2025-09-17T02:04:32.545089] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:04:32.597301] [DEBUG] [LOCAL ] ARIS: Primary data saved (42003 records). [2025-09-17T02:04:32.597497] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-17T02:04:32.597619] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARIS took 34.2s. Estimated remaining: 5h 13m 21s. Rate: 7.1 symbols/min [2025-09-17T02:04:32.695388] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-17T02:04:32.779519] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:32.821007] [DEBUG] [LOCAL ] ARR: Loaded 38691 existing records from primary storage. [2025-09-17T02:04:32.821209] [INFO ] [MAIN ] ARR: Loaded 38691 existing records. [2025-09-17T02:04:33.001832] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:33.002126] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-17T02:04:33.002186] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-17T02:04:33.003926] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-17T02:04:33.003997] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-17T02:04:33.369285] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:33.490128] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-11. [2025-09-17T02:04:33.597322] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:04:34.101430] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:04:34.290150] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-17T02:04:35.090202] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-17T02:04:35.156484] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T02:04:35.838781] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T02:04:35.890099] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-17T02:04:36.690163] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-17T02:04:36.725713] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:04:37.183527] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T02:04:37.490127] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-17T02:04:38.290183] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-17T02:04:38.343285] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:04:38.958849] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:04:39.090148] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-17T02:04:39.892622] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-17T02:04:39.898002] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T02:04:40.437478] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:04:40.690129] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-17T02:04:41.490128] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-17T02:04:41.593454] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T02:04:42.290198] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-17T02:04:42.602373] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T02:04:42.824606] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T02:04:43.090136] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-17T02:04:43.890203] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-17T02:04:43.973044] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T02:04:44.690139] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-17T02:04:44.786270] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T02:04:45.490167] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-17T02:04:45.831179] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T02:04:46.131312] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:04:46.290168] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-17T02:04:46.893753] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T02:04:47.090156] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-17T02:04:47.349007] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:04:47.354620] [INFO ] [REMOTE ] ARLO: Full fetch complete (62356 records). [2025-09-17T02:04:47.354757] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-17T02:04:47.738420] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-17T02:04:47.738539] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-17T02:04:47.739167] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-17T02:04:47.739253] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-17T02:04:47.741889] [DEBUG] [LOCAL ] ARLO: Trimmed 62356 records to 44220 (keeping 200 days of data) [2025-09-17T02:04:47.909054] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-17T02:04:47.999307] [DEBUG] [LOCAL ] ARLO: Primary data saved (44220 records). [2025-09-17T02:04:47.999447] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-17T02:04:47.999558] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARLO took 27.4s. Estimated remaining: 5h 14m 58s. Rate: 7.1 symbols/min [2025-09-17T02:04:48.166746] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:48.190203] [DEBUG] [LOCAL ] ARW: Loaded 23944 existing records from primary storage. [2025-09-17T02:04:48.190348] [INFO ] [MAIN ] ARW: Loaded 23944 existing records. [2025-09-17T02:04:48.370856] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:48.371070] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-17T02:04:48.371120] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-17T02:04:48.372006] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-17T02:04:48.372074] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-17T02:04:48.697936] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-17T02:04:48.725706] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:48.759107] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:04:49.490342] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-11. [2025-09-17T02:04:49.542119] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:04:50.290183] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-17T02:04:50.456946] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T02:04:50.893407] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T02:04:51.090142] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-17T02:04:51.706962] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T02:04:51.890095] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-17T02:04:52.572215] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T02:04:52.690126] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-17T02:04:53.490093] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-17T02:04:53.908215] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T02:04:53.982352] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:04:54.290133] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-17T02:04:55.090117] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-17T02:04:55.126552] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T02:04:55.451959] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T02:04:55.459379] [INFO ] [REMOTE ] ARMK: Full fetch complete (72361 records). [2025-09-17T02:04:55.459591] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-17T02:04:55.857029] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-17T02:04:55.857158] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-17T02:04:55.857894] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-17T02:04:55.857978] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-17T02:04:55.859430] [DEBUG] [LOCAL ] ARMK: Trimmed 72361 records to 50341 (keeping 200 days of data) [2025-09-17T02:04:55.923030] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-17T02:04:56.178313] [DEBUG] [LOCAL ] ARMK: Primary data saved (50341 records). [2025-09-17T02:04:56.178483] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-17T02:04:56.178586] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. ARMK took 33.8s. Estimated remaining: 5h 14m 45s. Rate: 7.1 symbols/min [2025-09-17T02:04:56.354973] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:56.355228] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-17T02:04:56.355275] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-17T02:04:56.355393] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-17T02:04:56.355457] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-17T02:04:56.355511] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-17T02:04:56.355568] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-17T02:04:56.695175] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-17T02:04:56.759426] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:57.091808] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T02:04:57.490138] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-11. [2025-09-17T02:04:57.668030] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:04:57.712997] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:04:57.714261] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:04:57.714495] [WARN ] [REMOTE ] ARX: No data returned for month 2024-11 [2025-09-17T02:04:58.290144] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-17T02:04:59.090182] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-17T02:04:59.890163] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-17T02:04:59.943531] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T02:05:00.097326] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:00.097711] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-17T02:05:00.690143] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-17T02:05:00.792748] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T02:05:01.490175] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-17T02:05:02.290175] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-17T02:05:02.779288] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T02:05:02.943761] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T02:05:03.090152] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-17T02:05:03.487037] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T02:05:03.493023] [INFO ] [REMOTE ] AROC: Full fetch complete (70303 records). [2025-09-17T02:05:03.493171] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-17T02:05:03.881682] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-17T02:05:03.881790] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-17T02:05:03.882456] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-17T02:05:03.882512] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-17T02:05:03.883866] [DEBUG] [LOCAL ] AROC: Trimmed 70303 records to 49022 (keeping 200 days of data) [2025-09-17T02:05:03.943807] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-17T02:05:04.188405] [DEBUG] [LOCAL ] AROC: Primary data saved (49022 records). [2025-09-17T02:05:04.188567] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-17T02:05:04.188675] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. AROC took 36.4s. Estimated remaining: 5h 14m 29s. Rate: 7.1 symbols/min [2025-09-17T02:05:04.233334] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:04.282172] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-17T02:05:04.370123] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:04.370279] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-17T02:05:04.370326] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-17T02:05:04.370433] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-17T02:05:04.370484] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-17T02:05:04.370527] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-17T02:05:04.370563] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-17T02:05:04.698144] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-17T02:05:04.738437] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:05.028510] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:05:05.490129] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-17T02:05:06.117595] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:05:06.290147] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-17T02:05:06.961202] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T02:05:06.967671] [INFO ] [REMOTE ] ARR: Full fetch complete (74853 records). [2025-09-17T02:05:06.967823] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-17T02:05:07.098187] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-11. [2025-09-17T02:05:07.380659] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-17T02:05:07.380781] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-17T02:05:07.381581] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-17T02:05:07.381667] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-17T02:05:07.384926] [DEBUG] [LOCAL ] ARR: Trimmed 74853 records to 52034 (keeping 200 days of data) [2025-09-17T02:05:07.736504] [DEBUG] [LOCAL ] ARR: Primary data saved (52034 records). [2025-09-17T02:05:07.737880] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:05:07.737984] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-17T02:05:07.738284] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. ARR took 35.1s. Estimated remaining: 5h 13m 7s. Rate: 7.1 symbols/min [2025-09-17T02:05:07.895490] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-17T02:05:07.925274] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:07.937946] [DEBUG] [LOCAL ] ASA: Loaded 10444 existing records from primary storage. [2025-09-17T02:05:07.938100] [INFO ] [MAIN ] ASA: Loaded 10444 existing records. [2025-09-17T02:05:08.113343] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:08.113629] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-17T02:05:08.113713] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-17T02:05:08.114322] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-17T02:05:08.114404] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-17T02:05:08.145756] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:08.194743] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-17T02:05:08.481240] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:08.690145] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-17T02:05:08.937703] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T02:05:09.490180] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-11. [2025-09-17T02:05:09.926498] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T02:05:10.287668] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:05:10.290709] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-17T02:05:10.893217] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T02:05:11.090145] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-17T02:05:11.302416] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:11.302882] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-17T02:05:11.890186] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-17T02:05:12.690180] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-17T02:05:12.756248] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T02:05:13.490141] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-17T02:05:13.722173] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:13.722535] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-17T02:05:14.290106] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-17T02:05:14.409248] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T02:05:14.498914] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:14.499260] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-17T02:05:15.090135] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-17T02:05:15.890136] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-17T02:05:16.109083] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:16.109433] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-17T02:05:16.690136] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-17T02:05:16.920252] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:05:17.490174] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-17T02:05:18.035350] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T02:05:18.290137] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-17T02:05:19.090103] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-17T02:05:19.264601] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:05:19.331678] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T02:05:19.890195] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-17T02:05:19.990421] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T02:05:20.690184] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-17T02:05:20.957357] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T02:05:21.225697] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T02:05:21.490204] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-17T02:05:22.290199] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-17T02:05:22.484326] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T02:05:23.090173] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-17T02:05:23.221968] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T02:05:23.890192] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-17T02:05:24.440601] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T02:05:24.459805] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T02:05:24.690151] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-17T02:05:25.490174] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-17T02:05:26.209225] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T02:05:26.290075] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-17T02:05:26.667025] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T02:05:26.672055] [INFO ] [REMOTE ] ARW: Full fetch complete (47376 records). [2025-09-17T02:05:26.672213] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-17T02:05:27.047250] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-17T02:05:27.047354] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-17T02:05:27.047892] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-17T02:05:27.047950] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-17T02:05:27.048968] [DEBUG] [LOCAL ] ARW: Trimmed 47376 records to 33077 (keeping 200 days of data) [2025-09-17T02:05:27.107624] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-17T02:05:27.262476] [DEBUG] [LOCAL ] ARW: Primary data saved (33077 records). [2025-09-17T02:05:27.262704] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-17T02:05:27.262824] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARW took 39.3s. Estimated remaining: 5h 15m 42s. Rate: 7.0 symbols/min [2025-09-17T02:05:27.434664] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:27.434912] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-09-17T02:05:27.434961] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-09-17T02:05:27.435067] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-17T02:05:27.435117] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-17T02:05:27.435168] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-17T02:05:27.435208] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-17T02:05:27.813181] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T02:05:27.812456] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:27.836132] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T02:05:27.841326] [INFO ] [REMOTE ] ARX: Full fetch complete (12016 records). [2025-09-17T02:05:27.841419] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-17T02:05:27.895231] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-17T02:05:28.024363] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-17T02:05:28.024662] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:05:28.024716] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:05:28.024762] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-17T02:05:28.024832] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-17T02:05:28.024878] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-17T02:05:28.024945] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-17T02:05:28.025010] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. ARX took 31.8s. Estimated remaining: 5h 13m 39s. Rate: 7.1 symbols/min [2025-09-17T02:05:28.190693] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:28.228536] [DEBUG] [LOCAL ] ASB: Loaded 36535 existing records from primary storage. [2025-09-17T02:05:28.228725] [INFO ] [MAIN ] ASB: Loaded 36535 existing records. [2025-09-17T02:05:28.403496] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:28.403832] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-17T02:05:28.403894] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-17T02:05:28.405413] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-17T02:05:28.405477] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-17T02:05:28.695238] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-11. [2025-09-17T02:05:28.765176] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:29.490128] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-17T02:05:29.761613] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T02:05:29.982191] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T02:05:30.290141] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-11. [2025-09-17T02:05:30.446111] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T02:05:31.090194] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-17T02:05:31.890113] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-17T02:05:31.991827] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:05:32.690133] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-17T02:05:33.067116] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T02:05:33.345677] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T02:05:33.490087] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-17T02:05:33.993757] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T02:05:34.290137] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-17T02:05:35.090182] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-17T02:05:35.283227] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T02:05:35.870598] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T02:05:35.890081] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-17T02:05:36.690144] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-17T02:05:36.744919] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:05:37.490134] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-17T02:05:37.610939] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:05:37.732285] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T02:05:38.290145] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-17T02:05:38.937166] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:05:38.954225] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T02:05:38.957864] [INFO ] [REMOTE ] ASA: Full fetch complete (18146 records). [2025-09-17T02:05:38.957973] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-17T02:05:39.095205] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-17T02:05:39.330771] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-17T02:05:39.330872] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-17T02:05:39.331158] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-17T02:05:39.331207] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-17T02:05:39.331803] [DEBUG] [LOCAL ] ASA: Trimmed 18146 records to 13358 (keeping 200 days of data) [2025-09-17T02:05:39.410560] [DEBUG] [LOCAL ] ASA: Primary data saved (13358 records). [2025-09-17T02:05:39.410745] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-17T02:05:39.410837] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. ASA took 31.7s. Estimated remaining: 5h 14m 13s. Rate: 7.1 symbols/min [2025-09-17T02:05:39.579441] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:39.583888] [DEBUG] [LOCAL ] ASBA: Loaded 2522 existing records from primary storage. [2025-09-17T02:05:39.583986] [INFO ] [MAIN ] ASBA: Loaded 2522 existing records. [2025-09-17T02:05:39.765076] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:39.765402] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-17T02:05:39.765486] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-17T02:05:39.765838] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-17T02:05:39.765924] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-17T02:05:39.895251] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-17T02:05:40.128019] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:40.690140] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-11. [2025-09-17T02:05:40.767017] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T02:05:41.261473] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T02:05:41.490182] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-17T02:05:41.815729] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:05:42.290194] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-17T02:05:43.090215] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-17T02:05:43.317598] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:05:43.890155] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-17T02:05:44.044183] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T02:05:44.690143] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-17T02:05:44.903491] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T02:05:45.261885] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T02:05:45.490097] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-17T02:05:46.107015] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T02:05:46.290136] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-17T02:05:47.090173] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-17T02:05:47.154252] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T02:05:47.450596] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T02:05:47.890129] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-17T02:05:48.081863] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:05:48.690141] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-17T02:05:49.490151] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-17T02:05:49.748962] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T02:05:50.232142] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T02:05:50.264294] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:05:50.290098] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-17T02:05:51.090133] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-17T02:05:51.890145] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-17T02:05:52.302304] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T02:05:52.690184] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-17T02:05:52.862208] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T02:05:52.868737] [INFO ] [REMOTE ] AS: Full fetch complete (76303 records). [2025-09-17T02:05:52.868910] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-17T02:05:53.265478] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-17T02:05:53.265589] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-17T02:05:53.266377] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-17T02:05:53.266443] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-17T02:05:53.271010] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T02:05:53.272935] [DEBUG] [LOCAL ] AS: Trimmed 76303 records to 53067 (keeping 200 days of data) [2025-09-17T02:05:53.490821] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-17T02:05:53.603457] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T02:05:53.634287] [DEBUG] [LOCAL ] AS: Primary data saved (53067 records). [2025-09-17T02:05:53.634482] [INFO ] [MAIN ] AS: Full history saved. [2025-09-17T02:05:53.634572] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. AS took 49.4s. Estimated remaining: 5h 15m 28s. Rate: 7.0 symbols/min [2025-09-17T02:05:53.806867] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:53.835568] [DEBUG] [LOCAL ] ASC: Loaded 27759 existing records from primary storage. [2025-09-17T02:05:53.835785] [INFO ] [MAIN ] ASC: Loaded 27759 existing records. [2025-09-17T02:05:54.015300] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:54.015562] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-17T02:05:54.015624] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-17T02:05:54.016901] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-17T02:05:54.016971] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-17T02:05:54.126892] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T02:05:54.301186] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-17T02:05:54.402700] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:55.090129] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-17T02:05:55.692900] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T02:05:55.890127] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-17T02:05:56.690137] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-17T02:05:56.964789] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:05:57.064234] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T02:05:57.334307] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T02:05:57.340553] [INFO ] [REMOTE ] ASB: Full fetch complete (71434 records). [2025-09-17T02:05:57.340752] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-17T02:05:57.495107] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-17T02:05:57.729844] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-17T02:05:57.730017] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-17T02:05:57.730731] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-17T02:05:57.730792] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-17T02:05:57.732214] [DEBUG] [LOCAL ] ASB: Trimmed 71434 records to 49653 (keeping 200 days of data) [2025-09-17T02:05:58.041106] [DEBUG] [LOCAL ] ASB: Primary data saved (49653 records). [2025-09-17T02:05:58.041271] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-17T02:05:58.041365] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASB took 30.0s. Estimated remaining: 5h 14m 20s. Rate: 7.0 symbols/min [2025-09-17T02:05:58.145301] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T02:05:58.214687] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:58.229495] [DEBUG] [LOCAL ] ASG: Loaded 14378 existing records from primary storage. [2025-09-17T02:05:58.229664] [INFO ] [MAIN ] ASG: Loaded 14378 existing records. [2025-09-17T02:05:58.295203] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-17T02:05:58.406113] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:58.406355] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-17T02:05:58.406414] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-17T02:05:58.407294] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-17T02:05:58.407357] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-17T02:05:58.759050] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:59.090101] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-11. [2025-09-17T02:05:59.890140] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-17T02:06:00.061270] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T02:06:00.067850] [INFO ] [REMOTE ] ASAN: Full fetch complete (76368 records). [2025-09-17T02:06:00.068036] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-17T02:06:00.426236] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T02:06:00.465672] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-17T02:06:00.465782] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-17T02:06:00.466707] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-17T02:06:00.466802] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-17T02:06:00.468422] [DEBUG] [LOCAL ] ASAN: Trimmed 76368 records to 52754 (keeping 200 days of data) [2025-09-17T02:06:00.690232] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-17T02:06:00.796146] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:06:00.820875] [DEBUG] [LOCAL ] ASAN: Primary data saved (52754 records). [2025-09-17T02:06:00.821021] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-17T02:06:00.821102] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASAN took 33.6s. Estimated remaining: 5h 12m 49s. Rate: 7.1 symbols/min [2025-09-17T02:06:00.988929] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:01.006076] [DEBUG] [LOCAL ] ASGI: Loaded 16802 existing records from primary storage. [2025-09-17T02:06:01.006249] [INFO ] [MAIN ] ASGI: Loaded 16802 existing records. [2025-09-17T02:06:01.183884] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:01.184122] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-17T02:06:01.184201] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-17T02:06:01.185382] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-17T02:06:01.185466] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-17T02:06:01.464349] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T02:06:01.492483] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-17T02:06:01.588401] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:02.290138] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-11. [2025-09-17T02:06:03.090145] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-17T02:06:03.890135] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-11. [2025-09-17T02:06:04.360633] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T02:06:04.690115] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-17T02:06:04.759516] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (3.27 seconds). [2025-09-17T02:06:05.057880] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T02:06:05.216244] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T02:06:05.217254] [INFO ] [REMOTE ] ASBA: Full fetch complete (5306 records). [2025-09-17T02:06:05.217338] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-17T02:06:05.495718] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-17T02:06:05.530591] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-11 (3.24 seconds). [2025-09-17T02:06:05.614027] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-17T02:06:05.614139] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-17T02:06:05.614301] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-17T02:06:05.614350] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-17T02:06:05.615098] [DEBUG] [LOCAL ] ASBA: Trimmed 5306 records to 3437 (keeping 200 days of data) [2025-09-17T02:06:05.636268] [DEBUG] [LOCAL ] ASBA: Primary data saved (3437 records). [2025-09-17T02:06:05.636354] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-17T02:06:05.636462] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASBA took 26.2s. Estimated remaining: 5h 11m 49s. Rate: 7.1 symbols/min [2025-09-17T02:06:05.803284] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:05.803494] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-09-17T02:06:05.803561] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-09-17T02:06:05.803735] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-17T02:06:05.803797] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-17T02:06:05.803848] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-17T02:06:05.803889] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-17T02:06:06.156138] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:06.290124] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-17T02:06:07.090168] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-17T02:06:07.155372] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:06:07.455336] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:06:07.890155] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-17T02:06:08.204214] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:06:08.690132] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-11. [2025-09-17T02:06:09.040078] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:06:09.490167] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-17T02:06:10.060505] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:06:10.290137] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-17T02:06:10.636490] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:06:11.090150] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-17T02:06:11.335629] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:06:11.890190] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-17T02:06:12.359192] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T02:06:12.690162] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-17T02:06:13.207147] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T02:06:13.490127] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-17T02:06:13.757504] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T02:06:14.290196] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-17T02:06:14.594374] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:06:15.090156] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-17T02:06:15.890195] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-17T02:06:15.944516] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:06:16.690173] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-17T02:06:16.821812] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T02:06:17.490131] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-17T02:06:17.748867] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T02:06:18.290216] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-17T02:06:18.623371] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T02:06:18.693445] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:06:19.090145] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-17T02:06:19.763837] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:06:19.890209] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-17T02:06:20.700007] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-17T02:06:20.722572] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:06:20.951198] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T02:06:21.490124] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-17T02:06:22.258591] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T02:06:22.290142] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-17T02:06:22.602280] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:06:23.090143] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-17T02:06:23.853954] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:06:23.890093] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-17T02:06:24.028336] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T02:06:24.690147] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-17T02:06:25.134070] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T02:06:25.490139] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-17T02:06:26.228940] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T02:06:26.290118] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-17T02:06:26.500685] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T02:06:27.090156] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-17T02:06:27.742970] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:06:27.888101] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T02:06:27.893179] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-17T02:06:28.690127] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-17T02:06:28.795508] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:06:29.490164] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-17T02:06:29.592859] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:06:29.597831] [INFO ] [REMOTE ] ASC: Full fetch complete (57547 records). [2025-09-17T02:06:29.598023] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-17T02:06:30.000278] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-17T02:06:30.000400] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-17T02:06:30.001085] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-17T02:06:30.001175] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-17T02:06:30.002489] [DEBUG] [LOCAL ] ASC: Trimmed 57547 records to 38179 (keeping 200 days of data) [2025-09-17T02:06:30.237521] [DEBUG] [LOCAL ] ASC: Primary data saved (38179 records). [2025-09-17T02:06:30.237710] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-17T02:06:30.237822] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASC took 36.6s. Estimated remaining: 5h 15m 28s. Rate: 7.0 symbols/min [2025-09-17T02:06:30.290148] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-17T02:06:30.428060] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T02:06:31.090230] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-17T02:06:31.417943] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T02:06:31.890135] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-17T02:06:32.667669] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:06:32.690151] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-17T02:06:32.890995] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:06:32.894534] [INFO ] [REMOTE ] ASGI: Full fetch complete (33069 records). [2025-09-17T02:06:32.894663] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-17T02:06:33.267117] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-17T02:06:33.267223] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-17T02:06:33.267706] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-17T02:06:33.267791] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-17T02:06:33.268907] [DEBUG] [LOCAL ] ASGI: Trimmed 33069 records to 22154 (keeping 200 days of data) [2025-09-17T02:06:33.405311] [DEBUG] [LOCAL ] ASGI: Primary data saved (22154 records). [2025-09-17T02:06:33.405466] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-17T02:06:33.405570] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASGI took 32.6s. Estimated remaining: 5h 14m 4s. Rate: 7.0 symbols/min [2025-09-17T02:06:33.490124] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-17T02:06:34.007224] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T02:06:34.290146] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-17T02:06:34.577453] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T02:06:35.090136] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-17T02:06:35.567930] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T02:06:35.572765] [INFO ] [REMOTE ] ASGN: Full fetch complete (51219 records). [2025-09-17T02:06:35.572969] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-17T02:06:36.188028] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-17T02:06:36.188211] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-17T02:06:36.189461] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-17T02:06:36.189583] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-17T02:06:36.191519] [DEBUG] [LOCAL ] ASGN: Trimmed 51219 records to 36021 (keeping 200 days of data) [2025-09-17T02:06:36.347774] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T02:06:36.359401] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-17T02:06:36.540204] [DEBUG] [LOCAL ] ASGN: Primary data saved (36021 records). [2025-09-17T02:06:36.540427] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-17T02:06:36.540533] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGN took 30.9s. Estimated remaining: 5h 12m 40s. Rate: 7.1 symbols/min [2025-09-17T02:06:37.154891] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T02:06:37.159512] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-17T02:06:38.129363] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:06:38.132326] [INFO ] [REMOTE ] ASG: Full fetch complete (31626 records). [2025-09-17T02:06:38.132441] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-17T02:06:38.531624] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-17T02:06:38.531748] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-17T02:06:38.532182] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-17T02:06:38.532240] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-17T02:06:38.533038] [DEBUG] [LOCAL ] ASG: Trimmed 31626 records to 21145 (keeping 200 days of data) [2025-09-17T02:06:38.659738] [DEBUG] [LOCAL ] ASG: Primary data saved (21145 records). [2025-09-17T02:06:38.659886] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-17T02:06:38.659976] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASG took 40.6s. Estimated remaining: 5h 11m 4s. Rate: 7.1 symbols/min [2025-09-17T02:06:39.207540] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.308869] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.310967] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.353898] [DEBUG] [LOCAL ] ASH: No existing data file found in primary storage. [2025-09-17T02:06:39.354683] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.355106] [WARN ] [MAIN ] ASH: No existing data found, performing full refresh instead. [2025-09-17T02:06:39.355842] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-17T02:06:39.355998] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-17T02:06:39.356067] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-09-17T02:06:39.356141] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-17T02:06:39.475213] [DEBUG] [LOCAL ] ASR: Loaded 7108 existing records from primary storage. [2025-09-17T02:06:39.499329] [INFO ] [MAIN ] ASR: Loaded 7108 existing records. [2025-09-17T02:06:39.634132] [DEBUG] [LOCAL ] ASIX: Loaded 17000 existing records from primary storage. [2025-09-17T02:06:39.698623] [INFO ] [MAIN ] ASIX: Loaded 17000 existing records. [2025-09-17T02:06:39.735230] [DEBUG] [LOCAL ] ASPN: Loaded 36948 existing records from primary storage. [2025-09-17T02:06:39.748048] [INFO ] [MAIN ] ASPN: Loaded 36948 existing records. [2025-09-17T02:06:40.022232] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:40.150991] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:40.167533] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-11. [2025-09-17T02:06:40.151108] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-17T02:06:40.195396] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-17T02:06:40.277664] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-17T02:06:40.284144] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:40.309038] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-17T02:06:40.315360] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:40.351293] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-17T02:06:40.373836] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-17T02:06:40.393567] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-17T02:06:40.403871] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-17T02:06:40.421078] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-17T02:06:40.421624] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-17T02:06:40.427039] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-17T02:06:40.443588] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-17T02:06:41.252884] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:41.350745] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-11. [2025-09-17T02:06:41.373876] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:41.414804] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-11. [2025-09-17T02:06:41.417762] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:41.419486] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-11. [2025-09-17T02:06:41.706103] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:06:41.714013] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-17T02:06:42.133297] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T02:06:42.135200] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-17T02:06:42.405898] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:06:42.409618] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-17T02:06:42.729453] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:06:42.929936] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:06:43.036942] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:06:43.090075] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-17T02:06:43.183319] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T02:06:43.890132] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-17T02:06:44.097789] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:06:44.690137] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-17T02:06:45.464870] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T02:06:45.469742] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T02:06:45.490081] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-17T02:06:46.290132] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-17T02:06:47.090127] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-17T02:06:47.267429] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T02:06:47.305482] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:06:47.890179] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-17T02:06:48.569242] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:06:48.581728] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T02:06:48.690130] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-17T02:06:49.490159] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-17T02:06:50.113128] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:06:50.290135] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-17T02:06:51.090149] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-17T02:06:51.269382] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:06:51.634100] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T02:06:51.890128] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-17T02:06:51.955244] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T02:06:52.690136] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-17T02:06:53.490126] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-17T02:06:53.603250] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:06:54.290181] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-17T02:06:54.349129] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:06:54.405786] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T02:06:55.090134] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-17T02:06:55.890103] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-17T02:06:55.952455] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T02:06:56.078079] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:06:56.690128] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-17T02:06:57.419033] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:06:57.490094] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-17T02:06:57.809409] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:06:58.290125] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-17T02:06:58.995113] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T02:06:59.090129] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-17T02:06:59.419718] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T02:06:59.890126] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-17T02:07:00.084974] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T02:07:00.690131] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-17T02:07:01.396285] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T02:07:01.490172] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-17T02:07:01.576623] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T02:07:02.290182] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-17T02:07:03.043521] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:07:03.090130] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-17T02:07:03.890244] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-17T02:07:04.179188] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:07:04.278441] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:07:04.690173] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-17T02:07:05.076510] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:07:05.490127] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-17T02:07:06.181272] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T02:07:06.290117] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-17T02:07:06.519158] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:07:06.522200] [INFO ] [REMOTE ] ASIX: Full fetch complete (29510 records). [2025-09-17T02:07:06.522327] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-17T02:07:06.922563] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-17T02:07:06.922695] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-17T02:07:06.923149] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-17T02:07:06.923229] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-17T02:07:06.924425] [DEBUG] [LOCAL ] ASIX: Trimmed 29510 records to 22344 (keeping 200 days of data) [2025-09-17T02:07:07.060029] [DEBUG] [LOCAL ] ASIX: Primary data saved (22344 records). [2025-09-17T02:07:07.060207] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-17T02:07:07.060330] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASIX took 28.4s. Estimated remaining: 5h 15m 29s. Rate: 7.0 symbols/min [2025-09-17T02:07:07.095259] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-17T02:07:07.230080] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:07.269228] [DEBUG] [LOCAL ] ASX: Loaded 39389 existing records from primary storage. [2025-09-17T02:07:07.269437] [INFO ] [MAIN ] ASX: Loaded 39389 existing records. [2025-09-17T02:07:07.447936] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:07.448234] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-17T02:07:07.448312] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-17T02:07:07.449930] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-17T02:07:07.450014] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-17T02:07:07.793526] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T02:07:07.813840] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:07.890085] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-17T02:07:08.177148] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:07:08.690185] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-17T02:07:08.756261] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:07:09.490131] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-17T02:07:10.089258] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:07:10.095397] [INFO ] [REMOTE ] ASPN: Full fetch complete (72266 records). [2025-09-17T02:07:10.095545] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-17T02:07:10.300716] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-17T02:07:10.487884] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-17T02:07:10.488016] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-17T02:07:10.488830] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-17T02:07:10.488908] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-17T02:07:10.490446] [DEBUG] [LOCAL ] ASPN: Trimmed 72266 records to 49681 (keeping 200 days of data) [2025-09-17T02:07:10.773476] [DEBUG] [LOCAL ] ASPN: Primary data saved (49681 records). [2025-09-17T02:07:10.773689] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-17T02:07:10.773788] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASPN took 32.1s. Estimated remaining: 5h 14m 14s. Rate: 7.0 symbols/min [2025-09-17T02:07:10.944073] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:10.955250] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T02:07:10.959916] [INFO ] [REMOTE ] ASH: Full fetch complete (54176 records). [2025-09-17T02:07:10.960063] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-17T02:07:11.099328] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-11. [2025-09-17T02:07:11.206638] [DEBUG] [LOCAL ] ATEN: Loaded 28678 existing records from primary storage. [2025-09-17T02:07:11.239310] [INFO ] [MAIN ] ATEN: Loaded 28678 existing records. [2025-09-17T02:07:11.504302] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T02:07:11.521103] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-17T02:07:11.544488] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-17T02:07:11.566053] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-17T02:07:11.588782] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-17T02:07:11.610055] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:11.610537] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-17T02:07:11.610603] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-17T02:07:11.610772] [DEBUG] [LOCAL ] ASH: Trimmed 54176 records to 38086 (keeping 200 days of data) [2025-09-17T02:07:11.612076] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-17T02:07:11.612159] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-17T02:07:11.894558] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-17T02:07:12.097771] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:12.217614] [DEBUG] [LOCAL ] ASH: Primary data saved (38086 records). [2025-09-17T02:07:12.217812] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-17T02:07:12.217943] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASH took 33.6s. Estimated remaining: 5h 12m 30s. Rate: 7.1 symbols/min [2025-09-17T02:07:12.390717] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:12.390951] [DEBUG] [LOCAL ] ATGE: No existing data file found in primary storage. [2025-09-17T02:07:12.391001] [WARN ] [MAIN ] ATGE: No existing data found, performing full refresh instead. [2025-09-17T02:07:12.391105] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-17T02:07:12.391155] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-17T02:07:12.391204] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-09-17T02:07:12.391245] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-17T02:07:12.695348] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-11. [2025-09-17T02:07:12.756106] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:12.824707] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T02:07:12.972966] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T02:07:13.490136] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-17T02:07:14.134858] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T02:07:14.290174] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-11. [2025-09-17T02:07:15.090176] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-17T02:07:15.224856] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:07:15.438273] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:07:15.890201] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-17T02:07:16.649857] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T02:07:16.690094] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-17T02:07:16.704622] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:07:16.706505] [INFO ] [REMOTE ] ASR: Full fetch complete (12181 records). [2025-09-17T02:07:16.706668] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-17T02:07:17.083295] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-17T02:07:17.083444] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-17T02:07:17.083749] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-17T02:07:17.083805] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-17T02:07:17.084289] [DEBUG] [LOCAL ] ASR: Trimmed 12181 records to 9147 (keeping 200 days of data) [2025-09-17T02:07:17.143026] [DEBUG] [LOCAL ] ASR: Primary data saved (9147 records). [2025-09-17T02:07:17.143193] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-17T02:07:17.143303] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASR took 38.5s. Estimated remaining: 5h 11m 33s. Rate: 7.1 symbols/min [2025-09-17T02:07:17.338226] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:17.338480] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-09-17T02:07:17.338553] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-09-17T02:07:17.338764] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-17T02:07:17.338824] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-17T02:07:17.338880] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-09-17T02:07:17.338925] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-17T02:07:17.498224] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-17T02:07:17.708167] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:18.106362] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:07:18.290128] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-17T02:07:18.892200] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T02:07:19.090145] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-11. [2025-09-17T02:07:19.890128] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-17T02:07:20.119559] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:07:20.263772] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T02:07:20.690153] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-17T02:07:21.321683] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T02:07:21.490128] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-17T02:07:22.290180] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-17T02:07:22.362841] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T02:07:22.806213] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:07:23.090159] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-17T02:07:23.297242] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T02:07:23.890149] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-17T02:07:24.690522] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-17T02:07:24.695404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T02:07:24.996185] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T02:07:25.490177] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-17T02:07:26.269003] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:07:26.290103] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-17T02:07:27.090137] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-17T02:07:27.372865] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T02:07:27.890192] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-17T02:07:28.401404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T02:07:28.676010] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T02:07:28.690116] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-17T02:07:29.440383] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:07:29.490109] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-17T02:07:30.130784] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:07:30.290161] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-17T02:07:31.045592] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:07:31.090105] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-17T02:07:31.526437] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T02:07:31.890140] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-17T02:07:32.690135] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-17T02:07:32.859655] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T02:07:33.216724] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:07:33.490180] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-17T02:07:34.176330] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:07:34.290152] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-17T02:07:34.687228] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:07:35.090164] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-17T02:07:35.748396] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:07:35.890142] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-17T02:07:36.384097] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:07:36.690148] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-17T02:07:37.490135] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-17T02:07:37.677337] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:07:37.796046] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:07:37.799685] [INFO ] [REMOTE ] ATGE: Full fetch complete (46187 records). [2025-09-17T02:07:37.799856] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-17T02:07:38.181567] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-17T02:07:38.181684] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-17T02:07:38.182214] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-17T02:07:38.182274] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-17T02:07:38.183246] [DEBUG] [LOCAL ] ATGE: Trimmed 46187 records to 32297 (keeping 200 days of data) [2025-09-17T02:07:38.293098] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-17T02:07:38.379779] [DEBUG] [LOCAL ] ATGE: Primary data saved (32297 records). [2025-09-17T02:07:38.379955] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-17T02:07:38.380060] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ATGE took 26.2s. Estimated remaining: 5h 14m 15s. Rate: 7.0 symbols/min [2025-09-17T02:07:38.559320] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:38.567789] [DEBUG] [LOCAL ] ATHS: Loaded 4952 existing records from primary storage. [2025-09-17T02:07:38.567917] [INFO ] [MAIN ] ATHS: Loaded 4952 existing records. [2025-09-17T02:07:38.750057] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:38.750532] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-17T02:07:38.750725] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-17T02:07:38.751273] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-17T02:07:38.751348] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-17T02:07:38.921356] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:07:39.095190] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-17T02:07:39.161808] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:39.890096] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-11. [2025-09-17T02:07:40.389241] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:07:40.428151] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-17T02:07:40.512232] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T02:07:40.690183] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-17T02:07:41.490130] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-17T02:07:41.982235] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T02:07:42.290157] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-17T02:07:42.977182] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:07:43.090091] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-17T02:07:43.559741] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:07:43.890153] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-17T02:07:44.645734] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T02:07:44.690082] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-17T02:07:45.490130] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-17T02:07:45.651592] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T02:07:45.698453] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T02:07:45.703241] [INFO ] [REMOTE ] ATEN: Full fetch complete (57489 records). [2025-09-17T02:07:45.703395] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-17T02:07:46.088344] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-17T02:07:46.088464] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-17T02:07:46.089132] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-17T02:07:46.089238] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-17T02:07:46.091924] [DEBUG] [LOCAL ] ATEN: Trimmed 57489 records to 40190 (keeping 200 days of data) [2025-09-17T02:07:46.311564] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-17T02:07:46.346912] [DEBUG] [LOCAL ] ATEN: Primary data saved (40190 records). [2025-09-17T02:07:46.347058] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-17T02:07:46.347167] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ATEN took 35.6s. Estimated remaining: 5h 13m 59s. Rate: 7.0 symbols/min [2025-09-17T02:07:46.515092] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:46.554920] [DEBUG] [LOCAL ] ATI: Loaded 38648 existing records from primary storage. [2025-09-17T02:07:46.555083] [INFO ] [MAIN ] ATI: Loaded 38648 existing records. [2025-09-17T02:07:46.739785] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:46.740048] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-17T02:07:46.740206] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-17T02:07:46.752005] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-17T02:07:46.753906] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-17T02:07:46.786609] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T02:07:47.109328] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-17T02:07:47.117078] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:47.797350] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T02:07:47.804525] [INFO ] [REMOTE ] ASX: Full fetch complete (76481 records). [2025-09-17T02:07:47.804760] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-17T02:07:47.898538] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-17T02:07:48.237026] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-17T02:07:48.238549] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:07:48.238658] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-17T02:07:48.246317] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-17T02:07:48.246551] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-17T02:07:48.248257] [DEBUG] [LOCAL ] ASX: Trimmed 76481 records to 52931 (keeping 200 days of data) [2025-09-17T02:07:48.576432] [DEBUG] [LOCAL ] ASX: Primary data saved (52931 records). [2025-09-17T02:07:48.576601] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-17T02:07:48.578924] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ASX took 41.5s. Estimated remaining: 5h 12m 27s. Rate: 7.0 symbols/min [2025-09-17T02:07:48.695263] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-11. [2025-09-17T02:07:48.752386] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:48.758658] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-09-17T02:07:48.759373] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T02:07:48.759445] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-09-17T02:07:48.762207] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-17T02:07:48.762276] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-17T02:07:48.762337] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-09-17T02:07:48.762376] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-17T02:07:49.115043] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:49.490131] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-17T02:07:50.094621] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T02:07:50.290095] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-17T02:07:50.401982] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:07:51.090109] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-17T02:07:51.353061] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:07:51.358170] [INFO ] [REMOTE ] ATHM: Full fetch complete (52496 records). [2025-09-17T02:07:51.358394] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-17T02:07:51.493550] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T02:07:51.772673] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-17T02:07:51.772773] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-17T02:07:51.773331] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-17T02:07:51.773386] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-17T02:07:51.776565] [DEBUG] [LOCAL ] ATHM: Trimmed 52496 records to 33265 (keeping 200 days of data) [2025-09-17T02:07:51.890355] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-17T02:07:51.977785] [DEBUG] [LOCAL ] ATHM: Primary data saved (33265 records). [2025-09-17T02:07:51.977935] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-17T02:07:51.978030] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHM took 34.8s. Estimated remaining: 5h 11m 11s. Rate: 7.1 symbols/min [2025-09-17T02:07:52.144621] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:52.175380] [DEBUG] [LOCAL ] ATMU: Loaded 28708 existing records from primary storage. [2025-09-17T02:07:52.175534] [INFO ] [MAIN ] ATMU: Loaded 28708 existing records. [2025-09-17T02:07:52.355776] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:52.356145] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-17T02:07:52.356285] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-17T02:07:52.357457] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-17T02:07:52.357528] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-17T02:07:52.691605] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-11. [2025-09-17T02:07:52.715014] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:52.722123] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T02:07:53.490117] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-11. [2025-09-17T02:07:54.290121] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-17T02:07:54.325805] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:07:54.999006] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T02:07:55.090131] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-17T02:07:55.112348] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T02:07:55.890133] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-17T02:07:56.339363] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:07:56.690181] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-17T02:07:57.320453] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T02:07:57.490132] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-17T02:07:58.156808] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T02:07:58.216404] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T02:07:58.290138] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-17T02:07:59.090155] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-17T02:07:59.123203] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:07:59.890135] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-17T02:08:00.583153] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T02:08:00.612122] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:08:00.690119] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-17T02:08:01.490137] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-17T02:08:02.202435] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T02:08:02.290133] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-17T02:08:02.799392] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T02:08:03.090195] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-17T02:08:03.750711] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:08:03.890132] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-17T02:08:04.288071] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T02:08:04.690143] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-17T02:08:04.746487] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:08:05.490139] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-17T02:08:06.021254] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T02:08:06.022675] [INFO ] [REMOTE ] ATHS: Full fetch complete (10028 records). [2025-09-17T02:08:06.022763] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-17T02:08:06.299744] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-17T02:08:06.401870] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-17T02:08:06.402013] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-17T02:08:06.402409] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-17T02:08:06.402495] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-17T02:08:06.403138] [DEBUG] [LOCAL ] ATHS: Trimmed 10028 records to 7197 (keeping 200 days of data) [2025-09-17T02:08:06.467013] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:08:06.486972] [DEBUG] [LOCAL ] ATHS: Primary data saved (7197 records). [2025-09-17T02:08:06.487098] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-17T02:08:06.487188] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHS took 28.1s. Estimated remaining: 5h 12m 21s. Rate: 7.0 symbols/min [2025-09-17T02:08:06.656838] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:06.657071] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-09-17T02:08:06.657123] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-09-17T02:08:06.657235] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-17T02:08:06.657284] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-17T02:08:06.657336] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-09-17T02:08:06.657392] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-17T02:08:07.021460] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:07.090099] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-11. [2025-09-17T02:08:07.758676] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:08:07.890141] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-17T02:08:08.656079] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T02:08:08.690128] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-17T02:08:09.490147] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-17T02:08:09.613885] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:08:09.801827] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T02:08:10.290176] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-17T02:08:11.059240] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:08:11.090125] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-17T02:08:11.453276] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T02:08:11.890167] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-17T02:08:12.569835] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:08:12.690155] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-17T02:08:13.490131] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-17T02:08:13.746666] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T02:08:14.215268] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:08:14.290153] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-17T02:08:15.045219] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:08:15.090090] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-17T02:08:15.890105] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-17T02:08:16.037953] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:08:16.584216] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T02:08:16.690175] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-17T02:08:17.043820] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T02:08:17.490163] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-17T02:08:17.980321] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T02:08:18.290173] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-17T02:08:18.901834] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:08:19.090203] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-17T02:08:19.890169] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-17T02:08:20.118852] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:08:20.299785] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T02:08:20.690321] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-17T02:08:21.408828] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:08:21.490139] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-17T02:08:22.147929] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T02:08:22.290124] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-17T02:08:22.988581] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:08:23.090150] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-17T02:08:23.770118] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T02:08:23.890210] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-17T02:08:24.304741] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:08:24.690171] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-17T02:08:25.288094] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:08:25.295226] [INFO ] [REMOTE ] ATI: Full fetch complete (73504 records). [2025-09-17T02:08:25.295433] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-17T02:08:25.495020] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-17T02:08:25.725067] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-17T02:08:25.725179] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-17T02:08:25.725940] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-17T02:08:25.726003] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-17T02:08:25.727466] [DEBUG] [LOCAL ] ATI: Trimmed 73504 records to 51702 (keeping 200 days of data) [2025-09-17T02:08:26.044247] [DEBUG] [LOCAL ] ATI: Primary data saved (51702 records). [2025-09-17T02:08:26.044604] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-17T02:08:26.044736] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATI took 39.7s. Estimated remaining: 5h 14m 36s. Rate: 7.0 symbols/min [2025-09-17T02:08:26.220475] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:26.243674] [DEBUG] [LOCAL ] ATR: Loaded 23182 existing records from primary storage. [2025-09-17T02:08:26.243851] [INFO ] [MAIN ] ATR: Loaded 23182 existing records. [2025-09-17T02:08:26.297848] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-17T02:08:26.427842] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:26.428391] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-17T02:08:26.428565] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-17T02:08:26.429863] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-17T02:08:26.429939] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-17T02:08:26.752122] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:08:26.842982] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:26.913006] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T02:08:26.918383] [INFO ] [REMOTE ] ATKR: Full fetch complete (53643 records). [2025-09-17T02:08:26.918608] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-17T02:08:27.090211] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-11. [2025-09-17T02:08:27.325747] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-17T02:08:27.325876] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-17T02:08:27.326477] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-17T02:08:27.326535] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-17T02:08:27.327838] [DEBUG] [LOCAL ] ATKR: Trimmed 53643 records to 35889 (keeping 200 days of data) [2025-09-17T02:08:27.558653] [DEBUG] [LOCAL ] ATKR: Primary data saved (35889 records). [2025-09-17T02:08:27.558866] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-17T02:08:27.558978] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATKR took 39.0s. Estimated remaining: 5h 12m 56s. Rate: 7.0 symbols/min [2025-09-17T02:08:27.733278] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:27.747718] [DEBUG] [LOCAL ] ATS: Loaded 13086 existing records from primary storage. [2025-09-17T02:08:27.747916] [INFO ] [MAIN ] ATS: Loaded 13086 existing records. [2025-09-17T02:08:27.928074] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:27.899823] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-17T02:08:27.928567] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-17T02:08:27.929744] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-17T02:08:27.930870] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-17T02:08:27.931126] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-17T02:08:28.184256] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:08:28.338072] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:28.367888] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T02:08:28.690182] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-17T02:08:29.406653] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:08:29.490153] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-17T02:08:30.071382] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T02:08:30.290203] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-17T02:08:31.023135] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:08:31.090120] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-17T02:08:31.193453] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:08:31.890149] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-17T02:08:32.695600] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-17T02:08:32.710672] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T02:08:32.799140] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T02:08:33.490147] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-17T02:08:33.758770] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:08:33.764221] [INFO ] [REMOTE ] ATMU: Full fetch complete (56650 records). [2025-09-17T02:08:33.764352] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-17T02:08:34.152852] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-17T02:08:34.152964] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-17T02:08:34.153595] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-17T02:08:34.153668] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-17T02:08:34.154886] [DEBUG] [LOCAL ] ATMU: Trimmed 56650 records to 39756 (keeping 200 days of data) [2025-09-17T02:08:34.331419] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-11. [2025-09-17T02:08:34.401378] [DEBUG] [LOCAL ] ATMU: Primary data saved (39756 records). [2025-09-17T02:08:34.401560] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-17T02:08:34.401675] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATMU took 42.4s. Estimated remaining: 5h 12m 26s. Rate: 7.0 symbols/min [2025-09-17T02:08:34.571250] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:34.571444] [DEBUG] [LOCAL ] ATUS: No existing data file found in primary storage. [2025-09-17T02:08:34.571496] [WARN ] [MAIN ] ATUS: No existing data found, performing full refresh instead. [2025-09-17T02:08:34.571611] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-17T02:08:34.571687] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-17T02:08:34.571745] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-17T02:08:34.571792] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-17T02:08:34.973816] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:35.004045] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T02:08:35.090153] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-11. [2025-09-17T02:08:35.435721] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T02:08:35.890132] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-17T02:08:36.363982] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T02:08:36.690122] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-17T02:08:36.791759] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:08:37.490140] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-17T02:08:38.046150] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T02:08:38.290135] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-17T02:08:38.826181] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T02:08:38.834196] [INFO ] [REMOTE ] ATO: Full fetch complete (60132 records). [2025-09-17T02:08:38.834547] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-17T02:08:39.117876] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-17T02:08:39.146867] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:08:39.250385] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-17T02:08:39.250531] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-17T02:08:39.251297] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-17T02:08:39.251418] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-17T02:08:39.252944] [DEBUG] [LOCAL ] ATO: Trimmed 60132 records to 42075 (keeping 200 days of data) [2025-09-17T02:08:39.520892] [DEBUG] [LOCAL ] ATO: Primary data saved (42075 records). [2025-09-17T02:08:39.521062] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-17T02:08:39.521157] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATO took 33.0s. Estimated remaining: 5h 11m 34s. Rate: 7.0 symbols/min [2025-09-17T02:08:39.693387] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:39.732142] [DEBUG] [LOCAL ] AU: Loaded 39477 existing records from primary storage. [2025-09-17T02:08:39.732336] [INFO ] [MAIN ] AU: Loaded 39477 existing records. [2025-09-17T02:08:39.898118] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-17T02:08:39.912189] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:39.912471] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-17T02:08:39.912535] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-17T02:08:39.914326] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-17T02:08:39.914444] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-17T02:08:40.275831] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:40.538225] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T02:08:40.690151] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-17T02:08:41.291778] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T02:08:41.490143] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-17T02:08:41.965166] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T02:08:42.290155] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-11. [2025-09-17T02:08:42.835101] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:08:43.090154] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-17T02:08:43.890102] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-17T02:08:43.994963] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:08:44.139315] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:08:44.690156] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-17T02:08:45.012449] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:08:45.490192] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-17T02:08:45.774512] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T02:08:46.290159] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-17T02:08:47.090141] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-17T02:08:47.137987] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T02:08:47.890138] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-17T02:08:48.230543] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T02:08:48.303585] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:08:48.690131] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-17T02:08:48.795692] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T02:08:49.490143] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-17T02:08:50.196396] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:08:50.290129] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-17T02:08:50.596152] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:08:51.090136] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-17T02:08:51.890122] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-17T02:08:52.118541] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:08:52.275766] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:08:52.279922] [INFO ] [REMOTE ] ATR: Full fetch complete (42993 records). [2025-09-17T02:08:52.280026] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-17T02:08:52.658792] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-17T02:08:52.658896] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-17T02:08:52.659380] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-17T02:08:52.659432] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-17T02:08:52.660383] [DEBUG] [LOCAL ] ATR: Trimmed 42993 records to 30540 (keeping 200 days of data) [2025-09-17T02:08:52.718059] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-17T02:08:52.851378] [DEBUG] [LOCAL ] ATR: Primary data saved (30540 records). [2025-09-17T02:08:52.851534] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-17T02:08:52.851624] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATR took 26.8s. Estimated remaining: 5h 12m 26s. Rate: 7.0 symbols/min [2025-09-17T02:08:53.021809] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:53.033334] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T02:08:53.071858] [DEBUG] [LOCAL ] AUB: Loaded 33888 existing records from primary storage. [2025-09-17T02:08:53.072018] [INFO ] [MAIN ] AUB: Loaded 33888 existing records. [2025-09-17T02:08:53.253877] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:53.254714] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-17T02:08:53.254775] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-17T02:08:53.256542] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-17T02:08:53.256608] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-17T02:08:53.495263] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-17T02:08:53.609779] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:54.290183] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-17T02:08:54.409779] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T02:08:55.090156] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-17T02:08:55.135725] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:08:55.224859] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:08:55.890125] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-17T02:08:56.353105] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:08:56.690128] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-11. [2025-09-17T02:08:57.406809] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T02:08:57.490119] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-17T02:08:58.195113] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:08:58.290127] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-17T02:08:59.056272] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T02:08:59.090078] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-17T02:08:59.537976] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T02:08:59.890138] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-17T02:09:00.136237] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:09:00.690172] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-17T02:09:01.467602] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:09:01.490089] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-17T02:09:02.290185] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-17T02:09:03.090141] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-17T02:09:04.043493] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (3.35 seconds). [2025-09-17T02:09:04.056347] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-17T02:09:04.273817] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-17T02:09:04.690128] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-17T02:09:06.146929] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (3.86 seconds). [2025-09-17T02:09:06.149416] [INFO ] [REMOTE ] ATS: Full fetch complete (25974 records). [2025-09-17T02:09:06.149507] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-17T02:09:06.535047] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-17T02:09:06.536117] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T02:09:06.536305] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-17T02:09:06.542418] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-17T02:09:06.542562] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-17T02:09:06.543332] [INFO ] [REMOTE ] ATUS: Full fetch complete (70644 records). [2025-09-17T02:09:06.543599] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-17T02:09:06.544377] [DEBUG] [LOCAL ] ATS: Trimmed 25974 records to 18304 (keeping 200 days of data) [2025-09-17T02:09:06.735796] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (3.65 seconds). [2025-09-17T02:09:06.798087] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-17T02:09:07.091138] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-17T02:09:07.097573] [DEBUG] [LOCAL ] ATS: Primary data saved (18304 records). [2025-09-17T02:09:07.097996] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-17T02:09:07.097882] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-17T02:09:07.098190] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATS took 39.5s. Estimated remaining: 5h 13m 29s. Rate: 7.0 symbols/min [2025-09-17T02:09:07.099104] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-17T02:09:07.099244] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-17T02:09:07.206384] [DEBUG] [LOCAL ] ATUS: Trimmed 70644 records to 49193 (keeping 200 days of data) [2025-09-17T02:09:07.329497] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:07.371973] [DEBUG] [LOCAL ] AUNA: Loaded 3645 existing records from primary storage. [2025-09-17T02:09:07.372663] [INFO ] [MAIN ] AUNA: Loaded 3645 existing records. [2025-09-17T02:09:07.564297] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:09:07.566568] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-17T02:09:07.567151] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-17T02:09:07.569374] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-17T02:09:07.570289] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-17T02:09:07.875469] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (3.82 seconds). [2025-09-17T02:09:07.981188] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-17T02:09:08.099487] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:08.102796] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-11. [2025-09-17T02:09:08.163824] [DEBUG] [LOCAL ] ATUS: Primary data saved (49193 records). [2025-09-17T02:09:08.164019] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-17T02:09:08.164108] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATUS took 33.8s. Estimated remaining: 5h 11m 47s. Rate: 7.0 symbols/min [2025-09-17T02:09:08.336726] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:08.336980] [DEBUG] [LOCAL ] AVA: No existing data file found in primary storage. [2025-09-17T02:09:08.337031] [WARN ] [MAIN ] AVA: No existing data found, performing full refresh instead. [2025-09-17T02:09:08.337140] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-17T02:09:08.337192] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-17T02:09:08.337240] [DEBUG] [LOCAL ] AVA: No primary data file found to delete. [2025-09-17T02:09:08.337283] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-17T02:09:08.694239] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:08.694747] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-11. [2025-09-17T02:09:08.721534] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T02:09:08.731112] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-17T02:09:08.778727] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:09:09.490099] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-17T02:09:09.924281] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T02:09:09.972158] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T02:09:10.115930] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:09:10.294787] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-17T02:09:10.299669] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:09:11.090226] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-17T02:09:11.890115] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-17T02:09:12.285529] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T02:09:12.690155] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-17T02:09:12.863021] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T02:09:13.343960] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:09:13.490132] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-17T02:09:14.290199] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-17T02:09:14.497094] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T02:09:14.639897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:09:15.090200] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-17T02:09:15.890254] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-17T02:09:16.046156] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T02:09:16.472349] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T02:09:16.528522] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:09:16.690136] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-17T02:09:17.121912] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T02:09:17.490173] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-17T02:09:18.290142] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-17T02:09:19.064856] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T02:09:19.090096] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-17T02:09:19.860228] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T02:09:19.890095] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-17T02:09:20.690178] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-17T02:09:21.490113] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-17T02:09:21.870669] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-17T02:09:22.077448] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T02:09:22.290149] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-17T02:09:22.339967] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T02:09:22.571790] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T02:09:22.578296] [INFO ] [REMOTE ] AU: Full fetch complete (76063 records). [2025-09-17T02:09:22.578449] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-17T02:09:22.978099] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-17T02:09:22.978202] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-17T02:09:22.979057] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-17T02:09:22.979154] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-17T02:09:22.980672] [DEBUG] [LOCAL ] AU: Trimmed 76063 records to 52895 (keeping 200 days of data) [2025-09-17T02:09:23.090202] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-17T02:09:23.308345] [DEBUG] [LOCAL ] AU: Primary data saved (52895 records). [2025-09-17T02:09:23.308522] [INFO ] [MAIN ] AU: Full history saved. [2025-09-17T02:09:23.308667] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. AU took 43.8s. Estimated remaining: 5h 13m 1s. Rate: 7.0 symbols/min [2025-09-17T02:09:23.493857] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:23.494167] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-09-17T02:09:23.494241] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-09-17T02:09:23.494416] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-17T02:09:23.494488] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-17T02:09:23.494571] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-09-17T02:09:23.494626] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-17T02:09:23.728037] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T02:09:23.891995] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-17T02:09:23.923436] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:23.970484] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T02:09:24.505702] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T02:09:24.690166] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-17T02:09:25.490214] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-17T02:09:26.290108] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-11. [2025-09-17T02:09:26.340212] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:09:26.759618] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:09:26.898281] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T02:09:27.090178] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-17T02:09:27.836347] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T02:09:27.890159] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-17T02:09:28.446023] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T02:09:28.690150] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-17T02:09:29.490158] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-17T02:09:29.589624] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:09:30.290138] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-17T02:09:30.920061] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:09:30.936629] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T02:09:31.090109] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-17T02:09:31.732479] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T02:09:31.890178] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-17T02:09:32.626774] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T02:09:32.690211] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-17T02:09:33.153427] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T02:09:33.490141] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-17T02:09:34.290150] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-17T02:09:34.880376] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:09:34.886116] [INFO ] [REMOTE ] AUB: Full fetch complete (65180 records). [2025-09-17T02:09:34.886294] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-17T02:09:35.095380] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-17T02:09:35.290326] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-17T02:09:35.290451] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-17T02:09:35.291173] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-17T02:09:35.291237] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-17T02:09:35.292773] [DEBUG] [LOCAL ] AUB: Trimmed 65180 records to 46562 (keeping 200 days of data) [2025-09-17T02:09:35.581131] [DEBUG] [LOCAL ] AUB: Primary data saved (46562 records). [2025-09-17T02:09:35.581308] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-17T02:09:35.581423] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AUB took 42.7s. Estimated remaining: 5h 13m 38s. Rate: 7.0 symbols/min [2025-09-17T02:09:35.756573] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:35.790603] [DEBUG] [LOCAL ] AVB: Loaded 31165 existing records from primary storage. [2025-09-17T02:09:35.790830] [INFO ] [MAIN ] AVB: Loaded 31165 existing records. [2025-09-17T02:09:35.862793] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T02:09:35.900896] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-17T02:09:36.007447] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:09:36.008991] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T02:09:36.009204] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-17T02:09:36.017716] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-17T02:09:36.019043] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-17T02:09:36.019107] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-17T02:09:36.376214] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:36.690364] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-17T02:09:36.693264] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:09:37.490199] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-17T02:09:38.117180] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:09:38.290169] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-17T02:09:38.375267] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T02:09:38.883098] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T02:09:39.090142] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-11. [2025-09-17T02:09:39.890140] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-17T02:09:40.419504] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T02:09:40.420796] [INFO ] [REMOTE ] AUNA: Full fetch complete (7406 records). [2025-09-17T02:09:40.420885] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-17T02:09:40.695440] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-17T02:09:40.792173] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-17T02:09:40.792399] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-17T02:09:40.792685] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-17T02:09:40.792857] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-17T02:09:40.793435] [DEBUG] [LOCAL ] AUNA: Trimmed 7406 records to 4611 (keeping 200 days of data) [2025-09-17T02:09:40.836407] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:09:40.849594] [DEBUG] [LOCAL ] AUNA: Primary data saved (4611 records). [2025-09-17T02:09:40.849702] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-17T02:09:40.849786] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUNA took 33.8s. Estimated remaining: 5h 12m 48s. Rate: 7.0 symbols/min [2025-09-17T02:09:41.035933] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:41.036151] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-17T02:09:41.036207] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-17T02:09:41.036353] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-17T02:09:41.036399] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-17T02:09:41.036453] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-17T02:09:41.036492] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-17T02:09:41.390584] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:41.490148] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-17T02:09:41.546801] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:09:42.290147] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-17T02:09:42.749455] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T02:09:42.754228] [INFO ] [REMOTE ] AVA: Full fetch complete (55240 records). [2025-09-17T02:09:42.754347] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-17T02:09:42.997141] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T02:09:43.052002] [INFO ] [REMOTE ] AVAL: Full fetch complete (14624 records). [2025-09-17T02:09:43.062722] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-17T02:09:43.092141] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-11. [2025-09-17T02:09:43.198835] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-17T02:09:43.234948] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-17T02:09:43.247598] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-17T02:09:43.258843] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-17T02:09:43.388800] [DEBUG] [LOCAL ] AVA: Trimmed 55240 records to 39688 (keeping 200 days of data) [2025-09-17T02:09:43.514221] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:43.551830] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-11 [2025-09-17T02:09:43.626477] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-17T02:09:43.627529] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-17T02:09:43.629840] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-17T02:09:43.630404] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-17T02:09:43.632950] [DEBUG] [LOCAL ] AVAL: Trimmed 14624 records to 9704 (keeping 200 days of data) [2025-09-17T02:09:43.717193] [DEBUG] [LOCAL ] AVAL: Primary data saved (9704 records). [2025-09-17T02:09:43.776187] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-17T02:09:43.776433] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVAL took 20.5s. Estimated remaining: 5h 11m 31s. Rate: 7.0 symbols/min [2025-09-17T02:09:43.890921] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-17T02:09:43.990887] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:43.992074] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-09-17T02:09:43.992446] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-09-17T02:09:43.993857] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-17T02:09:43.995427] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-17T02:09:43.996829] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-09-17T02:09:43.998058] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-17T02:09:44.380524] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:44.391717] [DEBUG] [LOCAL ] AVA: Primary data saved (39688 records). [2025-09-17T02:09:44.391916] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-17T02:09:44.392017] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVA took 36.2s. Estimated remaining: 5h 9m 47s. Rate: 7.1 symbols/min [2025-09-17T02:09:44.559597] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:44.574232] [DEBUG] [LOCAL ] AVK: Loaded 13450 existing records from primary storage. [2025-09-17T02:09:44.574394] [INFO ] [MAIN ] AVK: Loaded 13450 existing records. [2025-09-17T02:09:44.695241] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-11. [2025-09-17T02:09:44.755949] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:09:44.756195] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-17T02:09:44.756265] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-17T02:09:44.757162] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-17T02:09:44.757237] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-17T02:09:45.139990] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:45.389363] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T02:09:45.490100] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-17T02:09:46.129126] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:09:46.290132] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-11. [2025-09-17T02:09:47.015740] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:09:47.090143] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-17T02:09:47.105987] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T02:09:47.890163] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-17T02:09:48.219527] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T02:09:48.576700] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T02:09:48.690158] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-17T02:09:49.490147] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-17T02:09:50.032140] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:50.032485] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-17T02:09:50.290122] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-17T02:09:50.367110] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T02:09:51.090160] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-17T02:09:51.514181] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:09:51.774209] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T02:09:51.890145] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-17T02:09:52.690126] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-17T02:09:52.914600] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:52.915099] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-17T02:09:53.376216] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T02:09:53.490130] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-17T02:09:54.290150] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-17T02:09:54.508360] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:54.508687] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-17T02:09:55.052886] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:09:55.090083] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-17T02:09:55.890130] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-17T02:09:56.635110] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:09:56.690102] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-17T02:09:56.862675] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T02:09:56.923870] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:56.924203] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-17T02:09:57.490132] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-17T02:09:58.290148] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-17T02:09:58.428612] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:09:59.090120] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-17T02:09:59.221421] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T02:09:59.890105] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-17T02:10:00.109161] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:00.109746] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-17T02:10:00.120449] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T02:10:00.690127] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-17T02:10:01.490183] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-17T02:10:02.290184] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-17T02:10:02.330332] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T02:10:02.508555] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:02.508962] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-17T02:10:02.568774] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:10:03.090136] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-17T02:10:03.890151] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-17T02:10:04.102744] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T02:10:04.108634] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:04.108867] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-17T02:10:04.690159] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-17T02:10:04.905782] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:04.906095] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-17T02:10:05.490160] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-17T02:10:06.290184] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-17T02:10:06.907047] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:10:06.924102] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T02:10:07.090163] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-17T02:10:07.890173] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-17T02:10:08.262563] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:10:08.690145] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-17T02:10:09.274714] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:10:09.490102] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-17T02:10:09.846039] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T02:10:10.290142] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-17T02:10:11.090168] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-17T02:10:11.110052] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:10:11.115509] [INFO ] [REMOTE ] AVB: Full fetch complete (57749 records). [2025-09-17T02:10:11.115626] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-17T02:10:11.257063] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:10:11.310446] [INFO ] [REMOTE ] AVBC: Full fetch complete (4047 records). [2025-09-17T02:10:11.332607] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-17T02:10:11.697151] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-17T02:10:11.704143] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-17T02:10:11.719536] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-17T02:10:11.725242] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-17T02:10:11.725132] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 32 unique days, need 200 days [2025-09-17T02:10:11.725636] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:10:11.725719] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:10:11.725765] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-17T02:10:11.725829] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-17T02:10:11.725875] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-17T02:10:11.726393] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-17T02:10:11.726530] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVBC took 30.9s. Estimated remaining: 5h 13m 25s. Rate: 7.0 symbols/min [2025-09-17T02:10:11.757803] [DEBUG] [LOCAL ] AVB: Trimmed 57749 records to 41477 (keeping 200 days of data) [2025-09-17T02:10:11.898028] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-17T02:10:11.997049] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:12.032065] [DEBUG] [LOCAL ] AVNS: Loaded 25002 existing records from primary storage. [2025-09-17T02:10:12.036244] [INFO ] [MAIN ] AVNS: Loaded 25002 existing records. [2025-09-17T02:10:12.298583] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:12.330829] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-17T02:10:12.337868] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-17T02:10:12.338841] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-17T02:10:12.339206] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-17T02:10:12.452585] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T02:10:12.691216] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-17T02:10:12.769183] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:12.784598] [DEBUG] [LOCAL ] AVB: Primary data saved (41477 records). [2025-09-17T02:10:12.784817] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-17T02:10:12.784949] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVB took 37.2s. Estimated remaining: 5h 11m 46s. Rate: 7.0 symbols/min [2025-09-17T02:10:12.954717] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:12.988659] [DEBUG] [LOCAL ] AVNT: Loaded 28832 existing records from primary storage. [2025-09-17T02:10:12.988828] [INFO ] [MAIN ] AVNT: Loaded 28832 existing records. [2025-09-17T02:10:13.173703] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:13.174138] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-17T02:10:13.187668] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-17T02:10:13.188862] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T02:10:13.193492] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-17T02:10:13.194004] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-17T02:10:13.495441] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-17T02:10:13.558014] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:13.623839] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:10:14.290203] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-11. [2025-09-17T02:10:14.675667] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:10:15.090181] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-11. [2025-09-17T02:10:15.746916] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T02:10:15.890171] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-17T02:10:16.412708] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T02:10:16.690162] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-17T02:10:16.847047] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T02:10:16.850336] [INFO ] [REMOTE ] AVK: Full fetch complete (26766 records). [2025-09-17T02:10:16.850470] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-17T02:10:17.236564] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-17T02:10:17.236701] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-17T02:10:17.237634] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-17T02:10:17.237723] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-17T02:10:17.238424] [DEBUG] [LOCAL ] AVK: Trimmed 26766 records to 18256 (keeping 200 days of data) [2025-09-17T02:10:17.351563] [DEBUG] [LOCAL ] AVK: Primary data saved (18256 records). [2025-09-17T02:10:17.351781] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-17T02:10:17.351892] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVK took 33.0s. Estimated remaining: 5h 10m 50s. Rate: 7.0 symbols/min [2025-09-17T02:10:17.500131] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-17T02:10:17.527570] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:17.569125] [DEBUG] [LOCAL ] AVTR: Loaded 39944 existing records from primary storage. [2025-09-17T02:10:17.569332] [INFO ] [MAIN ] AVTR: Loaded 39944 existing records. [2025-09-17T02:10:17.753779] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:17.754144] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-17T02:10:17.754279] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-17T02:10:17.761139] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-17T02:10:17.767599] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-17T02:10:17.839870] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:10:18.157470] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:18.290118] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-11. [2025-09-17T02:10:18.953838] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:10:19.090153] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-17T02:10:19.890185] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-17T02:10:20.036327] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:10:20.080050] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T02:10:20.690109] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-17T02:10:21.015365] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:10:21.490173] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-17T02:10:22.217634] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:10:22.290092] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-17T02:10:22.918804] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T02:10:23.090139] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-17T02:10:23.663308] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:10:23.890182] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-17T02:10:24.602751] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T02:10:24.690410] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-17T02:10:24.728070] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:10:24.733123] [INFO ] [REMOTE ] AVD: Full fetch complete (33989 records). [2025-09-17T02:10:24.733409] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-17T02:10:25.329381] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-17T02:10:25.329560] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-17T02:10:25.330360] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-17T02:10:25.330443] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-17T02:10:25.331869] [DEBUG] [LOCAL ] AVD: Trimmed 33989 records to 23298 (keeping 200 days of data) [2025-09-17T02:10:25.491539] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-17T02:10:25.517918] [DEBUG] [LOCAL ] AVD: Primary data saved (23298 records). [2025-09-17T02:10:25.518157] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-17T02:10:25.519460] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVD took 41.7s. Estimated remaining: 5h 10m 37s. Rate: 7.0 symbols/min [2025-09-17T02:10:25.777730] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:25.805635] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:10:25.843896] [DEBUG] [LOCAL ] AVY: Loaded 27220 existing records from primary storage. [2025-09-17T02:10:25.844116] [INFO ] [MAIN ] AVY: Loaded 27220 existing records. [2025-09-17T02:10:26.037736] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:26.038030] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-17T02:10:26.038105] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-17T02:10:26.039379] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-17T02:10:26.039452] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-17T02:10:26.297105] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-17T02:10:26.406967] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:27.057669] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T02:10:27.090134] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-17T02:10:27.596181] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T02:10:27.890159] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-17T02:10:28.680464] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T02:10:28.690678] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-17T02:10:29.300965] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:10:29.490205] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-17T02:10:30.263534] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:10:30.290121] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-17T02:10:30.755015] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T02:10:31.090136] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-11. [2025-09-17T02:10:31.756636] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:10:31.890172] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-17T02:10:32.526744] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T02:10:32.690184] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-17T02:10:33.422002] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:10:33.490180] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-17T02:10:33.799001] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:10:34.290173] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-17T02:10:35.090167] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-17T02:10:35.327288] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T02:10:35.777341] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T02:10:35.890117] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-17T02:10:36.111317] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:10:36.690135] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-17T02:10:37.108506] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:10:37.490189] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-17T02:10:38.136079] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:10:38.290127] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-17T02:10:39.090163] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-17T02:10:39.284775] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:10:39.837783] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:10:39.890087] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-17T02:10:40.219975] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:10:40.690158] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-17T02:10:41.088964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:10:41.490134] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-17T02:10:42.146012] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T02:10:42.290135] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-17T02:10:42.709703] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:10:42.714318] [INFO ] [REMOTE ] AVNT: Full fetch complete (55754 records). [2025-09-17T02:10:42.714499] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-17T02:10:43.097408] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-17T02:10:43.100342] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-17T02:10:43.101222] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-17T02:10:43.101865] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-17T02:10:43.101947] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-17T02:10:43.103206] [DEBUG] [LOCAL ] AVNT: Trimmed 55754 records to 39625 (keeping 200 days of data) [2025-09-17T02:10:43.360867] [DEBUG] [LOCAL ] AVNT: Primary data saved (39625 records). [2025-09-17T02:10:43.361052] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-17T02:10:43.361197] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNT took 30.6s. Estimated remaining: 5h 12m 18s. Rate: 7.0 symbols/min [2025-09-17T02:10:43.539383] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:43.557868] [DEBUG] [LOCAL ] AWF: Loaded 17033 existing records from primary storage. [2025-09-17T02:10:43.558020] [INFO ] [MAIN ] AWF: Loaded 17033 existing records. [2025-09-17T02:10:43.744981] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:43.745253] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-17T02:10:43.745323] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-17T02:10:43.746164] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-17T02:10:43.746238] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-17T02:10:43.895216] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-17T02:10:44.106806] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:44.130588] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T02:10:44.626105] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T02:10:44.690120] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-11. [2025-09-17T02:10:45.490116] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-17T02:10:45.713108] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:10:45.803139] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:10:46.290137] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-17T02:10:46.323919] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:10:46.328900] [INFO ] [REMOTE ] AVNS: Full fetch complete (47518 records). [2025-09-17T02:10:46.329028] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-17T02:10:46.729767] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-17T02:10:46.729931] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-17T02:10:46.730663] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-17T02:10:46.730732] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-17T02:10:46.732356] [DEBUG] [LOCAL ] AVNS: Trimmed 47518 records to 33740 (keeping 200 days of data) [2025-09-17T02:10:46.940391] [DEBUG] [LOCAL ] AVNS: Primary data saved (33740 records). [2025-09-17T02:10:46.940558] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-17T02:10:46.940717] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVNS took 35.2s. Estimated remaining: 5h 11m 11s. Rate: 7.0 symbols/min [2025-09-17T02:10:47.095349] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-17T02:10:47.120512] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:47.143583] [DEBUG] [LOCAL ] AWI: Loaded 19097 existing records from primary storage. [2025-09-17T02:10:47.143787] [INFO ] [MAIN ] AWI: Loaded 19097 existing records. [2025-09-17T02:10:47.369171] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:47.369569] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-17T02:10:47.369718] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-17T02:10:47.376421] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-17T02:10:47.385702] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-17T02:10:47.455980] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:10:47.770274] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:47.890139] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-11. [2025-09-17T02:10:48.690113] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-17T02:10:48.848561] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:10:49.076081] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:10:49.490137] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-17T02:10:50.290149] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-17T02:10:50.458498] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T02:10:50.536919] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:10:51.090156] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-17T02:10:51.890130] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-17T02:10:52.209399] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T02:10:52.235345] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:10:52.690130] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-17T02:10:53.046800] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T02:10:53.490093] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-17T02:10:53.569261] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T02:10:54.290131] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-17T02:10:54.690562] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T02:10:54.697023] [INFO ] [REMOTE ] AVTR: Full fetch complete (77266 records). [2025-09-17T02:10:54.697206] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-17T02:10:55.088460] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-17T02:10:55.088571] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-17T02:10:55.089336] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-17T02:10:55.089396] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-17T02:10:55.090120] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-17T02:10:55.092380] [DEBUG] [LOCAL ] AVTR: Trimmed 77266 records to 53571 (keeping 200 days of data) [2025-09-17T02:10:55.417753] [DEBUG] [LOCAL ] AVTR: Primary data saved (53571 records). [2025-09-17T02:10:55.417919] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-17T02:10:55.418016] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AVTR took 38.1s. Estimated remaining: 5h 11m 2s. Rate: 7.0 symbols/min [2025-09-17T02:10:55.599839] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:55.643398] [DEBUG] [LOCAL ] AWK: Loaded 35976 existing records from primary storage. [2025-09-17T02:10:55.643697] [INFO ] [MAIN ] AWK: Loaded 35976 existing records. [2025-09-17T02:10:55.831395] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:55.831733] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-17T02:10:55.837669] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-17T02:10:55.848386] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T02:10:55.854317] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-17T02:10:55.854829] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-17T02:10:55.897364] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-17T02:10:56.220587] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:56.303220] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:10:56.690140] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-17T02:10:57.353837] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:10:57.490155] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-17T02:10:57.992019] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T02:10:58.290152] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-17T02:10:58.982334] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:10:59.090095] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-17T02:10:59.476401] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T02:10:59.890134] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-17T02:11:00.002685] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:11:00.690130] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-11. [2025-09-17T02:11:01.388831] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T02:11:01.490170] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-17T02:11:02.290117] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-17T02:11:02.412304] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T02:11:02.884964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:11:02.889825] [INFO ] [REMOTE ] AVY: Full fetch complete (55760 records). [2025-09-17T02:11:02.889950] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-17T02:11:03.095399] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-17T02:11:03.278135] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-17T02:11:03.278250] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-17T02:11:03.278932] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-17T02:11:03.278991] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-17T02:11:03.280393] [DEBUG] [LOCAL ] AVY: Trimmed 55760 records to 37751 (keeping 200 days of data) [2025-09-17T02:11:03.521740] [DEBUG] [LOCAL ] AVY: Primary data saved (37751 records). [2025-09-17T02:11:03.521929] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-17T02:11:03.522022] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 38.0s. Estimated remaining: 5h 10m 48s. Rate: 7.0 symbols/min [2025-09-17T02:11:03.695453] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:03.723885] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:11:03.746434] [DEBUG] [LOCAL ] AWP: Loaded 16751 existing records from primary storage. [2025-09-17T02:11:03.746617] [INFO ] [MAIN ] AWP: Loaded 16751 existing records. [2025-09-17T02:11:03.898751] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-17T02:11:03.929840] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:03.931056] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-17T02:11:03.931123] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-17T02:11:03.932026] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-17T02:11:03.932096] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-17T02:11:04.305036] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:04.690179] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-11. [2025-09-17T02:11:04.803493] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T02:11:04.934839] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:11:05.374904] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:11:05.490137] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-17T02:11:06.290176] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-17T02:11:06.712369] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:11:07.090121] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-17T02:11:07.436407] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T02:11:07.890158] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-17T02:11:08.570449] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:11:08.690158] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-17T02:11:08.875271] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T02:11:09.490145] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-17T02:11:10.287259] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T02:11:10.296428] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-17T02:11:10.446220] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T02:11:11.090151] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-17T02:11:11.480631] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:11:11.890224] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-17T02:11:12.506067] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:11:12.690147] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-17T02:11:13.047194] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T02:11:13.365046] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T02:11:13.490165] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-17T02:11:14.290109] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-17T02:11:14.743357] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:11:15.090147] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-17T02:11:15.187236] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:11:15.190588] [INFO ] [REMOTE ] AWF: Full fetch complete (35755 records). [2025-09-17T02:11:15.190703] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-17T02:11:15.560524] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-17T02:11:15.560670] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-17T02:11:15.561172] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-17T02:11:15.561229] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-17T02:11:15.562357] [DEBUG] [LOCAL ] AWF: Trimmed 35755 records to 24095 (keeping 200 days of data) [2025-09-17T02:11:15.711065] [DEBUG] [LOCAL ] AWF: Primary data saved (24095 records). [2025-09-17T02:11:15.711241] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-17T02:11:15.711367] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AWF took 32.4s. Estimated remaining: 5h 11m 21s. Rate: 7.0 symbols/min [2025-09-17T02:11:15.888093] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:15.890084] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-17T02:11:15.906087] [DEBUG] [LOCAL ] AWR: Loaded 16266 existing records from primary storage. [2025-09-17T02:11:15.906242] [INFO ] [MAIN ] AWR: Loaded 16266 existing records. [2025-09-17T02:11:16.083981] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:16.084229] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-17T02:11:16.084287] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-17T02:11:16.085139] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-17T02:11:16.085206] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-17T02:11:16.452633] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:16.466399] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:11:16.690153] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-11. [2025-09-17T02:11:17.490172] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-17T02:11:17.584777] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T02:11:17.677126] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T02:11:18.290215] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-17T02:11:18.658923] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:11:19.090206] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-17T02:11:19.890125] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-17T02:11:19.930673] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:11:20.337343] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T02:11:20.690144] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-17T02:11:20.745503] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T02:11:21.456942] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:11:21.490156] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-17T02:11:22.290152] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-17T02:11:22.591866] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:11:23.030536] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:11:23.034015] [INFO ] [REMOTE ] AWI: Full fetch complete (35381 records). [2025-09-17T02:11:23.034151] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-17T02:11:23.096542] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-17T02:11:23.410426] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-17T02:11:23.410527] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-17T02:11:23.410973] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-17T02:11:23.411028] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-17T02:11:23.411929] [DEBUG] [LOCAL ] AWI: Trimmed 35381 records to 26291 (keeping 200 days of data) [2025-09-17T02:11:23.578982] [DEBUG] [LOCAL ] AWI: Primary data saved (26291 records). [2025-09-17T02:11:23.579140] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-17T02:11:23.579230] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AWI took 36.6s. Estimated remaining: 5h 11m 4s. Rate: 7.0 symbols/min [2025-09-17T02:11:23.751098] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:23.770465] [DEBUG] [LOCAL ] AX: Loaded 20338 existing records from primary storage. [2025-09-17T02:11:23.770615] [INFO ] [MAIN ] AX: Loaded 20338 existing records. [2025-09-17T02:11:23.895253] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-17T02:11:23.951023] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:23.951242] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-17T02:11:23.951302] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-17T02:11:23.952063] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-17T02:11:23.952126] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-17T02:11:24.311770] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:24.659593] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:11:24.690106] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-17T02:11:25.111755] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T02:11:25.490197] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-11. [2025-09-17T02:11:25.748588] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T02:11:26.290238] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-17T02:11:26.860738] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:11:27.090216] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-17T02:11:27.890121] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-17T02:11:27.922191] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T02:11:28.163859] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:11:28.690141] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-17T02:11:29.155788] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T02:11:29.490183] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-17T02:11:30.082151] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T02:11:30.290212] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-17T02:11:30.606049] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:11:31.090174] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-17T02:11:31.285918] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:11:31.288810] [INFO ] [REMOTE ] AWP: Full fetch complete (32579 records). [2025-09-17T02:11:31.288923] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-17T02:11:31.658915] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-17T02:11:31.659023] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-17T02:11:31.659478] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-17T02:11:31.659536] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-17T02:11:31.660426] [DEBUG] [LOCAL ] AWP: Trimmed 32579 records to 22238 (keeping 200 days of data) [2025-09-17T02:11:31.800572] [DEBUG] [LOCAL ] AWP: Primary data saved (22238 records). [2025-09-17T02:11:31.801005] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-17T02:11:31.801220] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWP took 28.3s. Estimated remaining: 5h 10m 52s. Rate: 7.0 symbols/min [2025-09-17T02:11:31.898473] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-17T02:11:31.982402] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:32.019454] [DEBUG] [LOCAL ] AXL: Loaded 37509 existing records from primary storage. [2025-09-17T02:11:32.019623] [INFO ] [MAIN ] AXL: Loaded 37509 existing records. [2025-09-17T02:11:32.210979] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:32.211249] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-17T02:11:32.211309] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-17T02:11:32.212779] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-17T02:11:32.212844] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-17T02:11:32.565978] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:11:32.600829] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:32.690085] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-17T02:11:33.301452] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T02:11:33.490123] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-17T02:11:34.290153] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-11. [2025-09-17T02:11:34.480607] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:11:34.507244] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T02:11:35.090123] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-17T02:11:35.869874] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T02:11:35.890086] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-17T02:11:36.224216] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:11:36.230166] [INFO ] [REMOTE ] AWK: Full fetch complete (70331 records). [2025-09-17T02:11:36.230338] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-17T02:11:36.615818] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-17T02:11:36.615919] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-17T02:11:36.616665] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-17T02:11:36.616721] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-17T02:11:36.618064] [DEBUG] [LOCAL ] AWK: Trimmed 70331 records to 48881 (keeping 200 days of data) [2025-09-17T02:11:36.711443] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-17T02:11:36.874314] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T02:11:36.970600] [DEBUG] [LOCAL ] AWK: Primary data saved (48881 records). [2025-09-17T02:11:36.970825] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-17T02:11:36.970954] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWK took 41.6s. Estimated remaining: 5h 10m 5s. Rate: 7.0 symbols/min [2025-09-17T02:11:37.147874] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:37.191098] [DEBUG] [LOCAL ] AXP: Loaded 39661 existing records from primary storage. [2025-09-17T02:11:37.191287] [INFO ] [MAIN ] AXP: Loaded 39661 existing records. [2025-09-17T02:11:37.377030] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:37.377333] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-17T02:11:37.377414] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-17T02:11:37.379397] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-17T02:11:37.379475] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-17T02:11:37.490118] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-17T02:11:37.773106] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:38.290148] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-17T02:11:38.409136] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:11:38.883537] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T02:11:39.090166] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-17T02:11:39.224014] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T02:11:39.890133] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-17T02:11:40.330745] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:11:40.690135] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-17T02:11:40.978103] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T02:11:41.490136] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-17T02:11:42.063632] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:11:42.290101] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-11. [2025-09-17T02:11:42.758413] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:11:43.090128] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-17T02:11:43.890113] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-17T02:11:44.052900] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T02:11:44.090143] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T02:11:44.690149] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-17T02:11:44.814269] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T02:11:45.490130] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-17T02:11:45.682293] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T02:11:46.290128] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-17T02:11:46.828703] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T02:11:47.090146] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-17T02:11:47.386454] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T02:11:47.890154] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-17T02:11:48.690111] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-17T02:11:48.875391] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T02:11:48.894265] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:11:48.897738] [INFO ] [REMOTE ] AWR: Full fetch complete (31475 records). [2025-09-17T02:11:48.897835] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-17T02:11:49.272298] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-17T02:11:49.272423] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-17T02:11:49.272923] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-17T02:11:49.272986] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-17T02:11:49.273981] [DEBUG] [LOCAL ] AWR: Trimmed 31475 records to 22408 (keeping 200 days of data) [2025-09-17T02:11:49.425451] [DEBUG] [LOCAL ] AWR: Primary data saved (22408 records). [2025-09-17T02:11:49.425612] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-17T02:11:49.425723] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWR took 33.7s. Estimated remaining: 5h 10m 40s. Rate: 7.0 symbols/min [2025-09-17T02:11:49.499374] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-17T02:11:49.598673] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:49.602698] [DEBUG] [LOCAL ] AXR: Loaded 2150 existing records from primary storage. [2025-09-17T02:11:49.602795] [INFO ] [MAIN ] AXR: Loaded 2150 existing records. [2025-09-17T02:11:49.777832] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:49.778096] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-17T02:11:49.778155] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-17T02:11:49.778539] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-17T02:11:49.778604] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-17T02:11:50.129580] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:50.290134] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-11. [2025-09-17T02:11:50.742676] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T02:11:50.822726] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T02:11:51.090183] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-17T02:11:51.290125] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:11:51.890108] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-17T02:11:52.297177] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:11:52.690148] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-17T02:11:53.352397] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T02:11:53.490136] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-17T02:11:54.290131] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-17T02:11:54.835494] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T02:11:54.930805] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:11:55.090091] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-17T02:11:55.483558] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:11:55.487576] [INFO ] [REMOTE ] AX: Full fetch complete (42532 records). [2025-09-17T02:11:55.487714] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-17T02:11:55.865377] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-17T02:11:55.865504] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-17T02:11:55.866008] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-17T02:11:55.866077] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-17T02:11:55.867040] [DEBUG] [LOCAL ] AX: Trimmed 42532 records to 28693 (keeping 200 days of data) [2025-09-17T02:11:55.922257] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-17T02:11:56.045128] [DEBUG] [LOCAL ] AX: Primary data saved (28693 records). [2025-09-17T02:11:56.045293] [INFO ] [MAIN ] AX: Full history saved. [2025-09-17T02:11:56.045405] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 32.5s. Estimated remaining: 5h 10m 10s. Rate: 7.0 symbols/min [2025-09-17T02:11:56.228482] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:56.228733] [DEBUG] [LOCAL ] AXS: No existing data file found in primary storage. [2025-09-17T02:11:56.228804] [WARN ] [MAIN ] AXS: No existing data found, performing full refresh instead. [2025-09-17T02:11:56.228965] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-17T02:11:56.229042] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-17T02:11:56.229114] [DEBUG] [LOCAL ] AXS: No primary data file found to delete. [2025-09-17T02:11:56.229174] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-17T02:11:56.612804] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:56.690094] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-11. [2025-09-17T02:11:56.735791] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T02:11:56.960197] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T02:11:57.490145] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-17T02:11:57.927626] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T02:11:58.119597] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:11:58.290176] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-17T02:11:59.090126] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-17T02:11:59.757506] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T02:11:59.890130] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-17T02:12:00.690123] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-17T02:12:01.005721] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:12:01.103518] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T02:12:01.384028] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:12:01.490066] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-17T02:12:02.290179] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-17T02:12:02.341294] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T02:12:03.090261] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-17T02:12:03.890189] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-17T02:12:04.505479] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:12:04.649705] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T02:12:04.690108] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-17T02:12:05.247127] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-09-17T02:12:05.263228] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T02:12:05.490138] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-17T02:12:06.290149] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-17T02:12:07.090137] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-17T02:12:07.812533] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:12:07.856059] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T02:12:07.890088] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-17T02:12:08.690173] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-17T02:12:08.873609] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:12:09.041501] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T02:12:09.490122] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-17T02:12:09.932237] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T02:12:10.070851] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T02:12:10.290113] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-17T02:12:11.090205] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-17T02:12:11.890181] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-17T02:12:12.211490] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T02:12:12.642526] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T02:12:12.690091] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-17T02:12:13.465068] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:12:13.471628] [INFO ] [REMOTE ] AXL: Full fetch complete (72105 records). [2025-09-17T02:12:13.471803] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-17T02:12:13.495230] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-17T02:12:13.884685] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-17T02:12:13.884816] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-17T02:12:13.885606] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-17T02:12:13.885704] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-17T02:12:13.887180] [DEBUG] [LOCAL ] AXL: Trimmed 72105 records to 50534 (keeping 200 days of data) [2025-09-17T02:12:14.164604] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T02:12:14.194520] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:12:14.211904] [DEBUG] [LOCAL ] AXL: Primary data saved (50534 records). [2025-09-17T02:12:14.212082] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-17T02:12:14.212179] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 42.4s. Estimated remaining: 5h 11m 48s. Rate: 7.0 symbols/min [2025-09-17T02:12:14.295220] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-17T02:12:14.387441] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:14.387722] [DEBUG] [LOCAL ] AXTA: No existing data file found in primary storage. [2025-09-17T02:12:14.387804] [WARN ] [MAIN ] AXTA: No existing data found, performing full refresh instead. [2025-09-17T02:12:14.387943] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-17T02:12:14.387999] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-17T02:12:14.388063] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-09-17T02:12:14.388108] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-17T02:12:14.750949] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:15.090135] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-17T02:12:15.890153] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-17T02:12:16.690899] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-11. [2025-09-17T02:12:16.693135] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-17T02:12:17.192829] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:12:17.193890] [INFO ] [REMOTE ] AXR: Full fetch complete (4938 records). [2025-09-17T02:12:17.193973] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-17T02:12:17.495232] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-17T02:12:17.552245] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-17T02:12:17.552341] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-17T02:12:17.552498] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-17T02:12:17.552546] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-17T02:12:17.552938] [DEBUG] [LOCAL ] AXR: Trimmed 4938 records to 3125 (keeping 200 days of data) [2025-09-17T02:12:17.571762] [DEBUG] [LOCAL ] AXR: Primary data saved (3125 records). [2025-09-17T02:12:17.571862] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-17T02:12:17.571945] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXR took 28.1s. Estimated remaining: 5h 10m 41s. Rate: 7.0 symbols/min [2025-09-17T02:12:17.868559] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-17T02:12:18.290179] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-17T02:12:18.473998] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T02:12:19.078823] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:12:19.090065] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-17T02:12:19.890146] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-17T02:12:20.063625] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:12:20.546227] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:12:20.690128] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-17T02:12:21.485776] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:12:21.495537] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-17T02:12:21.746319] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:12:21.751133] [INFO ] [REMOTE ] AXS: Full fetch complete (55143 records). [2025-09-17T02:12:21.751262] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-17T02:12:22.141662] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-17T02:12:22.141773] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-17T02:12:22.142398] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-17T02:12:22.142458] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-17T02:12:22.143604] [DEBUG] [LOCAL ] AXS: Trimmed 55143 records to 38288 (keeping 200 days of data) [2025-09-17T02:12:22.324366] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-17T02:12:22.392936] [DEBUG] [LOCAL ] AXS: Primary data saved (38288 records). [2025-09-17T02:12:22.393120] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-17T02:12:22.393205] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXS took 26.3s. Estimated remaining: 5h 9m 51s. Rate: 7.0 symbols/min [2025-09-17T02:12:22.958386] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T02:12:22.964974] [INFO ] [REMOTE ] AXP: Full fetch complete (76792 records). [2025-09-17T02:12:22.965124] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-17T02:12:23.368503] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-17T02:12:23.368624] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-17T02:12:23.369412] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-17T02:12:23.369476] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-17T02:12:23.371117] [DEBUG] [LOCAL ] AXP: Trimmed 76792 records to 53258 (keeping 200 days of data) [2025-09-17T02:12:23.730424] [DEBUG] [LOCAL ] AXP: Primary data saved (53258 records). [2025-09-17T02:12:23.730608] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-17T02:12:23.730723] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXP took 46.8s. Estimated remaining: 5h 8m 24s. Rate: 7.0 symbols/min [2025-09-17T02:12:24.033921] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:12:24.044749] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-17T02:12:25.286915] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T02:12:25.297368] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-17T02:12:26.970279] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T02:12:26.981471] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-17T02:12:29.119405] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T02:12:29.130549] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-17T02:12:30.796860] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:12:30.808705] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-17T02:12:32.044232] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T02:12:32.055275] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-17T02:12:34.005098] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:12:34.017150] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-17T02:12:35.718782] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T02:12:35.729966] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-17T02:12:37.361546] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T02:12:37.367931] [INFO ] [REMOTE ] AXTA: Full fetch complete (74458 records). [2025-09-17T02:12:37.368088] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-17T02:12:37.755518] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-17T02:12:37.755664] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-17T02:12:37.756476] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-17T02:12:37.756565] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-17T02:12:37.758129] [DEBUG] [LOCAL ] AXTA: Trimmed 74458 records to 52032 (keeping 200 days of data) [2025-09-17T02:12:38.058674] [DEBUG] [LOCAL ] AXTA: Primary data saved (52032 records). [2025-09-17T02:12:38.058842] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-17T02:12:38.058978] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXTA took 23.8s. Estimated remaining: 5h 9m 18s. Rate: 7.0 symbols/min [2025-09-17T02:12:38.675631] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.704718] [DEBUG] [LOCAL ] AZO: No existing data file found in primary storage. [2025-09-17T02:12:38.704581] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.728733] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.753272] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.751463] [WARN ] [MAIN ] AZO: No existing data found, performing full refresh instead. [2025-09-17T02:12:38.753672] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-09-17T02:12:38.753943] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-17T02:12:38.754026] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-17T02:12:38.753747] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-17T02:12:38.754108] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-09-17T02:12:38.754187] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-09-17T02:12:38.754254] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-17T02:12:38.754473] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-17T02:12:38.754435] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-17T02:12:38.796206] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-17T02:12:38.766855] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-17T02:12:38.833776] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-17T02:12:38.844234] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-17T02:12:38.863703] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-17T02:12:38.869490] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-17T02:12:38.965959] [DEBUG] [LOCAL ] AYI: Loaded 17656 existing records from primary storage. [2025-09-17T02:12:38.966013] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-17T02:12:39.051140] [INFO ] [MAIN ] AYI: Loaded 17656 existing records. [2025-09-17T02:12:39.784981] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:12:39.831177] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:39.908435] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-17T02:12:39.919090] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-11. [2025-09-17T02:12:39.971865] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:39.982211] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-17T02:12:40.046582] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-11. [2025-09-17T02:12:40.046083] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:40.047773] [INFO ] [REMOTE ] B: Fetching primary data for 2024-11. [2025-09-17T02:12:40.047822] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-17T02:12:40.048527] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-17T02:12:40.415094] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:40.415469] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-11. [2025-09-17T02:12:41.037068] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:12:41.040316] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-17T02:12:41.165439] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:12:41.172921] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-17T02:12:41.186013] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:12:41.190773] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-17T02:12:41.629242] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:12:41.634333] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-17T02:12:42.012062] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:12:42.016384] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-17T02:12:42.097867] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T02:12:42.101297] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-17T02:12:42.388582] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:12:42.397179] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-17T02:12:42.850961] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:12:42.856211] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-17T02:12:42.870368] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T02:12:42.872970] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-17T02:12:42.959589] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:12:42.964290] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-17T02:12:43.328899] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:12:43.335113] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-17T02:12:43.545114] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:12:43.545432] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-17T02:12:43.545891] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-17T02:12:43.579290] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T02:12:43.581517] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-17T02:12:43.766215] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:12:43.766527] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-17T02:12:43.766968] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-17T02:12:43.954132] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T02:12:43.960834] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-17T02:12:43.978512] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T02:12:43.983072] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:12:43.983909] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-17T02:12:44.633255] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T02:12:44.690098] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-17T02:12:44.859911] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T02:12:45.490151] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-17T02:12:46.290096] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-17T02:12:46.562912] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T02:12:46.618005] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T02:12:47.074826] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T02:12:47.090072] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-17T02:12:47.890140] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-17T02:12:47.997041] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:12:48.690136] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-17T02:12:49.490169] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-17T02:12:49.950439] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T02:12:50.037308] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:12:50.290156] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-17T02:12:50.362318] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T02:12:51.090165] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-17T02:12:51.890095] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-17T02:12:52.277196] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:12:52.327374] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T02:12:52.690174] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-17T02:12:52.981890] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T02:12:53.490121] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-17T02:12:53.769310] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T02:12:54.290136] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-17T02:12:55.090129] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-17T02:12:55.253578] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T02:12:55.645532] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:12:55.890100] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-17T02:12:56.206720] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:12:56.690127] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-17T02:12:57.490136] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-17T02:12:57.842269] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T02:12:57.954566] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T02:12:57.960996] [INFO ] [REMOTE ] B: Full fetch complete (43996 records). [2025-09-17T02:12:57.961117] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-17T02:12:58.156211] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-17T02:12:58.156747] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:12:58.156808] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:12:58.156864] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-17T02:12:58.156934] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-17T02:12:58.156984] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-17T02:12:58.157060] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-17T02:12:58.157140] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. B took 20.1s. Estimated remaining: 5h 11m 14s. Rate: 7.0 symbols/min [2025-09-17T02:12:58.304330] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-17T02:12:58.340923] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:58.382418] [DEBUG] [LOCAL ] BA: Loaded 40141 existing records from primary storage. [2025-09-17T02:12:58.382683] [INFO ] [MAIN ] BA: Loaded 40141 existing records. [2025-09-17T02:12:58.580497] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:12:58.580881] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-17T02:12:58.580955] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-17T02:12:58.582863] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-17T02:12:58.582944] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-17T02:12:58.945512] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:58.962888] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:12:59.023833] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T02:12:59.027820] [INFO ] [REMOTE ] AZZ: Full fetch complete (30630 records). [2025-09-17T02:12:59.027924] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-17T02:12:59.095183] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-17T02:12:59.419133] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-17T02:12:59.419274] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-17T02:12:59.420016] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-17T02:12:59.420130] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-17T02:12:59.421876] [DEBUG] [LOCAL ] AZZ: Trimmed 30630 records to 22142 (keeping 200 days of data) [2025-09-17T02:12:59.563929] [DEBUG] [LOCAL ] AZZ: Primary data saved (22142 records). [2025-09-17T02:12:59.564084] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-17T02:12:59.564207] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. AZZ took 21.5s. Estimated remaining: 5h 9m 48s. Rate: 7.0 symbols/min [2025-09-17T02:12:59.740704] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:59.784952] [DEBUG] [LOCAL ] BABA: Loaded 40170 existing records from primary storage. [2025-09-17T02:12:59.785122] [INFO ] [MAIN ] BABA: Loaded 40170 existing records. [2025-09-17T02:12:59.895215] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-11. [2025-09-17T02:12:59.967811] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:12:59.968062] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-17T02:12:59.968123] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-17T02:12:59.969756] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-17T02:12:59.969820] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-17T02:13:00.330694] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:00.340695] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T02:13:00.690162] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-17T02:13:01.490146] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-11. [2025-09-17T02:13:01.597015] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:13:02.290142] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-17T02:13:02.414903] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-17T02:13:03.090192] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-17T02:13:03.138379] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:13:03.890208] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-17T02:13:04.187032] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-11 (2.70 seconds). [2025-09-17T02:13:04.643329] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T02:13:04.645043] [INFO ] [REMOTE ] AZO: Full fetch complete (16539 records). [2025-09-17T02:13:04.645141] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-17T02:13:04.699318] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-17T02:13:05.022386] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-17T02:13:05.022504] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-17T02:13:05.022868] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-17T02:13:05.022971] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-17T02:13:05.023550] [DEBUG] [LOCAL ] AZO: Trimmed 16539 records to 11621 (keeping 200 days of data) [2025-09-17T02:13:05.101192] [DEBUG] [LOCAL ] AZO: Primary data saved (11621 records). [2025-09-17T02:13:05.101373] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-17T02:13:05.101491] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZO took 27.0s. Estimated remaining: 5h 9m 7s. Rate: 7.0 symbols/min [2025-09-17T02:13:05.276823] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:05.317463] [DEBUG] [LOCAL ] BAC: Loaded 40158 existing records from primary storage. [2025-09-17T02:13:05.317654] [INFO ] [MAIN ] BAC: Loaded 40158 existing records. [2025-09-17T02:13:05.492028] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-17T02:13:05.514613] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:05.516052] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-17T02:13:05.516198] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-17T02:13:05.517979] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-17T02:13:05.518061] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-17T02:13:05.879694] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:05.924832] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:13:05.932409] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-17T02:13:06.290149] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-17T02:13:07.090147] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-17T02:13:07.525081] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T02:13:07.867097] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-17T02:13:07.890102] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-17T02:13:08.690199] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-11. [2025-09-17T02:13:09.245770] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T02:13:09.490184] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-17T02:13:10.290211] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-17T02:13:10.398526] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T02:13:10.813070] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T02:13:11.090173] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-17T02:13:11.268610] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T02:13:11.271484] [INFO ] [REMOTE ] AYI: Full fetch complete (36903 records). [2025-09-17T02:13:11.271590] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-17T02:13:11.663502] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-17T02:13:11.663736] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-17T02:13:11.664591] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-17T02:13:11.664799] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-17T02:13:11.666814] [DEBUG] [LOCAL ] AYI: Trimmed 36903 records to 25758 (keeping 200 days of data) [2025-09-17T02:13:11.843192] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-17T02:13:11.894828] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-17T02:13:11.916636] [DEBUG] [LOCAL ] AYI: Primary data saved (25758 records). [2025-09-17T02:13:11.916895] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-17T02:13:11.917047] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AYI took 33.9s. Estimated remaining: 5h 8m 40s. Rate: 7.0 symbols/min [2025-09-17T02:13:12.095506] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:12.095766] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-09-17T02:13:12.095820] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-09-17T02:13:12.095934] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-17T02:13:12.095985] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-17T02:13:12.096033] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-17T02:13:12.096088] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-17T02:13:12.452313] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:12.690158] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-11. [2025-09-17T02:13:13.373282] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-17T02:13:13.490107] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-17T02:13:14.290151] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-17T02:13:14.414814] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-17T02:13:14.531160] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T02:13:15.090204] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-17T02:13:15.890236] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-17T02:13:16.225811] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-17T02:13:16.690158] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-17T02:13:16.750554] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-17T02:13:17.162560] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T02:13:17.490171] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-17T02:13:17.773067] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T02:13:18.290176] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-17T02:13:19.090211] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-17T02:13:19.346614] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-17T02:13:19.890169] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-17T02:13:20.075839] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-17T02:13:20.305381] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T02:13:20.690171] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-17T02:13:20.888026] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:13:21.490173] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-17T02:13:22.290205] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-17T02:13:22.586422] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-17T02:13:23.096269] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-17T02:13:23.122628] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-17T02:13:23.181377] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:13:23.890189] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-17T02:13:24.530835] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T02:13:24.690149] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-17T02:13:25.490125] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-17T02:13:25.648500] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T02:13:25.732087] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T02:13:26.290135] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-17T02:13:27.090164] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-17T02:13:27.269369] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-17T02:13:27.890109] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-17T02:13:27.970699] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T02:13:28.690121] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-17T02:13:28.754074] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:13:29.175417] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-17T02:13:29.490129] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-17T02:13:30.007491] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T02:13:30.290178] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-17T02:13:30.915518] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T02:13:31.090176] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-17T02:13:31.890168] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-17T02:13:32.188989] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-17T02:13:32.290406] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T02:13:32.690174] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-17T02:13:33.376218] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T02:13:33.490152] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-17T02:13:34.021918] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T02:13:34.298534] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-17T02:13:34.318667] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-17T02:13:35.090135] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-17T02:13:35.890172] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-17T02:13:36.094871] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-17T02:13:36.101417] [INFO ] [REMOTE ] BABA: Full fetch complete (77980 records). [2025-09-17T02:13:36.101573] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-17T02:13:36.531186] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-17T02:13:36.531836] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-17T02:13:36.533290] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T02:13:36.534297] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-17T02:13:36.534482] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-17T02:13:36.546560] [DEBUG] [LOCAL ] BABA: Trimmed 77980 records to 53820 (keeping 200 days of data) [2025-09-17T02:13:36.690229] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-17T02:13:36.926917] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-17T02:13:36.927092] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-17T02:13:36.927199] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BABA took 37.4s. Estimated remaining: 5h 11m 25s. Rate: 6.9 symbols/min [2025-09-17T02:13:37.099939] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:37.128791] [DEBUG] [LOCAL ] BAK: Loaded 29020 existing records from primary storage. [2025-09-17T02:13:37.128958] [INFO ] [MAIN ] BAK: Loaded 29020 existing records. [2025-09-17T02:13:37.307135] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:37.307421] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-17T02:13:37.307490] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-17T02:13:37.308393] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-17T02:13:37.308460] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-17T02:13:37.660536] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:37.660992] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-11. [2025-09-17T02:13:37.698060] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-17T02:13:38.140573] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-17T02:13:38.147365] [INFO ] [REMOTE ] BA: Full fetch complete (77904 records). [2025-09-17T02:13:38.147628] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-17T02:13:38.297784] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-17T02:13:38.549190] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T02:13:38.592377] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-17T02:13:38.592696] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-17T02:13:38.593669] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-17T02:13:38.593761] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-17T02:13:38.595742] [DEBUG] [LOCAL ] BA: Trimmed 77904 records to 53791 (keeping 200 days of data) [2025-09-17T02:13:38.934703] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-17T02:13:38.934868] [INFO ] [MAIN ] BA: Full history saved. [2025-09-17T02:13:38.934966] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BA took 40.8s. Estimated remaining: 5h 10m 7s. Rate: 7.0 symbols/min [2025-09-17T02:13:39.103593] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-17T02:13:39.105990] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:39.144397] [DEBUG] [LOCAL ] BALL: Loaded 38534 existing records from primary storage. [2025-09-17T02:13:39.144708] [INFO ] [MAIN ] BALL: Loaded 38534 existing records. [2025-09-17T02:13:39.363514] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:39.363974] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-17T02:13:39.364099] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-17T02:13:39.371740] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-17T02:13:39.384263] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-17T02:13:39.463386] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:13:39.763477] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:39.890195] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-11. [2025-09-17T02:13:40.696565] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-17T02:13:40.735765] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-17T02:13:40.748630] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:13:40.756456] [INFO ] [REMOTE ] BAH: Full fetch complete (74630 records). [2025-09-17T02:13:40.756719] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-17T02:13:41.160077] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-17T02:13:41.160197] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-17T02:13:41.161017] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-17T02:13:41.161080] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-17T02:13:41.162566] [DEBUG] [LOCAL ] BAH: Trimmed 74630 records to 51820 (keeping 200 days of data) [2025-09-17T02:13:41.490149] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-17T02:13:41.520359] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:13:41.544374] [DEBUG] [LOCAL ] BAH: Primary data saved (51820 records). [2025-09-17T02:13:41.544534] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-17T02:13:41.544626] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAH took 29.6s. Estimated remaining: 5h 8m 56s. Rate: 7.0 symbols/min [2025-09-17T02:13:41.714283] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:41.723284] [DEBUG] [LOCAL ] BALY: Loaded 7203 existing records from primary storage. [2025-09-17T02:13:41.723455] [INFO ] [MAIN ] BALY: Loaded 7203 existing records. [2025-09-17T02:13:41.910920] [WARN ] [MAIN ] BALY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:41.911239] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-17T02:13:41.911303] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-17T02:13:41.911739] [DEBUG] [LOCAL ] BALY: Deleted primary data file. [2025-09-17T02:13:41.911817] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-17T02:13:42.283112] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:42.295209] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-17T02:13:42.310969] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T02:13:43.090139] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-17T02:13:43.438760] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-17T02:13:43.445252] [INFO ] [REMOTE ] BAC: Full fetch complete (77933 records). [2025-09-17T02:13:43.445410] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-17T02:13:43.833232] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-17T02:13:43.833335] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-17T02:13:43.834100] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-17T02:13:43.834160] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-17T02:13:43.835662] [DEBUG] [LOCAL ] BAC: Trimmed 77933 records to 53808 (keeping 200 days of data) [2025-09-17T02:13:43.899166] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-11. [2025-09-17T02:13:44.116086] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T02:13:44.216895] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-17T02:13:44.217073] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-17T02:13:44.219667] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BAC took 39.1s. Estimated remaining: 5h 7m 46s. Rate: 7.0 symbols/min [2025-09-17T02:13:44.387350] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:44.428712] [DEBUG] [LOCAL ] BAM: Loaded 38634 existing records from primary storage. [2025-09-17T02:13:44.428899] [INFO ] [MAIN ] BAM: Loaded 38634 existing records. [2025-09-17T02:13:44.605078] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:44.605338] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-17T02:13:44.605391] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-17T02:13:44.606484] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-17T02:13:44.606546] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-17T02:13:44.707853] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-17T02:13:44.971795] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:44.993360] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T02:13:45.319983] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T02:13:45.490190] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-11. [2025-09-17T02:13:46.290137] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-17T02:13:46.510993] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:13:46.677462] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:13:47.090126] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-17T02:13:47.351860] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:13:47.890122] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-17T02:13:48.292148] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:13:48.690116] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-17T02:13:49.490150] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-17T02:13:49.673318] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:13:50.138368] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:13:50.290120] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-17T02:13:51.090145] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-17T02:13:51.135038] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:13:51.789869] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T02:13:51.848109] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T02:13:51.890170] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-17T02:13:52.690160] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-17T02:13:53.204051] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T02:13:53.490198] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-17T02:13:54.290150] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-17T02:13:54.585017] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:13:54.942712] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T02:13:55.090154] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-17T02:13:55.655950] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:13:55.890137] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-17T02:13:56.600536] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T02:13:56.660843] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T02:13:56.690126] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-17T02:13:57.173395] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T02:13:57.490141] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-17T02:13:58.290123] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-17T02:13:59.090092] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-17T02:13:59.201189] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T02:13:59.808886] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T02:13:59.890117] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-17T02:14:00.635983] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T02:14:00.690145] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-17T02:14:01.490141] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-17T02:14:01.830990] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T02:14:01.855160] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T02:14:01.860173] [INFO ] [REMOTE ] BAK: Full fetch complete (56982 records). [2025-09-17T02:14:01.860306] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-17T02:14:02.159542] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T02:14:02.254505] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-17T02:14:02.254631] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-17T02:14:02.255319] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-17T02:14:02.255380] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-17T02:14:02.256726] [DEBUG] [LOCAL ] BAK: Trimmed 56982 records to 38907 (keeping 200 days of data) [2025-09-17T02:14:02.304255] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-17T02:14:02.485832] [DEBUG] [LOCAL ] BAK: Primary data saved (38907 records). [2025-09-17T02:14:02.486019] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-17T02:14:02.486134] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 25.6s. Estimated remaining: 5h 9m 18s. Rate: 7.0 symbols/min [2025-09-17T02:14:02.660346] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:02.698098] [DEBUG] [LOCAL ] BANC: Loaded 37899 existing records from primary storage. [2025-09-17T02:14:02.698269] [INFO ] [MAIN ] BANC: Loaded 37899 existing records. [2025-09-17T02:14:02.875488] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:02.875784] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-17T02:14:02.875850] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-17T02:14:02.877095] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-17T02:14:02.877157] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-17T02:14:03.097363] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-17T02:14:03.245034] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T02:14:03.265054] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:03.890150] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-11. [2025-09-17T02:14:04.690712] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-17T02:14:04.693257] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T02:14:05.490169] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-17T02:14:05.514543] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T02:14:05.573804] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T02:14:06.290192] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-17T02:14:07.090190] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-17T02:14:07.332823] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T02:14:07.575969] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:14:07.890196] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-17T02:14:07.978431] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T02:14:08.690156] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-17T02:14:09.371973] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T02:14:09.490136] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-17T02:14:09.776321] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T02:14:10.290168] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-17T02:14:10.969363] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:14:10.970993] [INFO ] [REMOTE ] BALY: Full fetch complete (17749 records). [2025-09-17T02:14:10.971097] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-17T02:14:11.093367] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-17T02:14:11.158635] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T02:14:11.159004] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:14:11.159151] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:14:11.159250] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-17T02:14:11.159411] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-17T02:14:11.159468] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-17T02:14:11.159865] [DEBUG] [LOCAL ] BALY: Deleted derivative data file. [2025-09-17T02:14:11.160017] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BALY took 29.6s. Estimated remaining: 5h 9m 10s. Rate: 7.0 symbols/min [2025-09-17T02:14:11.356715] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:11.358670] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T02:14:11.387372] [DEBUG] [LOCAL ] BAP: Loaded 19126 existing records from primary storage. [2025-09-17T02:14:11.387530] [INFO ] [MAIN ] BAP: Loaded 19126 existing records. [2025-09-17T02:14:11.570347] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:11.570615] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-17T02:14:11.570696] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-17T02:14:11.571484] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-17T02:14:11.571554] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-17T02:14:11.906130] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-17T02:14:11.946262] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:12.296895] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:14:12.690167] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-17T02:14:13.490155] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-11. [2025-09-17T02:14:13.735524] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:14:14.290114] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-17T02:14:14.644896] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:14:14.677979] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T02:14:15.090173] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-17T02:14:15.730398] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:14:15.890217] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-17T02:14:16.690158] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-17T02:14:16.766614] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:14:17.490136] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-17T02:14:17.783123] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:14:17.940797] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T02:14:18.290183] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-17T02:14:19.098134] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-17T02:14:19.103584] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:14:19.648956] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T02:14:19.658631] [INFO ] [REMOTE ] BALL: Full fetch complete (75123 records). [2025-09-17T02:14:19.658885] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-17T02:14:19.895373] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-17T02:14:20.065584] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-17T02:14:20.065739] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-17T02:14:20.066586] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-17T02:14:20.066692] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-17T02:14:20.068297] [DEBUG] [LOCAL ] BALL: Trimmed 75123 records to 51856 (keeping 200 days of data) [2025-09-17T02:14:20.191884] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T02:14:20.403907] [DEBUG] [LOCAL ] BALL: Primary data saved (51856 records). [2025-09-17T02:14:20.404075] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-17T02:14:20.404171] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BALL took 41.5s. Estimated remaining: 5h 9m 8s. Rate: 7.0 symbols/min [2025-09-17T02:14:20.582284] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:20.610793] [DEBUG] [LOCAL ] BARK: Loaded 28629 existing records from primary storage. [2025-09-17T02:14:20.610962] [INFO ] [MAIN ] BARK: Loaded 28629 existing records. [2025-09-17T02:14:20.695245] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-17T02:14:20.800883] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:20.801122] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-17T02:14:20.801180] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-17T02:14:20.802177] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-17T02:14:20.802241] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-17T02:14:21.159524] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:21.490133] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-17T02:14:21.618524] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T02:14:21.650033] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T02:14:22.290147] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-17T02:14:23.090103] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-17T02:14:23.153592] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T02:14:23.890218] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-11. [2025-09-17T02:14:24.273931] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T02:14:24.352965] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T02:14:24.690147] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-17T02:14:25.032374] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:14:25.490162] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-17T02:14:26.193536] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:14:26.200106] [INFO ] [REMOTE ] BAM: Full fetch complete (73673 records). [2025-09-17T02:14:26.200282] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-17T02:14:26.296529] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-17T02:14:26.627435] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-17T02:14:26.627562] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-17T02:14:26.628343] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-17T02:14:26.628408] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-17T02:14:26.630134] [DEBUG] [LOCAL ] BAM: Trimmed 73673 records to 52019 (keeping 200 days of data) [2025-09-17T02:14:26.962554] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T02:14:26.987105] [DEBUG] [LOCAL ] BAM: Primary data saved (52019 records). [2025-09-17T02:14:26.987384] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-17T02:14:26.988799] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BAM took 42.8s. Estimated remaining: 5h 8m 39s. Rate: 7.0 symbols/min [2025-09-17T02:14:27.096402] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-17T02:14:27.169483] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:27.217134] [DEBUG] [LOCAL ] BAX: Loaded 39905 existing records from primary storage. [2025-09-17T02:14:27.217317] [INFO ] [MAIN ] BAX: Loaded 39905 existing records. [2025-09-17T02:14:27.417171] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:27.417445] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-17T02:14:27.417504] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-17T02:14:27.418820] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-17T02:14:27.418883] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-17T02:14:27.771583] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:27.890111] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-11. [2025-09-17T02:14:28.107844] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T02:14:28.391733] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T02:14:28.690136] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-17T02:14:29.490138] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-17T02:14:29.675668] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:14:29.838295] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:14:30.290119] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-17T02:14:31.090132] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-17T02:14:31.265920] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T02:14:31.446492] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T02:14:31.890131] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-17T02:14:32.395558] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T02:14:32.690102] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-17T02:14:33.042617] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T02:14:33.490137] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-17T02:14:34.238623] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:14:34.290111] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-17T02:14:35.017353] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:14:35.090098] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-17T02:14:35.495498] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T02:14:35.499520] [INFO ] [REMOTE ] BAP: Full fetch complete (37935 records). [2025-09-17T02:14:35.499656] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-17T02:14:35.885603] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-17T02:14:35.885745] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-17T02:14:35.886335] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-17T02:14:35.886407] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-17T02:14:35.887454] [DEBUG] [LOCAL ] BAP: Trimmed 37935 records to 26418 (keeping 200 days of data) [2025-09-17T02:14:35.942138] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-17T02:14:36.051914] [DEBUG] [LOCAL ] BAP: Primary data saved (26418 records). [2025-09-17T02:14:36.052075] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-17T02:14:36.052167] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BAP took 24.9s. Estimated remaining: 5h 8m 36s. Rate: 7.0 symbols/min [2025-09-17T02:14:36.226100] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:36.267251] [DEBUG] [LOCAL ] BB: Loaded 39362 existing records from primary storage. [2025-09-17T02:14:36.267421] [INFO ] [MAIN ] BB: Loaded 39362 existing records. [2025-09-17T02:14:36.451176] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:36.451460] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-17T02:14:36.451522] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-17T02:14:36.452777] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-17T02:14:36.452842] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-17T02:14:36.698792] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-17T02:14:36.830826] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:36.860831] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:14:37.401547] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:14:37.490128] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-11. [2025-09-17T02:14:38.290115] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-17T02:14:38.414581] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:14:39.090123] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-17T02:14:39.404878] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:14:39.786685] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T02:14:39.890142] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-17T02:14:40.690164] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-17T02:14:40.819608] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:14:41.333135] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:14:41.490156] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-17T02:14:42.290153] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-17T02:14:42.323766] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T02:14:42.332908] [INFO ] [REMOTE ] BANC: Full fetch complete (73868 records). [2025-09-17T02:14:42.333157] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-17T02:14:42.749710] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-17T02:14:42.749857] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-17T02:14:42.750743] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-17T02:14:42.750814] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-17T02:14:42.752514] [DEBUG] [LOCAL ] BANC: Trimmed 73868 records to 51263 (keeping 200 days of data) [2025-09-17T02:14:43.074374] [DEBUG] [LOCAL ] BANC: Primary data saved (51263 records). [2025-09-17T02:14:43.074596] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-17T02:14:43.074733] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BANC took 40.6s. Estimated remaining: 5h 8m 11s. Rate: 7.0 symbols/min [2025-09-17T02:14:43.095859] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-17T02:14:43.272246] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:43.345108] [DEBUG] [LOCAL ] BBAI: Loaded 40170 existing records from primary storage. [2025-09-17T02:14:43.347298] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T02:14:43.347598] [INFO ] [MAIN ] BBAI: Loaded 40170 existing records. [2025-09-17T02:14:43.544254] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:43.555671] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-17T02:14:43.573142] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-17T02:14:43.575163] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:14:43.575249] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-17T02:14:43.585974] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-17T02:14:43.903960] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-17T02:14:43.942777] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:44.690128] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-11. [2025-09-17T02:14:45.267373] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-17T02:14:45.490177] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-17T02:14:45.846284] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T02:14:46.290187] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-17T02:14:46.420052] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:14:47.063196] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:14:47.090101] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-17T02:14:47.756398] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T02:14:47.890141] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-17T02:14:48.690131] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-17T02:14:48.947155] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:14:49.495209] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-17T02:14:49.513398] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T02:14:50.290216] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-17T02:14:50.434283] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T02:14:51.090142] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-17T02:14:51.890129] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-17T02:14:52.088000] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-17T02:14:52.340415] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T02:14:52.690134] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-17T02:14:53.044566] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:14:53.092262] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T02:14:53.490132] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-17T02:14:54.290131] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-17T02:14:54.669172] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T02:14:55.090134] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-17T02:14:55.370477] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T02:14:55.890126] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-17T02:14:56.096089] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-17T02:14:56.690144] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-17T02:14:57.097906] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T02:14:57.121617] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:14:57.126047] [INFO ] [REMOTE ] BARK: Full fetch complete (57380 records). [2025-09-17T02:14:57.126171] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-17T02:14:57.492489] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-17T02:14:57.509999] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-17T02:14:57.510090] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-17T02:14:57.510729] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-17T02:14:57.510868] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-17T02:14:57.512130] [DEBUG] [LOCAL ] BARK: Trimmed 57380 records to 38682 (keeping 200 days of data) [2025-09-17T02:14:57.733928] [DEBUG] [LOCAL ] BARK: Primary data saved (38682 records). [2025-09-17T02:14:57.734104] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-17T02:14:57.734252] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BARK took 37.3s. Estimated remaining: 5h 9m 4s. Rate: 7.0 symbols/min [2025-09-17T02:14:57.901435] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:57.931688] [DEBUG] [LOCAL ] BBAR: Loaded 30859 existing records from primary storage. [2025-09-17T02:14:57.931850] [INFO ] [MAIN ] BBAR: Loaded 30859 existing records. [2025-09-17T02:14:58.112862] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:58.113229] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-17T02:14:58.113314] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-17T02:14:58.114388] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-17T02:14:58.114483] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-17T02:14:58.297008] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-17T02:14:58.472341] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:58.774277] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T02:14:59.051551] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:14:59.090146] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-11. [2025-09-17T02:14:59.890145] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-17T02:15:00.061639] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T02:15:00.070576] [INFO ] [REMOTE ] BAX: Full fetch complete (77275 records). [2025-09-17T02:15:00.070907] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-17T02:15:00.523432] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-17T02:15:00.523561] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-17T02:15:00.524680] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-17T02:15:00.524760] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-17T02:15:00.526350] [DEBUG] [LOCAL ] BAX: Trimmed 77275 records to 53491 (keeping 200 days of data) [2025-09-17T02:15:00.733082] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-17T02:15:00.789099] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:15:00.912946] [DEBUG] [LOCAL ] BAX: Primary data saved (53491 records). [2025-09-17T02:15:00.913131] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-17T02:15:00.913911] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BAX took 33.9s. Estimated remaining: 5h 8m 1s. Rate: 7.0 symbols/min [2025-09-17T02:15:01.084690] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:01.126892] [DEBUG] [LOCAL ] BBD: Loaded 39702 existing records from primary storage. [2025-09-17T02:15:01.127063] [INFO ] [MAIN ] BBD: Loaded 39702 existing records. [2025-09-17T02:15:01.304892] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:01.305161] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-17T02:15:01.305221] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-17T02:15:01.306400] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-17T02:15:01.306464] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-17T02:15:01.494918] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-17T02:15:01.732368] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:02.290119] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-11. [2025-09-17T02:15:02.335497] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-17T02:15:03.090190] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-17T02:15:04.205609] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (3.47 seconds). [2025-09-17T02:15:04.218092] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-17T02:15:04.241948] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-17T02:15:04.690238] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-17T02:15:05.429449] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-11 (3.14 seconds). [2025-09-17T02:15:05.490149] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-17T02:15:05.559663] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-17T02:15:06.290133] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-17T02:15:06.568701] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T02:15:07.074264] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:15:07.090456] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-17T02:15:07.473484] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-09-17T02:15:07.890180] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-17T02:15:08.226992] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:15:08.592741] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:15:08.690225] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-17T02:15:09.490134] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-17T02:15:09.761334] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:15:10.290185] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-17T02:15:10.529056] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T02:15:10.535561] [INFO ] [REMOTE ] BB: Full fetch complete (76853 records). [2025-09-17T02:15:10.535759] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-17T02:15:10.932063] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-17T02:15:10.932180] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-17T02:15:10.933176] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-17T02:15:10.933305] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-17T02:15:10.934835] [DEBUG] [LOCAL ] BB: Trimmed 76853 records to 52930 (keeping 200 days of data) [2025-09-17T02:15:11.042114] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:15:11.130202] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-17T02:15:11.279912] [DEBUG] [LOCAL ] BB: Primary data saved (52930 records). [2025-09-17T02:15:11.280082] [INFO ] [MAIN ] BB: Full history saved. [2025-09-17T02:15:11.280810] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BB took 35.2s. Estimated remaining: 5h 8m 10s. Rate: 7.0 symbols/min [2025-09-17T02:15:11.457949] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:11.483880] [DEBUG] [LOCAL ] BBDC: Loaded 23506 existing records from primary storage. [2025-09-17T02:15:11.484060] [INFO ] [MAIN ] BBDC: Loaded 23506 existing records. [2025-09-17T02:15:11.670757] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:11.671039] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-17T02:15:11.671105] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-17T02:15:11.671884] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-17T02:15:11.671963] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-17T02:15:11.896770] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-17T02:15:12.050406] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:12.082421] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:15:12.690185] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-17T02:15:12.823746] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:15:13.490138] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-17T02:15:14.290148] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-11. [2025-09-17T02:15:14.438507] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T02:15:14.686906] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-17T02:15:14.724059] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T02:15:15.090147] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-17T02:15:15.581096] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T02:15:15.890158] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-17T02:15:16.360031] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:15:16.690144] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-17T02:15:17.340338] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:15:17.490154] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-17T02:15:18.290245] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-17T02:15:19.090138] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-17T02:15:20.089799] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (3.40 seconds). [2025-09-17T02:15:20.101519] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-17T02:15:20.600192] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-09-17T02:15:20.647185] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T02:15:20.690125] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-17T02:15:20.970360] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T02:15:21.490154] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-17T02:15:22.290155] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-17T02:15:22.543665] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:15:22.602693] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-17T02:15:22.742042] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:15:23.090140] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-17T02:15:23.343179] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:15:23.890155] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-17T02:15:24.690123] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-17T02:15:24.781540] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T02:15:25.441530] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:15:25.490146] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-17T02:15:25.789266] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T02:15:25.795122] [INFO ] [REMOTE ] BBAR: Full fetch complete (60190 records). [2025-09-17T02:15:25.795298] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-17T02:15:26.185589] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-17T02:15:26.185720] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-17T02:15:26.186352] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-17T02:15:26.186433] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-17T02:15:26.187713] [DEBUG] [LOCAL ] BBAR: Trimmed 60190 records to 40983 (keeping 200 days of data) [2025-09-17T02:15:26.290204] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-17T02:15:26.455805] [DEBUG] [LOCAL ] BBAR: Primary data saved (40983 records). [2025-09-17T02:15:26.455969] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-17T02:15:26.456111] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBAR took 28.7s. Estimated remaining: 5h 9m 6s. Rate: 7.0 symbols/min [2025-09-17T02:15:26.637280] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:26.642625] [DEBUG] [LOCAL ] BBDO: Loaded 3607 existing records from primary storage. [2025-09-17T02:15:26.642753] [INFO ] [MAIN ] BBDO: Loaded 3607 existing records. [2025-09-17T02:15:26.826818] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:26.827098] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-17T02:15:26.827172] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-17T02:15:26.827463] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-17T02:15:26.827536] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-17T02:15:27.101237] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-17T02:15:27.186323] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:27.836325] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-17T02:15:27.890097] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-17T02:15:28.206288] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:15:28.665761] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:15:28.690094] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-17T02:15:29.490131] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-17T02:15:29.812110] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:15:29.970891] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T02:15:29.977401] [INFO ] [REMOTE ] BBAI: Full fetch complete (77974 records). [2025-09-17T02:15:29.977609] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-17T02:15:30.295211] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-11. [2025-09-17T02:15:30.371678] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-17T02:15:30.371793] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-17T02:15:30.372635] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-17T02:15:30.372723] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-17T02:15:30.374318] [DEBUG] [LOCAL ] BBAI: Trimmed 77974 records to 53820 (keeping 200 days of data) [2025-09-17T02:15:30.699599] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-17T02:15:30.699787] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-17T02:15:30.699897] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAI took 47.6s. Estimated remaining: 5h 8m 15s. Rate: 7.0 symbols/min [2025-09-17T02:15:30.805882] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T02:15:30.878412] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:30.896236] [DEBUG] [LOCAL ] BBN: Loaded 13520 existing records from primary storage. [2025-09-17T02:15:30.896400] [INFO ] [MAIN ] BBN: Loaded 13520 existing records. [2025-09-17T02:15:31.075574] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:31.075876] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-17T02:15:31.075946] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-17T02:15:31.076615] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-17T02:15:31.076715] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-17T02:15:31.097126] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-17T02:15:31.442395] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:31.477128] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:15:31.890147] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-11. [2025-09-17T02:15:31.922195] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:15:32.690123] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-17T02:15:32.980488] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:15:33.490139] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-17T02:15:34.261576] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:15:34.290106] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-17T02:15:34.754828] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:15:35.090148] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-17T02:15:35.867204] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T02:15:35.873759] [INFO ] [REMOTE ] BBD: Full fetch complete (77001 records). [2025-09-17T02:15:35.873924] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-17T02:15:35.895782] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-17T02:15:36.286361] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-17T02:15:36.286531] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-17T02:15:36.287789] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-17T02:15:36.287896] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-17T02:15:36.289601] [DEBUG] [LOCAL ] BBD: Trimmed 77001 records to 53176 (keeping 200 days of data) [2025-09-17T02:15:36.418259] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:15:36.657352] [DEBUG] [LOCAL ] BBD: Primary data saved (53176 records). [2025-09-17T02:15:36.657528] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-17T02:15:36.659422] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 35.7s. Estimated remaining: 5h 7m 40s. Rate: 7.0 symbols/min [2025-09-17T02:15:36.695245] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-17T02:15:36.829808] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:36.829983] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-17T02:15:36.830024] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-17T02:15:36.830126] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-17T02:15:36.830176] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-17T02:15:36.830226] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-17T02:15:36.830286] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-17T02:15:37.134803] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:15:37.210827] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:37.490131] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-17T02:15:38.059997] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T02:15:38.060564] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T02:15:38.290182] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-17T02:15:39.092017] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-17T02:15:39.094579] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:15:39.890148] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-17T02:15:40.324533] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:15:40.331802] [INFO ] [REMOTE ] BBDC: Full fetch complete (48989 records). [2025-09-17T02:15:40.331949] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-17T02:15:40.693799] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-11. [2025-09-17T02:15:40.695083] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T02:15:40.733857] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-17T02:15:40.733966] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-17T02:15:40.734576] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-17T02:15:40.734637] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-17T02:15:40.735753] [DEBUG] [LOCAL ] BBDC: Trimmed 48989 records to 33544 (keeping 200 days of data) [2025-09-17T02:15:40.937808] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:40.940812] [DEBUG] [LOCAL ] BBDC: Primary data saved (33544 records). [2025-09-17T02:15:40.940750] [WARN ] [REMOTE ] BBT: No data returned for month 2024-11 [2025-09-17T02:15:40.941341] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-17T02:15:40.941435] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBDC took 29.7s. Estimated remaining: 5h 6m 50s. Rate: 7.0 symbols/min [2025-09-17T02:15:41.111367] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:41.116181] [DEBUG] [LOCAL ] BBU: Loaded 3205 existing records from primary storage. [2025-09-17T02:15:41.116277] [INFO ] [MAIN ] BBU: Loaded 3205 existing records. [2025-09-17T02:15:41.293466] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:41.293746] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-17T02:15:41.293808] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-17T02:15:41.294130] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-17T02:15:41.294190] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-17T02:15:41.495199] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-17T02:15:41.649231] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:42.290115] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-17T02:15:42.505783] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:42.506201] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-17T02:15:42.636835] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:15:43.090155] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-17T02:15:43.300500] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:43.300930] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-17T02:15:43.890152] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-17T02:15:44.690183] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-11. [2025-09-17T02:15:44.967542] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T02:15:45.286510] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T02:15:45.490135] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-17T02:15:46.290109] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-17T02:15:46.512565] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:46.512952] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-17T02:15:46.589806] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:15:47.090148] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-17T02:15:47.751608] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:15:47.890132] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-17T02:15:48.560801] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T02:15:48.690130] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-17T02:15:48.899140] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:48.899476] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-17T02:15:49.490185] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-17T02:15:49.699974] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:49.700361] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-17T02:15:50.290143] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-17T02:15:51.090163] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-17T02:15:51.297346] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:51.297724] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-17T02:15:51.333419] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T02:15:51.890137] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-17T02:15:52.500581] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T02:15:52.690194] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-17T02:15:52.914474] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:52.914849] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-17T02:15:53.490150] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-17T02:15:53.718965] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:53.719353] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-17T02:15:54.290163] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-17T02:15:54.494910] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:54.495242] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-17T02:15:55.090132] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-17T02:15:55.890129] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-17T02:15:56.129377] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:15:56.134542] [INFO ] [REMOTE ] BBT: Full fetch complete (3381 records). [2025-09-17T02:15:56.134634] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-17T02:15:56.318943] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 11 unique days, need 200 days [2025-09-17T02:15:56.319167] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:15:56.319246] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:15:56.319298] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-17T02:15:56.319386] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-17T02:15:56.319449] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-17T02:15:56.319514] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-17T02:15:56.319589] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBT took 19.7s. Estimated remaining: 5h 7m 47s. Rate: 7.0 symbols/min [2025-09-17T02:15:56.489194] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:56.503873] [DEBUG] [LOCAL ] BBUC: Loaded 9313 existing records from primary storage. [2025-09-17T02:15:56.504028] [INFO ] [MAIN ] BBUC: Loaded 9313 existing records. [2025-09-17T02:15:56.656787] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T02:15:56.695191] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-17T02:15:56.701935] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:56.702106] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-17T02:15:56.702969] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-17T02:15:56.703582] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-17T02:15:56.703662] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-17T02:15:57.058911] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:57.490146] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-17T02:15:57.506134] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T02:15:58.290133] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-17T02:15:58.564376] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:15:58.914204] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T02:15:59.090154] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-17T02:15:59.890130] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-11. [2025-09-17T02:15:59.960682] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T02:15:59.963447] [INFO ] [REMOTE ] BBN: Full fetch complete (27000 records). [2025-09-17T02:15:59.963551] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-17T02:16:00.356532] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-17T02:16:00.356670] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-17T02:16:00.357101] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-17T02:16:00.357159] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-17T02:16:00.358294] [DEBUG] [LOCAL ] BBN: Trimmed 27000 records to 18010 (keeping 200 days of data) [2025-09-17T02:16:00.472654] [DEBUG] [LOCAL ] BBN: Primary data saved (18010 records). [2025-09-17T02:16:00.472841] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-17T02:16:00.472938] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBN took 29.8s. Estimated remaining: 5h 6m 56s. Rate: 7.0 symbols/min [2025-09-17T02:16:00.651575] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:00.684297] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T02:16:00.690113] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-17T02:16:00.714323] [DEBUG] [LOCAL ] BBVA: Loaded 36371 existing records from primary storage. [2025-09-17T02:16:00.714755] [INFO ] [MAIN ] BBVA: Loaded 36371 existing records. [2025-09-17T02:16:01.030134] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:01.030675] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-17T02:16:01.030772] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-17T02:16:01.033747] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-17T02:16:01.034044] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-17T02:16:01.206388] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T02:16:01.495767] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-17T02:16:01.697613] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:02.029634] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T02:16:02.290128] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-17T02:16:02.925818] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T02:16:03.090146] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-17T02:16:03.764856] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T02:16:03.890145] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-11. [2025-09-17T02:16:04.690184] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-17T02:16:05.240909] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T02:16:05.368712] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:16:05.490167] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-17T02:16:06.288089] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T02:16:06.290290] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-17T02:16:06.906947] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T02:16:07.090135] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-17T02:16:07.425712] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T02:16:07.890208] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-17T02:16:08.364365] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T02:16:08.690177] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-17T02:16:09.428181] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T02:16:09.490136] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-17T02:16:10.120820] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T02:16:10.290175] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-17T02:16:11.090169] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-17T02:16:11.647437] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T02:16:11.890180] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-17T02:16:11.957700] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:16:12.461922] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T02:16:12.690187] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-17T02:16:13.490141] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-17T02:16:14.043730] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T02:16:14.045117] [INFO ] [REMOTE ] BBU: Full fetch complete (5984 records). [2025-09-17T02:16:14.045205] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-17T02:16:14.301382] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-17T02:16:14.428979] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-17T02:16:14.429225] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-17T02:16:14.429556] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-17T02:16:14.429627] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-17T02:16:14.430302] [DEBUG] [LOCAL ] BBU: Trimmed 5984 records to 4015 (keeping 200 days of data) [2025-09-17T02:16:14.459100] [DEBUG] [LOCAL ] BBU: Primary data saved (4015 records). [2025-09-17T02:16:14.459279] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-17T02:16:14.492037] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBU took 33.6s. Estimated remaining: 5h 7m 39s. Rate: 7.0 symbols/min [2025-09-17T02:16:14.503379] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:16:14.686347] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:14.705870] [DEBUG] [LOCAL ] BBW: Loaded 18907 existing records from primary storage. [2025-09-17T02:16:14.706030] [INFO ] [MAIN ] BBW: Loaded 18907 existing records. [2025-09-17T02:16:14.884568] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:14.887937] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T02:16:14.888106] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-17T02:16:14.889571] [INFO ] [REMOTE ] BBDO: Full fetch complete (7924 records). [2025-09-17T02:16:14.889710] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-17T02:16:14.889977] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-17T02:16:14.896611] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-17T02:16:14.960542] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-17T02:16:15.101010] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-17T02:16:15.630716] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-17T02:16:15.634857] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:15.634943] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-17T02:16:15.635542] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-17T02:16:15.635609] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-17T02:16:15.636213] [DEBUG] [LOCAL ] BBDO: Trimmed 7924 records to 5109 (keeping 200 days of data) [2025-09-17T02:16:15.667170] [DEBUG] [LOCAL ] BBDO: Primary data saved (5109 records). [2025-09-17T02:16:15.667315] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-17T02:16:15.667416] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBDO took 49.2s. Estimated remaining: 5h 6m 20s. Rate: 7.0 symbols/min [2025-09-17T02:16:15.842922] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:15.882850] [DEBUG] [LOCAL ] BBWI: Loaded 39941 existing records from primary storage. [2025-09-17T02:16:15.883068] [INFO ] [MAIN ] BBWI: Loaded 39941 existing records. [2025-09-17T02:16:15.895826] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-17T02:16:16.062241] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:16.062537] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-17T02:16:16.062606] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-17T02:16:16.065749] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-17T02:16:16.065817] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-17T02:16:16.416011] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:16.690172] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-11. [2025-09-17T02:16:16.941082] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T02:16:16.998433] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:16:17.490165] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-17T02:16:18.290169] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-11. [2025-09-17T02:16:18.636107] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T02:16:18.909955] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:16:19.090145] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-17T02:16:19.501112] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:16:19.890166] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-17T02:16:20.690159] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-17T02:16:20.898661] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T02:16:21.007293] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:16:21.490149] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-17T02:16:22.201432] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T02:16:22.290131] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-17T02:16:23.090145] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-17T02:16:23.201033] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T02:16:23.255300] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T02:16:23.890182] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-17T02:16:24.486655] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T02:16:24.690153] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-17T02:16:25.091170] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:16:25.490136] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-17T02:16:26.290150] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-17T02:16:26.460837] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:16:26.753429] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T02:16:27.090192] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-17T02:16:27.778568] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T02:16:27.890152] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-17T02:16:28.526024] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:16:28.690137] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-17T02:16:29.490129] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-17T02:16:29.679688] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T02:16:29.797218] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T02:16:30.290137] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-17T02:16:31.090157] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-17T02:16:31.684135] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-17T02:16:31.879290] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T02:16:31.890505] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-17T02:16:32.268283] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:16:32.690133] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-17T02:16:33.363885] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T02:16:33.490127] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-17T02:16:33.562261] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T02:16:33.568146] [INFO ] [REMOTE ] BBVA: Full fetch complete (71469 records). [2025-09-17T02:16:33.568314] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-17T02:16:33.960301] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-17T02:16:33.960417] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-17T02:16:33.961198] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-17T02:16:33.961286] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-17T02:16:33.962827] [DEBUG] [LOCAL ] BBVA: Trimmed 71469 records to 49642 (keeping 200 days of data) [2025-09-17T02:16:34.267808] [DEBUG] [LOCAL ] BBVA: Primary data saved (49642 records). [2025-09-17T02:16:34.268003] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-17T02:16:34.268118] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBVA took 33.8s. Estimated remaining: 5h 7m 46s. Rate: 7.0 symbols/min [2025-09-17T02:16:34.300065] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-17T02:16:34.457238] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T02:16:34.458709] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:34.499747] [DEBUG] [LOCAL ] BBY: Loaded 39860 existing records from primary storage. [2025-09-17T02:16:34.499938] [INFO ] [MAIN ] BBY: Loaded 39860 existing records. [2025-09-17T02:16:34.679380] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:34.679621] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-17T02:16:34.679701] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-17T02:16:34.681862] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-17T02:16:34.681953] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-17T02:16:35.038825] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:35.090090] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-11. [2025-09-17T02:16:35.890130] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-17T02:16:36.193163] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:16:36.690118] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-17T02:16:36.890751] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:16:37.064413] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T02:16:37.490129] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-17T02:16:38.084608] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T02:16:38.290122] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-17T02:16:39.090166] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-17T02:16:39.143981] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:16:39.431523] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T02:16:39.890127] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-17T02:16:40.690089] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-17T02:16:40.732852] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T02:16:41.022169] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T02:16:41.482070] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:16:41.483953] [INFO ] [REMOTE ] BBUC: Full fetch complete (17075 records). [2025-09-17T02:16:41.484037] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-17T02:16:41.495338] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-17T02:16:41.847121] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-17T02:16:41.847229] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-17T02:16:41.847526] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-17T02:16:41.847578] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-17T02:16:41.848240] [DEBUG] [LOCAL ] BBUC: Trimmed 17075 records to 13185 (keeping 200 days of data) [2025-09-17T02:16:41.934248] [DEBUG] [LOCAL ] BBUC: Primary data saved (13185 records). [2025-09-17T02:16:41.934494] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-17T02:16:41.934680] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBUC took 45.6s. Estimated remaining: 5h 7m 29s. Rate: 7.0 symbols/min [2025-09-17T02:16:42.104150] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:42.142431] [DEBUG] [LOCAL ] BC: Loaded 32937 existing records from primary storage. [2025-09-17T02:16:42.142634] [INFO ] [MAIN ] BC: Loaded 32937 existing records. [2025-09-17T02:16:42.296881] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-17T02:16:42.328203] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:42.328442] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-17T02:16:42.328532] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-17T02:16:42.330316] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-17T02:16:42.330388] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-17T02:16:42.702403] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:42.715382] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:16:43.090148] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-17T02:16:43.901705] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-17T02:16:43.907857] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T02:16:44.690172] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-11. [2025-09-17T02:16:44.909074] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:16:45.172012] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T02:16:45.490127] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-17T02:16:45.698319] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T02:16:46.290163] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-17T02:16:47.090143] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-17T02:16:47.290302] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:16:47.399707] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:16:47.890139] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-17T02:16:48.690144] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-17T02:16:48.973632] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T02:16:49.496261] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-17T02:16:49.501028] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:16:49.605364] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:16:49.609784] [INFO ] [REMOTE ] BBW: Full fetch complete (38867 records). [2025-09-17T02:16:49.609907] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-17T02:16:49.980871] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-17T02:16:49.980970] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-17T02:16:49.981432] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-17T02:16:49.981486] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-17T02:16:49.982335] [DEBUG] [LOCAL ] BBW: Trimmed 38867 records to 26342 (keeping 200 days of data) [2025-09-17T02:16:50.146200] [DEBUG] [LOCAL ] BBW: Primary data saved (26342 records). [2025-09-17T02:16:50.146393] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-17T02:16:50.146497] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBW took 35.7s. Estimated remaining: 5h 7m 16s. Rate: 7.0 symbols/min [2025-09-17T02:16:50.298420] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-17T02:16:50.318792] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:50.346029] [DEBUG] [LOCAL ] BCAT: Loaded 25335 existing records from primary storage. [2025-09-17T02:16:50.346204] [INFO ] [MAIN ] BCAT: Loaded 25335 existing records. [2025-09-17T02:16:50.529507] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:50.529805] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-17T02:16:50.529866] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-17T02:16:50.530999] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-17T02:16:50.531058] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-17T02:16:50.891223] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:51.090128] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-17T02:16:51.142556] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:16:51.151885] [INFO ] [REMOTE ] BBWI: Full fetch complete (77249 records). [2025-09-17T02:16:51.152102] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-17T02:16:51.548376] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-17T02:16:51.548495] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-17T02:16:51.549364] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-17T02:16:51.549443] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-17T02:16:51.551093] [DEBUG] [LOCAL ] BBWI: Trimmed 77249 records to 53573 (keeping 200 days of data) [2025-09-17T02:16:51.886973] [DEBUG] [LOCAL ] BBWI: Primary data saved (53573 records). [2025-09-17T02:16:51.887162] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-17T02:16:51.887272] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBWI took 36.2s. Estimated remaining: 5h 6m 4s. Rate: 7.0 symbols/min [2025-09-17T02:16:51.898907] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-11. [2025-09-17T02:16:52.061423] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:52.061823] [DEBUG] [LOCAL ] BCC: No existing data file found in primary storage. [2025-09-17T02:16:52.061906] [WARN ] [MAIN ] BCC: No existing data found, performing full refresh instead. [2025-09-17T02:16:52.069763] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-17T02:16:52.082945] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-17T02:16:52.083579] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-09-17T02:16:52.084390] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:16:52.084558] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-17T02:16:52.448028] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:52.596731] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:16:52.690136] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-17T02:16:53.221204] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T02:16:53.490129] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-17T02:16:54.294484] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-17T02:16:54.301063] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T02:16:54.642166] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T02:16:55.090161] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-17T02:16:55.890141] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-11. [2025-09-17T02:16:56.247315] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T02:16:56.277735] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T02:16:56.690150] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-17T02:16:57.150549] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:16:57.490146] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-17T02:16:58.290171] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-17T02:16:58.708515] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T02:16:59.090129] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-17T02:16:59.274065] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T02:16:59.344027] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:16:59.890125] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-17T02:17:00.690132] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-17T02:17:00.968578] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:17:01.138697] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:17:01.490167] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-17T02:17:01.979830] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:17:02.290138] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-17T02:17:03.090111] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-17T02:17:03.131047] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T02:17:03.890119] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-17T02:17:04.043532] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T02:17:04.200885] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T02:17:04.690157] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-17T02:17:05.297553] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:17:05.490140] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-17T02:17:06.290136] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-17T02:17:06.629106] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:17:07.098081] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-17T02:17:07.115979] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T02:17:07.574673] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T02:17:07.890151] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-17T02:17:08.196386] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:17:08.690141] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-17T02:17:09.490161] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-17T02:17:09.587413] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T02:17:09.594015] [INFO ] [REMOTE ] BBY: Full fetch complete (77120 records). [2025-09-17T02:17:09.594170] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-17T02:17:09.920028] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:17:09.977324] [INFO ] [REMOTE ] BC: Full fetch complete (63418 records). [2025-09-17T02:17:09.984112] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-17T02:17:10.085706] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-17T02:17:10.102089] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-17T02:17:10.123359] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-17T02:17:10.123531] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-17T02:17:10.214846] [DEBUG] [LOCAL ] BBY: Trimmed 77120 records to 53485 (keeping 200 days of data) [2025-09-17T02:17:10.295596] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-17T02:17:10.508036] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-17T02:17:10.509818] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-17T02:17:10.512372] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-17T02:17:10.513377] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-17T02:17:10.519902] [DEBUG] [LOCAL ] BC: Trimmed 63418 records to 44798 (keeping 200 days of data) [2025-09-17T02:17:10.985809] [DEBUG] [LOCAL ] BBY: Primary data saved (53485 records). [2025-09-17T02:17:11.003493] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-17T02:17:11.004520] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BBY took 36.7s. Estimated remaining: 5h 7m 33s. Rate: 7.0 symbols/min [2025-09-17T02:17:11.005511] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:17:11.099903] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-17T02:17:11.173525] [DEBUG] [LOCAL ] BC: Primary data saved (44798 records). [2025-09-17T02:17:11.220217] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:11.217102] [INFO ] [MAIN ] BC: Full history saved. [2025-09-17T02:17:11.220505] [DEBUG] [LOCAL ] BCE: No existing data file found in primary storage. [2025-09-17T02:17:11.220412] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BC took 29.3s. Estimated remaining: 5h 6m 6s. Rate: 7.0 symbols/min [2025-09-17T02:17:11.220611] [WARN ] [MAIN ] BCE: No existing data found, performing full refresh instead. [2025-09-17T02:17:11.252794] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-17T02:17:11.301084] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-17T02:17:11.321892] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-09-17T02:17:11.322313] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-17T02:17:11.509133] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:11.775067] [DEBUG] [LOCAL ] BCH: Loaded 21687 existing records from primary storage. [2025-09-17T02:17:11.773879] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:11.775387] [INFO ] [MAIN ] BCH: Loaded 21687 existing records. [2025-09-17T02:17:11.863019] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:17:11.891125] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-11. [2025-09-17T02:17:11.997268] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:11.997956] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-17T02:17:11.998222] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-17T02:17:11.999296] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-17T02:17:11.999412] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-17T02:17:12.375708] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:12.559310] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T02:17:12.690133] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-17T02:17:13.490281] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-17T02:17:13.820763] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T02:17:14.171766] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:17:14.290191] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-11. [2025-09-17T02:17:14.716866] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T02:17:15.090133] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-17T02:17:15.484806] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:17:15.890138] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-17T02:17:16.385812] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T02:17:16.690117] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-17T02:17:17.147050] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:17:17.490160] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-17T02:17:17.905138] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:17:18.290178] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-17T02:17:18.730022] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:17:19.090126] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-17T02:17:19.601715] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T02:17:19.890131] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-17T02:17:20.376706] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:17:20.690125] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-17T02:17:20.980584] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T02:17:21.490150] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-17T02:17:21.768827] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T02:17:21.773259] [INFO ] [REMOTE ] BCAT: Full fetch complete (49627 records). [2025-09-17T02:17:21.773383] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-17T02:17:22.161405] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-17T02:17:22.161536] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-17T02:17:22.162172] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-17T02:17:22.162253] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-17T02:17:22.163482] [DEBUG] [LOCAL ] BCAT: Trimmed 49627 records to 34598 (keeping 200 days of data) [2025-09-17T02:17:22.290176] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-17T02:17:22.388069] [DEBUG] [LOCAL ] BCAT: Primary data saved (34598 records). [2025-09-17T02:17:22.388259] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-17T02:17:22.388408] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCAT took 32.2s. Estimated remaining: 5h 6m 22s. Rate: 7.0 symbols/min [2025-09-17T02:17:22.559456] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:22.578706] [DEBUG] [LOCAL ] BCO: Loaded 19242 existing records from primary storage. [2025-09-17T02:17:22.578878] [INFO ] [MAIN ] BCO: Loaded 19242 existing records. [2025-09-17T02:17:22.770294] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:22.770615] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-17T02:17:22.770707] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-17T02:17:22.771952] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-17T02:17:22.772025] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-17T02:17:23.095366] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-17T02:17:23.205157] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:23.312775] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:17:23.736177] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:17:23.890132] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-17T02:17:23.964100] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T02:17:24.690136] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-17T02:17:25.490187] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-11. [2025-09-17T02:17:25.581909] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:17:26.051987] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T02:17:26.290093] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-17T02:17:26.683506] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:17:27.090152] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-17T02:17:27.890153] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-17T02:17:28.289902] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:17:28.353489] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:17:28.690200] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-17T02:17:29.022550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:17:29.026379] [INFO ] [REMOTE ] BCC: Full fetch complete (39675 records). [2025-09-17T02:17:29.026524] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-17T02:17:29.414800] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-17T02:17:29.414949] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-17T02:17:29.416006] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-17T02:17:29.416069] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-17T02:17:29.418629] [DEBUG] [LOCAL ] BCC: Trimmed 39675 records to 28404 (keeping 200 days of data) [2025-09-17T02:17:29.513313] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-17T02:17:29.601747] [DEBUG] [LOCAL ] BCC: Primary data saved (28404 records). [2025-09-17T02:17:29.601894] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-17T02:17:29.601990] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCC took 37.7s. Estimated remaining: 5h 6m 0s. Rate: 7.0 symbols/min [2025-09-17T02:17:29.770502] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:29.770728] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-09-17T02:17:29.770795] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-09-17T02:17:29.770901] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-17T02:17:29.770950] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-17T02:17:29.770996] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-17T02:17:29.771047] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-17T02:17:30.139171] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:30.290832] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T02:17:30.290895] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-11. [2025-09-17T02:17:30.933398] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:17:31.090153] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-17T02:17:31.890132] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-17T02:17:32.060178] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T02:17:32.690127] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-17T02:17:32.799111] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T02:17:32.894495] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T02:17:33.490137] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-17T02:17:34.125923] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:17:34.290114] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-17T02:17:35.090275] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-17T02:17:35.235908] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:17:35.577017] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:17:35.890140] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-17T02:17:36.642443] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T02:17:36.690086] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-17T02:17:37.490133] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-17T02:17:37.641495] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:17:38.290136] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-17T02:17:38.532869] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T02:17:38.639906] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T02:17:39.090146] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-17T02:17:39.889137] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T02:17:39.899677] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-17T02:17:40.433502] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T02:17:40.690153] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-17T02:17:41.099375] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:17:41.490154] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-17T02:17:42.290141] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-17T02:17:42.469962] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:17:42.538610] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T02:17:43.090220] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-17T02:17:43.894745] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-17T02:17:43.896051] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:17:43.903404] [INFO ] [REMOTE ] BCE: Full fetch complete (76073 records). [2025-09-17T02:17:43.903578] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-17T02:17:44.306968] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-17T02:17:44.307117] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-17T02:17:44.308279] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-17T02:17:44.308474] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-17T02:17:44.326574] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:17:44.332812] [DEBUG] [LOCAL ] BCE: Trimmed 76073 records to 52381 (keeping 200 days of data) [2025-09-17T02:17:44.668627] [DEBUG] [LOCAL ] BCE: Primary data saved (52381 records). [2025-09-17T02:17:44.668803] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-17T02:17:44.668902] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCE took 33.7s. Estimated remaining: 5h 6m 51s. Rate: 7.0 symbols/min [2025-09-17T02:17:44.700681] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-17T02:17:44.845073] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:44.865340] [DEBUG] [LOCAL ] BCSF: Loaded 19518 existing records from primary storage. [2025-09-17T02:17:44.865507] [INFO ] [MAIN ] BCSF: Loaded 19518 existing records. [2025-09-17T02:17:45.048073] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:45.048396] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-17T02:17:45.048472] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-17T02:17:45.049109] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-17T02:17:45.049179] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-17T02:17:45.406115] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:45.426145] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:17:45.490106] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-17T02:17:45.756159] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:17:45.760208] [INFO ] [REMOTE ] BCH: Full fetch complete (40494 records). [2025-09-17T02:17:45.760330] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-17T02:17:46.136441] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-17T02:17:46.136560] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-17T02:17:46.137073] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-17T02:17:46.137129] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-17T02:17:46.138496] [DEBUG] [LOCAL ] BCH: Trimmed 40494 records to 29507 (keeping 200 days of data) [2025-09-17T02:17:46.292723] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-17T02:17:46.324275] [DEBUG] [LOCAL ] BCH: Primary data saved (29507 records). [2025-09-17T02:17:46.324417] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-17T02:17:46.324553] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCH took 35.1s. Estimated remaining: 5h 5m 39s. Rate: 7.0 symbols/min [2025-09-17T02:17:46.499915] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:46.518462] [DEBUG] [LOCAL ] BCX: Loaded 15406 existing records from primary storage. [2025-09-17T02:17:46.518665] [INFO ] [MAIN ] BCX: Loaded 15406 existing records. [2025-09-17T02:17:46.698496] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:46.698853] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-17T02:17:46.699076] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-17T02:17:46.699833] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-17T02:17:46.699907] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-17T02:17:46.860495] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:17:47.079703] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:47.090081] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-11. [2025-09-17T02:17:47.890124] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-11. [2025-09-17T02:17:48.204654] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:17:48.292234] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:17:48.690146] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-17T02:17:49.047596] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:17:49.490134] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-17T02:17:50.290145] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-17T02:17:50.675357] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T02:17:50.740406] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:17:51.093954] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-17T02:17:51.099086] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T02:17:51.890153] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-17T02:17:52.014097] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T02:17:52.690144] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-17T02:17:53.079320] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T02:17:53.380861] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T02:17:53.490101] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-17T02:17:54.290167] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-17T02:17:54.549305] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:17:55.090124] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-17T02:17:55.388774] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T02:17:55.890154] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-17T02:17:56.690132] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-17T02:17:57.094882] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T02:17:57.157487] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T02:17:57.439961] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T02:17:57.490116] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-17T02:17:58.290131] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-17T02:17:58.778123] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:17:59.090155] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-17T02:17:59.266532] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:17:59.766610] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:17:59.769936] [INFO ] [REMOTE ] BCO: Full fetch complete (36733 records). [2025-09-17T02:17:59.770054] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-17T02:17:59.895209] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-17T02:18:00.162753] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-17T02:18:00.162864] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-17T02:18:00.163381] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-17T02:18:00.163465] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-17T02:18:00.164829] [DEBUG] [LOCAL ] BCO: Trimmed 36733 records to 26552 (keeping 200 days of data) [2025-09-17T02:18:00.342062] [DEBUG] [LOCAL ] BCO: Primary data saved (26552 records). [2025-09-17T02:18:00.342235] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-17T02:18:00.342354] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCO took 38.0s. Estimated remaining: 5h 6m 19s. Rate: 7.0 symbols/min [2025-09-17T02:18:00.519556] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:00.539837] [DEBUG] [LOCAL ] BDC: Loaded 17786 existing records from primary storage. [2025-09-17T02:18:00.540003] [INFO ] [MAIN ] BDC: Loaded 17786 existing records. [2025-09-17T02:18:00.696949] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-17T02:18:00.727789] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:18:00.728750] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-17T02:18:00.728831] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-17T02:18:00.729591] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-17T02:18:00.729700] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-17T02:18:01.102502] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:01.355322] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:18:01.490136] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-17T02:18:02.290196] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-17T02:18:03.090139] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-11. [2025-09-17T02:18:03.357723] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-17T02:18:03.613092] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T02:18:03.865150] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T02:18:03.890082] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-17T02:18:04.348635] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:18:04.690131] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-17T02:18:05.162050] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:18:05.490132] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-17T02:18:05.595287] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:18:06.290200] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-17T02:18:07.090283] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-17T02:18:07.281750] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T02:18:07.310116] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:18:07.857979] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:18:07.890096] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-17T02:18:08.690097] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-17T02:18:09.095969] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:18:09.490180] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-17T02:18:10.290175] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-17T02:18:10.575458] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:18:10.742550] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:18:11.090175] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-17T02:18:11.607004] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:18:11.890183] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-17T02:18:12.690196] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-17T02:18:12.939518] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T02:18:12.946199] [INFO ] [REMOTE ] BCS: Full fetch complete (77080 records). [2025-09-17T02:18:12.946401] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-17T02:18:13.352288] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-17T02:18:13.352461] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-17T02:18:13.353279] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-17T02:18:13.353349] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-17T02:18:13.369984] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:18:13.375742] [DEBUG] [LOCAL ] BCS: Trimmed 77080 records to 53480 (keeping 200 days of data) [2025-09-17T02:18:13.490346] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-17T02:18:13.713206] [DEBUG] [LOCAL ] BCS: Primary data saved (53480 records). [2025-09-17T02:18:13.713385] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-17T02:18:13.713470] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCS took 44.1s. Estimated remaining: 5h 6m 53s. Rate: 6.9 symbols/min [2025-09-17T02:18:13.875835] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:18:14.290174] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-17T02:18:15.090182] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-17T02:18:15.778212] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T02:18:15.890155] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-17T02:18:16.427597] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T02:18:16.690132] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-17T02:18:16.853729] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T02:18:17.423961] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:18:17.490257] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-17T02:18:17.787816] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T02:18:17.792875] [INFO ] [REMOTE ] BCSF: Full fetch complete (37426 records). [2025-09-17T02:18:17.793094] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-17T02:18:18.198214] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-17T02:18:18.198363] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-17T02:18:18.199186] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-17T02:18:18.199264] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-17T02:18:18.200806] [DEBUG] [LOCAL ] BCSF: Trimmed 37426 records to 27938 (keeping 200 days of data) [2025-09-17T02:18:18.295299] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-17T02:18:18.382084] [DEBUG] [LOCAL ] BCSF: Primary data saved (27938 records). [2025-09-17T02:18:18.382255] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-17T02:18:18.382352] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCSF took 33.7s. Estimated remaining: 5h 6m 9s. Rate: 7.0 symbols/min [2025-09-17T02:18:18.521720] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T02:18:18.919609] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T02:18:18.922238] [INFO ] [REMOTE ] BCX: Full fetch complete (34242 records). [2025-09-17T02:18:18.922337] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-17T02:18:19.097479] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-17T02:18:19.303434] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-17T02:18:19.303541] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-17T02:18:19.304011] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-17T02:18:19.304067] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-17T02:18:19.308101] [DEBUG] [LOCAL ] BCX: Trimmed 34242 records to 22031 (keeping 200 days of data) [2025-09-17T02:18:19.443345] [DEBUG] [LOCAL ] BCX: Primary data saved (22031 records). [2025-09-17T02:18:19.443499] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-17T02:18:19.443594] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCX took 33.1s. Estimated remaining: 5h 4m 53s. Rate: 7.0 symbols/min [2025-09-17T02:18:20.210512] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T02:18:20.216736] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-17T02:18:21.454768] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:18:21.460578] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-17T02:18:22.480547] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T02:18:22.483700] [INFO ] [REMOTE ] BDC: Full fetch complete (35495 records). [2025-09-17T02:18:22.483803] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-17T02:18:22.863471] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-17T02:18:22.863585] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-17T02:18:22.864044] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-17T02:18:22.864100] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-17T02:18:22.865121] [DEBUG] [LOCAL ] BDC: Trimmed 35495 records to 25094 (keeping 200 days of data) [2025-09-17T02:18:23.034516] [DEBUG] [LOCAL ] BDC: Primary data saved (25094 records). [2025-09-17T02:18:23.034719] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-17T02:18:23.034847] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BDC took 22.7s. Estimated remaining: 5h 4m 0s. Rate: 7.0 symbols/min [2025-09-17T02:18:23.560354] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.654160] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-09-17T02:18:23.750655] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-09-17T02:18:23.752956] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.754223] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.754760] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-09-17T02:18:23.734098] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.755254] [DEBUG] [LOCAL ] BDX: No existing data file found in primary storage. [2025-09-17T02:18:23.755087] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-17T02:18:23.755129] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-09-17T02:18:23.755349] [WARN ] [MAIN ] BDX: No existing data found, performing full refresh instead. [2025-09-17T02:18:23.755843] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-17T02:18:23.755730] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-17T02:18:23.756188] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-17T02:18:23.756777] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-17T02:18:23.756254] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-17T02:18:23.756877] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-17T02:18:23.768189] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-17T02:18:23.768138] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-17T02:18:23.817636] [DEBUG] [LOCAL ] BDX: No primary data file found to delete. [2025-09-17T02:18:23.828720] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-17T02:18:23.834174] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-17T02:18:24.066623] [DEBUG] [LOCAL ] BDJ: Loaded 21383 existing records from primary storage. [2025-09-17T02:18:24.143721] [INFO ] [MAIN ] BDJ: Loaded 21383 existing records. [2025-09-17T02:18:24.972715] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:18:25.076244] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-17T02:18:24.981261] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.111879] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-17T02:18:25.111816] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-11. [2025-09-17T02:18:25.084424] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.113625] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-17T02:18:25.116668] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.116983] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-17T02:18:25.117411] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-11. [2025-09-17T02:18:25.117787] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-11. [2025-09-17T02:18:25.490718] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.491087] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-11. [2025-09-17T02:18:26.674540] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T02:18:26.681560] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-17T02:18:26.943453] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T02:18:26.955192] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-17T02:18:27.138797] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T02:18:27.154496] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-17T02:18:27.188258] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T02:18:27.198616] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-17T02:18:28.092731] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:18:28.099363] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-17T02:18:28.613413] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T02:18:28.690095] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-17T02:18:28.823535] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T02:18:28.937251] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T02:18:29.435692] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T02:18:29.490082] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-17T02:18:30.290209] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-17T02:18:30.389313] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T02:18:31.090110] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-17T02:18:31.193496] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T02:18:31.539868] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:18:31.890151] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-17T02:18:32.617042] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T02:18:32.690112] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-17T02:18:33.098513] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T02:18:33.490173] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-17T02:18:34.290165] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-17T02:18:34.555622] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:18:35.090156] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-17T02:18:35.141090] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:18:35.890193] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-17T02:18:36.288043] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T02:18:36.690121] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-17T02:18:36.779651] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:18:37.268317] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T02:18:37.490139] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-17T02:18:38.290135] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-17T02:18:38.862616] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T02:18:38.905612] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T02:18:39.090127] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-17T02:18:39.890091] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-17T02:18:39.944262] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T02:18:40.371703] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T02:18:40.690165] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-17T02:18:41.490144] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-17T02:18:41.614696] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T02:18:42.185853] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T02:18:42.290136] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-17T02:18:43.090204] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-17T02:18:43.375724] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:18:43.890175] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-17T02:18:44.116725] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:18:44.699237] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-17T02:18:44.723194] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:18:45.383461] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T02:18:45.490088] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-17T02:18:46.290153] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-17T02:18:46.308217] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T02:18:46.421553] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:18:47.090134] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-17T02:18:47.886459] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:18:47.896793] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-17T02:18:48.420889] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:18:48.690211] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-17T02:18:49.431750] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T02:18:49.437482] [INFO ] [REMOTE ] BDN: Full fetch complete (69192 records). [2025-09-17T02:18:49.437610] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-17T02:18:49.497758] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-17T02:18:49.836754] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-17T02:18:49.836880] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-17T02:18:49.837697] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-17T02:18:49.837850] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-17T02:18:49.839296] [DEBUG] [LOCAL ] BDN: Trimmed 69192 records to 47698 (keeping 200 days of data) [2025-09-17T02:18:50.120577] [DEBUG] [LOCAL ] BDN: Primary data saved (47698 records). [2025-09-17T02:18:50.120789] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-17T02:18:50.120882] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDN took 27.1s. Estimated remaining: 5h 6m 35s. Rate: 6.9 symbols/min [2025-09-17T02:18:50.290992] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-17T02:18:50.292606] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:50.293989] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-17T02:18:50.294050] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-17T02:18:50.294180] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-17T02:18:50.294234] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-17T02:18:50.294281] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-17T02:18:50.294325] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-17T02:18:50.655816] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:50.673975] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:18:50.714050] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T02:18:51.090172] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-17T02:18:51.890158] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-17T02:18:51.968051] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:18:52.690185] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-17T02:18:52.779665] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T02:18:52.784661] [INFO ] [REMOTE ] BDJ: Full fetch complete (42829 records). [2025-09-17T02:18:52.784814] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-17T02:18:53.173440] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-17T02:18:53.173552] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-17T02:18:53.174171] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-17T02:18:53.174308] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-17T02:18:53.175586] [DEBUG] [LOCAL ] BDJ: Trimmed 42829 records to 29272 (keeping 200 days of data) [2025-09-17T02:18:53.305940] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T02:18:53.397405] [DEBUG] [LOCAL ] BDJ: Primary data saved (29272 records). [2025-09-17T02:18:53.397563] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-17T02:18:53.397686] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDJ took 30.4s. Estimated remaining: 5h 5m 40s. Rate: 7.0 symbols/min [2025-09-17T02:18:53.500277] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-11. [2025-09-17T02:18:53.582820] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:53.622860] [DEBUG] [LOCAL ] BEKE: Loaded 39625 existing records from primary storage. [2025-09-17T02:18:53.623045] [INFO ] [MAIN ] BEKE: Loaded 39625 existing records. [2025-09-17T02:18:53.805065] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:18:53.805338] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-17T02:18:53.805413] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-17T02:18:53.806669] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-17T02:18:53.806752] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-17T02:18:53.926419] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:18:54.181872] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:54.290183] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-11. [2025-09-17T02:18:54.628398] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T02:18:55.090142] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-17T02:18:55.890127] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-17T02:18:56.169760] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T02:18:56.690147] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-17T02:18:56.958830] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:18:57.490129] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-17T02:18:58.259626] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T02:18:58.288101] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:18:58.292421] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-17T02:18:58.594042] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-17T02:18:59.095338] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-17T02:18:59.108096] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:18:59.115043] [INFO ] [REMOTE ] BDX: Full fetch complete (75792 records). [2025-09-17T02:18:59.115230] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-17T02:18:59.641043] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-17T02:18:59.641375] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-17T02:18:59.643030] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-17T02:18:59.643587] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-17T02:18:59.655448] [DEBUG] [LOCAL ] BDX: Trimmed 75792 records to 52531 (keeping 200 days of data) [2025-09-17T02:18:59.813692] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T02:18:59.849779] [INFO ] [REMOTE ] BE: Full fetch complete (77544 records). [2025-09-17T02:18:59.860584] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-17T02:18:59.892512] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-17T02:19:00.566390] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-17T02:19:00.567849] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-17T02:19:00.569888] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-17T02:19:00.570672] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-17T02:19:00.576712] [DEBUG] [LOCAL ] BE: Trimmed 77544 records to 53653 (keeping 200 days of data) [2025-09-17T02:19:00.722389] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-17T02:19:00.973145] [DEBUG] [LOCAL ] BDX: Primary data saved (52531 records). [2025-09-17T02:19:00.973904] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-17T02:19:00.974582] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BDX took 37.9s. Estimated remaining: 5h 5m 22s. Rate: 7.0 symbols/min [2025-09-17T02:19:01.163575] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:01.138043] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T02:19:01.180854] [DEBUG] [LOCAL ] BE: Primary data saved (53653 records). [2025-09-17T02:19:01.181040] [INFO ] [MAIN ] BE: Full history saved. [2025-09-17T02:19:01.181216] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BE took 38.1s. Estimated remaining: 5h 3m 60s. Rate: 7.0 symbols/min [2025-09-17T02:19:01.316970] [DEBUG] [LOCAL ] BEN: Loaded 39572 existing records from primary storage. [2025-09-17T02:19:01.346684] [INFO ] [MAIN ] BEN: Loaded 39572 existing records. [2025-09-17T02:19:01.439761] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:01.493069] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-17T02:19:01.563617] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:01.563894] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-17T02:19:01.564105] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-17T02:19:01.565314] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-17T02:19:01.565437] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-17T02:19:01.749334] [DEBUG] [LOCAL ] BEP: Loaded 27781 existing records from primary storage. [2025-09-17T02:19:01.767764] [INFO ] [MAIN ] BEP: Loaded 27781 existing records. [2025-09-17T02:19:01.922198] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T02:19:02.131100] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:02.135251] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:02.135753] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-17T02:19:02.135817] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-17T02:19:02.136721] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-17T02:19:02.136788] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-17T02:19:02.305700] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-11. [2025-09-17T02:19:02.395614] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-17T02:19:02.542496] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:03.090136] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-17T02:19:03.596333] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T02:19:03.890183] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-17T02:19:04.180835] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-17T02:19:04.215416] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:19:04.690168] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-11. [2025-09-17T02:19:05.490162] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-17T02:19:06.229759] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:19:06.290093] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-17T02:19:07.090144] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-17T02:19:07.701900] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-17T02:19:07.890128] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-17T02:19:08.690169] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-17T02:19:08.806157] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-17T02:19:08.837873] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T02:19:09.064828] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T02:19:09.490175] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-17T02:19:09.711209] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:19:09.825278] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T02:19:10.290141] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-17T02:19:11.090152] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-17T02:19:11.890142] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-17T02:19:12.124584] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-17T02:19:12.246822] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T02:19:12.690207] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-17T02:19:12.811701] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:19:13.490148] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-17T02:19:13.724767] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-17T02:19:14.136420] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T02:19:14.290213] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-17T02:19:15.090182] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-17T02:19:15.554225] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:19:15.890163] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-17T02:19:16.404184] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T02:19:16.690149] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-17T02:19:17.490179] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-17T02:19:17.525515] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:19:17.795354] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T02:19:17.796102] [INFO ] [REMOTE ] BEDU: Full fetch complete (1375 records). [2025-09-17T02:19:17.796186] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-17T02:19:17.973036] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-17T02:19:17.973218] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:19:17.973268] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:19:17.973314] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-17T02:19:17.973390] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-17T02:19:17.973439] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-17T02:19:17.973499] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-17T02:19:17.973571] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 27.9s. Estimated remaining: 5h 5m 2s. Rate: 7.0 symbols/min [2025-09-17T02:19:18.141014] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:18.175505] [DEBUG] [LOCAL ] BEPC: Loaded 34009 existing records from primary storage. [2025-09-17T02:19:18.175696] [INFO ] [MAIN ] BEPC: Loaded 34009 existing records. [2025-09-17T02:19:18.295364] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-17T02:19:18.361984] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:18.362273] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-17T02:19:18.362333] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-17T02:19:18.363409] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-17T02:19:18.363472] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-17T02:19:18.727510] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:18.763273] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T02:19:19.090227] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-17T02:19:19.890140] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-17T02:19:20.185707] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:19:20.690136] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-11. [2025-09-17T02:19:20.926103] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T02:19:20.965733] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:19:21.490141] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-17T02:19:22.235803] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T02:19:22.290142] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-17T02:19:22.660448] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T02:19:23.090143] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-17T02:19:23.849561] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T02:19:23.890127] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-17T02:19:24.690193] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-17T02:19:25.053407] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T02:19:25.490106] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-17T02:19:25.521961] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:19:26.162888] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:19:26.290216] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-17T02:19:26.924329] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:19:27.090163] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-17T02:19:27.783966] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T02:19:27.890159] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-17T02:19:28.690177] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-17T02:19:28.923472] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:19:29.490142] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-17T02:19:29.834317] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:19:30.071360] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:19:30.290137] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-17T02:19:30.961925] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:19:31.090094] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-17T02:19:31.366516] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:19:31.890154] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-17T02:19:32.690155] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-17T02:19:32.931175] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:19:33.490180] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-17T02:19:33.565807] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T02:19:33.572332] [INFO ] [REMOTE ] BEKE: Full fetch complete (77050 records). [2025-09-17T02:19:33.572498] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-17T02:19:33.967233] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-17T02:19:33.967424] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-17T02:19:33.968482] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-17T02:19:33.968564] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-17T02:19:33.970220] [DEBUG] [LOCAL ] BEKE: Trimmed 77050 records to 53268 (keeping 200 days of data) [2025-09-17T02:19:34.090063] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:19:34.305405] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-17T02:19:34.328063] [DEBUG] [LOCAL ] BEKE: Primary data saved (53268 records). [2025-09-17T02:19:34.328236] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-17T02:19:34.328345] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEKE took 40.9s. Estimated remaining: 5h 6m 1s. Rate: 6.9 symbols/min [2025-09-17T02:19:34.498223] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:34.503423] [DEBUG] [LOCAL ] BEPH: Loaded 3492 existing records from primary storage. [2025-09-17T02:19:34.503535] [INFO ] [MAIN ] BEPH: Loaded 3492 existing records. [2025-09-17T02:19:34.683558] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:34.683839] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-17T02:19:34.683895] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-17T02:19:34.684194] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-17T02:19:34.684249] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-17T02:19:35.048245] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:35.090133] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-17T02:19:35.300350] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T02:19:35.856284] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:19:35.890144] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-17T02:19:36.690185] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-17T02:19:36.805687] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T02:19:37.140247] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T02:19:37.144918] [INFO ] [REMOTE ] BEP: Full fetch complete (58413 records). [2025-09-17T02:19:37.145091] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-17T02:19:37.495352] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-17T02:19:37.549782] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-17T02:19:37.549908] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-17T02:19:37.550696] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-17T02:19:37.550769] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-17T02:19:37.552274] [DEBUG] [LOCAL ] BEP: Trimmed 58413 records to 38899 (keeping 200 days of data) [2025-09-17T02:19:37.790014] [DEBUG] [LOCAL ] BEP: Primary data saved (38899 records). [2025-09-17T02:19:37.790184] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-17T02:19:37.790290] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEP took 36.6s. Estimated remaining: 5h 5m 7s. Rate: 7.0 symbols/min [2025-09-17T02:19:37.959737] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:37.963954] [DEBUG] [LOCAL ] BEPI: Loaded 2679 existing records from primary storage. [2025-09-17T02:19:37.964045] [INFO ] [MAIN ] BEPI: Loaded 2679 existing records. [2025-09-17T02:19:38.139201] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:38.139436] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-17T02:19:38.139493] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-17T02:19:38.139744] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-17T02:19:38.139800] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-17T02:19:38.293958] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-11. [2025-09-17T02:19:38.503867] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:38.523755] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T02:19:38.531345] [INFO ] [REMOTE ] BEN: Full fetch complete (76741 records). [2025-09-17T02:19:38.531573] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-17T02:19:38.721623] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:19:38.950004] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-17T02:19:38.950135] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-17T02:19:38.950963] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-17T02:19:38.951038] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-17T02:19:38.952865] [DEBUG] [LOCAL ] BEN: Trimmed 76741 records to 53087 (keeping 200 days of data) [2025-09-17T02:19:39.133141] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-17T02:19:39.226230] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:19:39.325032] [DEBUG] [LOCAL ] BEN: Primary data saved (53087 records). [2025-09-17T02:19:39.325229] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-17T02:19:39.327673] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEN took 38.4s. Estimated remaining: 5h 3m 58s. Rate: 7.0 symbols/min [2025-09-17T02:19:39.503587] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:39.503833] [DEBUG] [LOCAL ] BEPJ: No existing data file found in primary storage. [2025-09-17T02:19:39.503886] [WARN ] [MAIN ] BEPJ: No existing data found, performing full refresh instead. [2025-09-17T02:19:39.503999] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-17T02:19:39.504046] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-17T02:19:39.504090] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-09-17T02:19:39.504126] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-17T02:19:39.869908] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:39.877075] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T02:19:39.890091] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-11. [2025-09-17T02:19:40.414850] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T02:19:40.690186] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-17T02:19:41.202175] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T02:19:41.490140] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-17T02:19:42.050581] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T02:19:42.290144] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-17T02:19:42.601211] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-17T02:19:43.090173] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-11. [2025-09-17T02:19:43.549749] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T02:19:43.890137] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-17T02:19:44.349160] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T02:19:44.690125] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-17T02:19:45.143125] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T02:19:45.490166] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-17T02:19:46.041103] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T02:19:46.290164] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-17T02:19:46.954993] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:19:47.090133] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-17T02:19:47.534402] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T02:19:47.890143] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-17T02:19:48.690144] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-17T02:19:49.074576] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T02:19:49.490199] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-17T02:19:49.699818] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T02:19:50.097274] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T02:19:50.290142] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-17T02:19:50.982833] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T02:19:51.090159] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-17T02:19:51.807025] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T02:19:51.890199] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-17T02:19:52.509233] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:19:52.690204] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-17T02:19:53.291301] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T02:19:53.490167] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-17T02:19:53.951571] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:19:54.290143] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-17T02:19:54.751144] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T02:19:55.090152] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-17T02:19:55.890133] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-17T02:19:56.387119] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:19:56.388198] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4553 records). [2025-09-17T02:19:56.388441] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-17T02:19:56.693997] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-17T02:19:56.724260] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T02:19:56.803899] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-17T02:19:56.804003] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-17T02:19:56.804199] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-17T02:19:56.804294] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-17T02:19:56.804745] [DEBUG] [LOCAL ] BEPJ: Trimmed 4553 records to 3356 (keeping 200 days of data) [2025-09-17T02:19:56.827119] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3356 records). [2025-09-17T02:19:56.827205] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-17T02:19:56.827285] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEPJ took 17.5s. Estimated remaining: 5h 5m 5s. Rate: 6.9 symbols/min [2025-09-17T02:19:56.994683] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:57.026252] [DEBUG] [LOCAL ] BFAM: Loaded 24751 existing records from primary storage. [2025-09-17T02:19:57.026423] [INFO ] [MAIN ] BFAM: Loaded 24751 existing records. [2025-09-17T02:19:57.202915] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:57.203179] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-17T02:19:57.203240] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-17T02:19:57.203957] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-17T02:19:57.204052] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-17T02:19:57.330186] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:19:57.493452] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-17T02:19:57.571545] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:57.977746] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T02:19:58.290150] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-17T02:19:59.090185] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-11. [2025-09-17T02:19:59.319024] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:19:59.325249] [INFO ] [REMOTE ] BEPC: Full fetch complete (68353 records). [2025-09-17T02:19:59.325469] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-17T02:19:59.728531] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-17T02:19:59.728660] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-17T02:19:59.729371] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-17T02:19:59.729428] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-17T02:19:59.731131] [DEBUG] [LOCAL ] BEPC: Trimmed 68353 records to 46706 (keeping 200 days of data) [2025-09-17T02:19:59.921031] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-17T02:20:00.038272] [DEBUG] [LOCAL ] BEPC: Primary data saved (46706 records). [2025-09-17T02:20:00.038483] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-17T02:20:00.038627] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPC took 42.1s. Estimated remaining: 5h 4m 11s. Rate: 7.0 symbols/min [2025-09-17T02:20:00.214266] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:00.214488] [DEBUG] [LOCAL ] BFH: No existing data file found in primary storage. [2025-09-17T02:20:00.214533] [WARN ] [MAIN ] BFH: No existing data found, performing full refresh instead. [2025-09-17T02:20:00.214658] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-17T02:20:00.214706] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-17T02:20:00.214752] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-09-17T02:20:00.214837] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-17T02:20:00.583143] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:00.588841] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T02:20:00.618191] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T02:20:00.690080] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-17T02:20:01.490146] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-17T02:20:02.172809] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T02:20:02.290140] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-17T02:20:02.297121] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T02:20:03.090135] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-17T02:20:03.212379] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T02:20:03.714188] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T02:20:03.890158] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-17T02:20:04.504984] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:20:04.690146] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-17T02:20:05.246287] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T02:20:05.490181] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-17T02:20:06.290196] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-17T02:20:06.687883] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:20:06.779664] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T02:20:07.090187] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-17T02:20:07.553776] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T02:20:07.554957] [INFO ] [REMOTE ] BEPI: Full fetch complete (4998 records). [2025-09-17T02:20:07.555074] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-17T02:20:07.900247] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-11. [2025-09-17T02:20:07.932153] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-17T02:20:07.932256] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-17T02:20:07.932422] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-17T02:20:07.932474] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-17T02:20:07.932929] [DEBUG] [LOCAL ] BEPI: Trimmed 4998 records to 3428 (keeping 200 days of data) [2025-09-17T02:20:07.954954] [DEBUG] [LOCAL ] BEPI: Primary data saved (3428 records). [2025-09-17T02:20:07.955114] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-17T02:20:07.955225] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPI took 30.2s. Estimated remaining: 5h 3m 56s. Rate: 7.0 symbols/min [2025-09-17T02:20:08.127813] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:08.139529] [DEBUG] [LOCAL ] BFK: Loaded 9721 existing records from primary storage. [2025-09-17T02:20:08.139719] [INFO ] [MAIN ] BFK: Loaded 9721 existing records. [2025-09-17T02:20:08.336244] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:08.336535] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-17T02:20:08.336605] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-17T02:20:08.337064] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-17T02:20:08.337130] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-17T02:20:08.703971] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-17T02:20:08.710415] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:09.284810] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T02:20:09.442436] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:20:09.490159] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-17T02:20:10.063710] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T02:20:10.290173] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-17T02:20:11.090178] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-17T02:20:11.592466] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:20:11.593953] [INFO ] [REMOTE ] BEPH: Full fetch complete (7558 records). [2025-09-17T02:20:11.594042] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-17T02:20:11.894146] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-17T02:20:11.970755] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-17T02:20:11.970905] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-17T02:20:11.971342] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-17T02:20:11.971409] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-17T02:20:11.972212] [DEBUG] [LOCAL ] BEPH: Trimmed 7558 records to 5228 (keeping 200 days of data) [2025-09-17T02:20:12.027371] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T02:20:12.043893] [DEBUG] [LOCAL ] BEPH: Primary data saved (5228 records). [2025-09-17T02:20:12.044018] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-17T02:20:12.044147] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BEPH took 37.7s. Estimated remaining: 5h 3m 10s. Rate: 7.0 symbols/min [2025-09-17T02:20:12.216444] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:12.216742] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-09-17T02:20:12.216816] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-09-17T02:20:12.216951] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-17T02:20:12.217003] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-17T02:20:12.217050] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-09-17T02:20:12.217089] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-17T02:20:12.580961] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:12.690081] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-11. [2025-09-17T02:20:13.071707] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T02:20:13.490140] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-11. [2025-09-17T02:20:14.287205] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:20:14.290189] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-17T02:20:14.548845] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:20:15.090131] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-17T02:20:15.159564] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:20:15.890143] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-17T02:20:16.603148] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T02:20:16.630298] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T02:20:16.690166] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-17T02:20:17.439915] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T02:20:17.490155] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-17T02:20:18.290147] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-17T02:20:18.515205] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T02:20:19.090182] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-17T02:20:19.596095] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T02:20:19.890154] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-17T02:20:20.543731] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T02:20:20.690170] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-17T02:20:21.490165] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-17T02:20:21.679506] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:20:22.041001] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:20:22.290148] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-17T02:20:22.965786] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:20:23.090127] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-17T02:20:23.615656] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T02:20:23.890208] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-17T02:20:24.690173] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-17T02:20:24.937353] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T02:20:25.004416] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:20:25.490149] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-17T02:20:25.884959] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:20:26.290247] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-17T02:20:26.911563] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T02:20:27.090178] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-17T02:20:27.890145] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-17T02:20:28.003753] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T02:20:28.134971] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T02:20:28.690129] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-17T02:20:29.415515] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:20:29.490171] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-17T02:20:30.078713] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T02:20:30.115753] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:20:30.290150] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-17T02:20:30.904105] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:20:31.090157] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-17T02:20:31.890140] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-17T02:20:32.690125] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-17T02:20:32.921660] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:20:33.158613] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T02:20:33.162705] [INFO ] [REMOTE ] BFAM: Full fetch complete (46827 records). [2025-09-17T02:20:33.162886] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-17T02:20:33.497355] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-17T02:20:33.564492] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-17T02:20:33.564672] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-17T02:20:33.565474] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-17T02:20:33.565568] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-17T02:20:33.567221] [DEBUG] [LOCAL ] BFAM: Trimmed 46827 records to 32885 (keeping 200 days of data) [2025-09-17T02:20:33.688586] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:20:33.798485] [DEBUG] [LOCAL ] BFAM: Primary data saved (32885 records). [2025-09-17T02:20:33.798662] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-17T02:20:33.798761] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFAM took 37.0s. Estimated remaining: 5h 4m 51s. Rate: 6.9 symbols/min [2025-09-17T02:20:34.000504] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:34.008270] [DEBUG] [LOCAL ] BFS: Loaded 6786 existing records from primary storage. [2025-09-17T02:20:34.008374] [INFO ] [MAIN ] BFS: Loaded 6786 existing records. [2025-09-17T02:20:34.185026] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:34.185300] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-17T02:20:34.185360] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-17T02:20:34.185713] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-17T02:20:34.185774] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-17T02:20:34.295343] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-17T02:20:34.561088] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:34.936094] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T02:20:35.090133] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-17T02:20:35.890141] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-17T02:20:36.068148] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:20:36.238381] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T02:20:36.690119] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-17T02:20:37.125227] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:20:37.490152] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-17T02:20:38.144586] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T02:20:38.290171] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-11. [2025-09-17T02:20:38.790701] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:20:38.795463] [INFO ] [REMOTE ] BFH: Full fetch complete (59495 records). [2025-09-17T02:20:38.795623] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-17T02:20:39.090537] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-17T02:20:39.155245] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T02:20:39.210976] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-17T02:20:39.211083] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-17T02:20:39.211726] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-17T02:20:39.211783] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-17T02:20:39.213055] [DEBUG] [LOCAL ] BFH: Trimmed 59495 records to 42060 (keeping 200 days of data) [2025-09-17T02:20:39.468960] [DEBUG] [LOCAL ] BFH: Primary data saved (42060 records). [2025-09-17T02:20:39.469124] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-17T02:20:39.469212] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFH took 39.4s. Estimated remaining: 5h 4m 18s. Rate: 7.0 symbols/min [2025-09-17T02:20:39.660771] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:39.671382] [DEBUG] [LOCAL ] BFZ: Loaded 8443 existing records from primary storage. [2025-09-17T02:20:39.671543] [INFO ] [MAIN ] BFZ: Loaded 8443 existing records. [2025-09-17T02:20:39.848138] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:39.848396] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-17T02:20:39.848453] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-17T02:20:39.848864] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-17T02:20:39.848925] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-17T02:20:39.895280] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-17T02:20:40.145922] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:20:40.166865] [INFO ] [REMOTE ] BFK: Full fetch complete (19006 records). [2025-09-17T02:20:40.201842] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-17T02:20:40.298222] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:40.599920] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-17T02:20:40.600037] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-17T02:20:40.600376] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-17T02:20:40.600436] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-17T02:20:40.601105] [DEBUG] [LOCAL ] BFK: Trimmed 19006 records to 13903 (keeping 200 days of data) [2025-09-17T02:20:40.679619] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:20:40.690160] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-17T02:20:40.699389] [DEBUG] [LOCAL ] BFK: Primary data saved (13903 records). [2025-09-17T02:20:40.699549] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-17T02:20:40.699662] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFK took 32.7s. Estimated remaining: 5h 3m 8s. Rate: 7.0 symbols/min [2025-09-17T02:20:40.873413] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:40.914557] [DEBUG] [LOCAL ] BG: Loaded 37699 existing records from primary storage. [2025-09-17T02:20:40.914763] [INFO ] [MAIN ] BG: Loaded 37699 existing records. [2025-09-17T02:20:41.097881] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:41.098153] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-17T02:20:41.098216] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-17T02:20:41.099361] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-17T02:20:41.099425] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-17T02:20:41.465880] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:41.490114] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-11. [2025-09-17T02:20:41.633387] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:20:42.290177] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-17T02:20:42.830779] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T02:20:43.090140] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-11. [2025-09-17T02:20:43.890156] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-17T02:20:44.076442] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T02:20:44.127549] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T02:20:44.690184] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-17T02:20:45.490135] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-17T02:20:45.619559] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:20:45.709716] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:20:46.290134] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-17T02:20:46.951821] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:20:47.090143] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-17T02:20:47.360797] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:20:47.658359] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T02:20:47.890140] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-17T02:20:48.690142] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-17T02:20:49.298058] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T02:20:49.490205] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-17T02:20:50.219727] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T02:20:50.290103] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-17T02:20:50.620247] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:20:51.090107] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-17T02:20:51.274796] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T02:20:51.890142] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-17T02:20:52.251446] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T02:20:52.260871] [INFO ] [REMOTE ] BFLY: Full fetch complete (75062 records). [2025-09-17T02:20:52.261107] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-17T02:20:52.652396] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-17T02:20:52.652511] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-17T02:20:52.653338] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-17T02:20:52.653404] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-17T02:20:52.655035] [DEBUG] [LOCAL ] BFLY: Trimmed 75062 records to 51856 (keeping 200 days of data) [2025-09-17T02:20:52.710969] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-17T02:20:52.960087] [DEBUG] [LOCAL ] BFLY: Primary data saved (51856 records). [2025-09-17T02:20:52.960266] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-17T02:20:52.960361] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFLY took 40.9s. Estimated remaining: 5h 3m 29s. Rate: 7.0 symbols/min [2025-09-17T02:20:53.128727] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:53.142507] [DEBUG] [LOCAL ] BGB: Loaded 12351 existing records from primary storage. [2025-09-17T02:20:53.142663] [INFO ] [MAIN ] BGB: Loaded 12351 existing records. [2025-09-17T02:20:53.328576] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:53.328871] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-17T02:20:53.328940] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-17T02:20:53.329362] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-17T02:20:53.329421] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-17T02:20:53.490554] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-17T02:20:53.638686] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T02:20:53.711694] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:53.739433] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T02:20:54.196454] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T02:20:54.290115] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-17T02:20:55.090131] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-17T02:20:55.862117] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T02:20:55.890139] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-17T02:20:56.149841] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T02:20:56.459529] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T02:20:56.690127] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-17T02:20:57.427171] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T02:20:57.490093] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-11. [2025-09-17T02:20:58.290169] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-17T02:20:58.550476] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:20:59.090146] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-17T02:20:59.098332] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:20:59.890144] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-17T02:21:00.690200] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-17T02:21:00.983062] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:21:01.037570] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T02:21:01.490142] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-17T02:21:01.710861] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T02:21:02.290131] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-17T02:21:03.090121] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-17T02:21:03.340433] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T02:21:03.890132] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-17T02:21:04.683275] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-17T02:21:04.690079] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-17T02:21:05.009767] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T02:21:05.472996] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T02:21:05.474886] [INFO ] [REMOTE ] BFS: Full fetch complete (12313 records). [2025-09-17T02:21:05.474993] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-17T02:21:05.495674] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-17T02:21:05.899241] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-17T02:21:05.935799] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-17T02:21:05.936604] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-17T02:21:05.937177] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-17T02:21:05.937819] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-17T02:21:05.938703] [DEBUG] [LOCAL ] BFS: Trimmed 12313 records to 8999 (keeping 200 days of data) [2025-09-17T02:21:06.012702] [DEBUG] [LOCAL ] BFS: Primary data saved (8999 records). [2025-09-17T02:21:06.012928] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-17T02:21:06.013064] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFS took 32.2s. Estimated remaining: 5h 3m 57s. Rate: 6.9 symbols/min [2025-09-17T02:21:06.288233] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:06.290289] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-17T02:21:06.308615] [DEBUG] [LOCAL ] BGH: Loaded 12163 existing records from primary storage. [2025-09-17T02:21:06.311199] [INFO ] [MAIN ] BGH: Loaded 12163 existing records. [2025-09-17T02:21:06.636716] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T02:21:06.634022] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:06.644572] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-17T02:21:06.645173] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-17T02:21:06.645933] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-17T02:21:06.646028] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-17T02:21:07.024523] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T02:21:07.095280] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-17T02:21:07.135055] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:07.890164] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-17T02:21:08.690146] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-11. [2025-09-17T02:21:08.806168] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T02:21:08.899244] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:21:09.254545] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T02:21:09.490210] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-17T02:21:10.211894] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T02:21:10.290159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-17T02:21:10.864705] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T02:21:11.090168] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-17T02:21:11.890197] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-17T02:21:12.569742] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T02:21:12.684912] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T02:21:12.690075] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-17T02:21:13.490161] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-17T02:21:13.535889] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:21:14.290159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-17T02:21:15.090135] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-17T02:21:15.796883] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:21:15.890094] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-17T02:21:16.044934] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-17T02:21:16.690180] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-17T02:21:16.697748] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:21:16.700202] [INFO ] [REMOTE ] BFZ: Full fetch complete (17889 records). [2025-09-17T02:21:16.700372] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-17T02:21:17.107811] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-17T02:21:17.108444] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-17T02:21:17.108810] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-17T02:21:17.109340] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T02:21:17.109502] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-17T02:21:17.115437] [DEBUG] [LOCAL ] BFZ: Trimmed 17889 records to 11334 (keeping 200 days of data) [2025-09-17T02:21:17.185738] [DEBUG] [LOCAL ] BFZ: Primary data saved (11334 records). [2025-09-17T02:21:17.185904] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-17T02:21:17.185999] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BFZ took 37.7s. Estimated remaining: 5h 4m 9s. Rate: 6.9 symbols/min [2025-09-17T02:21:17.357847] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:17.369137] [DEBUG] [LOCAL ] BGR: Loaded 9713 existing records from primary storage. [2025-09-17T02:21:17.369306] [INFO ] [MAIN ] BGR: Loaded 9713 existing records. [2025-09-17T02:21:17.499274] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-17T02:21:17.564120] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:17.564379] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-17T02:21:17.564445] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-17T02:21:17.565002] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-17T02:21:17.565086] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-17T02:21:17.934209] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:17.950276] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T02:21:18.290159] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-11. [2025-09-17T02:21:18.552439] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:21:19.022598] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T02:21:19.090097] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-17T02:21:19.890166] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-17T02:21:20.080750] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T02:21:20.690153] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-17T02:21:20.938857] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:21:21.367217] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:21:21.490154] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-17T02:21:22.290199] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-17T02:21:22.415810] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:21:23.090242] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-17T02:21:23.283871] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T02:21:23.883105] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:21:23.890069] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-17T02:21:24.690188] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-17T02:21:24.891027] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:21:25.490166] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-17T02:21:25.658378] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T02:21:26.190455] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T02:21:26.290202] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-17T02:21:26.389082] [DEBUG] [REMOTE ] BGR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-17T02:21:26.389382] [WARN ] [REMOTE ] BGR: No data returned for month 2025-03 [2025-09-17T02:21:27.090164] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-17T02:21:27.890123] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-17T02:21:28.440503] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:21:28.446813] [INFO ] [REMOTE ] BG: Full fetch complete (72544 records). [2025-09-17T02:21:28.446971] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-17T02:21:28.695262] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-17T02:21:28.850398] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-17T02:21:28.850499] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-17T02:21:28.851234] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-17T02:21:28.851292] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-17T02:21:28.852890] [DEBUG] [LOCAL ] BG: Trimmed 72544 records to 50385 (keeping 200 days of data) [2025-09-17T02:21:28.932193] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T02:21:29.223036] [DEBUG] [LOCAL ] BG: Primary data saved (50385 records). [2025-09-17T02:21:29.223224] [INFO ] [MAIN ] BG: Full history saved. [2025-09-17T02:21:29.223332] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BG took 48.5s. Estimated remaining: 5h 4m 28s. Rate: 6.9 symbols/min [2025-09-17T02:21:29.411834] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:29.419761] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T02:21:29.422870] [INFO ] [REMOTE ] BGH: Full fetch complete (21638 records). [2025-09-17T02:21:29.422970] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-17T02:21:29.491010] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-17T02:21:29.742850] [DEBUG] [LOCAL ] BGS: Loaded 37704 existing records from primary storage. [2025-09-17T02:21:29.766552] [INFO ] [MAIN ] BGS: Loaded 37704 existing records. [2025-09-17T02:21:29.907616] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-17T02:21:29.909998] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-17T02:21:29.915999] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-17T02:21:29.926425] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-17T02:21:29.988838] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:29.988977] [DEBUG] [LOCAL ] BGH: Trimmed 21638 records to 16427 (keeping 200 days of data) [2025-09-17T02:21:29.989506] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-17T02:21:29.989573] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-17T02:21:29.990706] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-17T02:21:29.990783] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-17T02:21:30.302095] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-17T02:21:30.383058] [DEBUG] [LOCAL ] BGH: Primary data saved (16427 records). [2025-09-17T02:21:30.403839] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-17T02:21:30.441440] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BGH took 24.4s. Estimated remaining: 5h 3m 19s. Rate: 7.0 symbols/min [2025-09-17T02:21:30.462220] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:30.629834] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:30.636328] [DEBUG] [LOCAL ] BGSF: Loaded 4813 existing records from primary storage. [2025-09-17T02:21:30.636432] [INFO ] [MAIN ] BGSF: Loaded 4813 existing records. [2025-09-17T02:21:30.819260] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:30.853474] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T02:21:30.853096] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-17T02:21:30.857809] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-17T02:21:30.858069] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-17T02:21:30.858125] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-17T02:21:31.100635] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-17T02:21:31.220919] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:31.226374] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:21:31.228476] [INFO ] [REMOTE ] BGB: Full fetch complete (27006 records). [2025-09-17T02:21:31.228565] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-17T02:21:31.594872] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-17T02:21:31.594970] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-17T02:21:31.595320] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-17T02:21:31.595398] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-17T02:21:31.596133] [DEBUG] [LOCAL ] BGB: Trimmed 27006 records to 17666 (keeping 200 days of data) [2025-09-17T02:21:31.703556] [DEBUG] [LOCAL ] BGB: Primary data saved (17666 records). [2025-09-17T02:21:31.703715] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-17T02:21:31.703807] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BGB took 38.7s. Estimated remaining: 5h 2m 11s. Rate: 7.0 symbols/min [2025-09-17T02:21:31.887940] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:31.890096] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-11. [2025-09-17T02:21:31.901730] [DEBUG] [LOCAL ] BGT: Loaded 12384 existing records from primary storage. [2025-09-17T02:21:31.901849] [INFO ] [MAIN ] BGT: Loaded 12384 existing records. [2025-09-17T02:21:32.083397] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:32.083711] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-17T02:21:32.083960] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-17T02:21:32.092961] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T02:21:32.092590] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-17T02:21:32.096294] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-17T02:21:32.466544] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:32.690122] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-11. [2025-09-17T02:21:33.490219] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-11. [2025-09-17T02:21:33.676208] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:21:33.695166] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T02:21:34.077703] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T02:21:34.290169] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-17T02:21:35.090165] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-17T02:21:35.301600] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T02:21:35.890159] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-17T02:21:36.065171] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T02:21:36.690155] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-17T02:21:37.490204] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-17T02:21:37.508628] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T02:21:37.691606] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:21:38.097401] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T02:21:38.290165] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-17T02:21:38.631264] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T02:21:39.090164] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-17T02:21:39.539358] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T02:21:39.890187] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-17T02:21:40.690158] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-17T02:21:41.047958] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:21:41.301438] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T02:21:41.490145] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-17T02:21:42.290157] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-17T02:21:42.474252] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:21:42.780346] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T02:21:43.090155] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-17T02:21:43.575298] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T02:21:43.890156] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-17T02:21:44.690135] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-17T02:21:45.490405] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-17T02:21:45.491599] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T02:21:45.624500] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T02:21:46.290130] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-17T02:21:46.341396] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T02:21:47.090134] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-17T02:21:47.890140] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-17T02:21:47.974852] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T02:21:48.055395] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:21:48.057545] [INFO ] [REMOTE ] BGR: Full fetch complete (18344 records). [2025-09-17T02:21:48.057726] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-17T02:21:48.242947] [WARN ] [VALIDATOR ] BGR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T02:21:48.243314] [FATAL] [MAIN ] BGR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:21:48.243377] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:21:48.243468] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-17T02:21:48.243558] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-09-17T02:21:48.243606] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-09-17T02:21:48.244053] [DEBUG] [LOCAL ] BGR: Deleted derivative data file. [2025-09-17T02:21:48.244165] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGR took 31.1s. Estimated remaining: 5h 3m 6s. Rate: 7.0 symbols/min [2025-09-17T02:21:48.412127] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:48.422073] [DEBUG] [LOCAL ] BGX: Loaded 7749 existing records from primary storage. [2025-09-17T02:21:48.422220] [INFO ] [MAIN ] BGX: Loaded 7749 existing records. [2025-09-17T02:21:48.616410] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:48.617342] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T02:21:48.617563] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-17T02:21:48.621384] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-17T02:21:48.622098] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-17T02:21:48.622171] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-17T02:21:48.695185] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-17T02:21:48.991075] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:49.490189] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-11. [2025-09-17T02:21:49.757392] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T02:21:50.242916] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T02:21:50.290141] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-17T02:21:51.078541] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:21:51.090108] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-17T02:21:51.880205] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T02:21:51.890089] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-17T02:21:52.457268] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T02:21:52.690139] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-17T02:21:53.490136] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-17T02:21:54.290196] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-17T02:21:54.408040] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T02:21:54.474945] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:21:55.090246] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-17T02:21:55.155203] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T02:21:55.890148] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-17T02:21:56.689345] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T02:21:56.691802] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-17T02:21:56.827504] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:21:57.490156] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-17T02:21:57.743779] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:21:57.984355] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T02:21:58.290179] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-17T02:21:59.091909] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T02:21:59.090903] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-17T02:21:59.890154] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-17T02:22:00.676974] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:22:00.690070] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-17T02:22:00.791976] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:22:01.490147] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-17T02:22:01.499111] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T02:22:02.290087] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-17T02:22:02.691404] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T02:22:03.090144] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-17T02:22:03.857117] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T02:22:03.890122] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-17T02:22:04.040154] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:22:04.472176] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T02:22:04.475790] [INFO ] [REMOTE ] BGT: Full fetch complete (24486 records). [2025-09-17T02:22:04.475964] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-17T02:22:04.700038] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-17T02:22:04.864107] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-17T02:22:04.864237] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-17T02:22:04.864778] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-17T02:22:04.864866] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-17T02:22:04.865836] [DEBUG] [LOCAL ] BGT: Trimmed 24486 records to 16701 (keeping 200 days of data) [2025-09-17T02:22:04.971326] [DEBUG] [LOCAL ] BGT: Primary data saved (16701 records). [2025-09-17T02:22:04.971498] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-17T02:22:04.971594] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGT took 33.3s. Estimated remaining: 5h 4m 3s. Rate: 6.9 symbols/min [2025-09-17T02:22:05.139517] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:05.155584] [DEBUG] [LOCAL ] BGY: Loaded 16395 existing records from primary storage. [2025-09-17T02:22:05.155746] [INFO ] [MAIN ] BGY: Loaded 16395 existing records. [2025-09-17T02:22:05.342422] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:05.352916] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-17T02:22:05.353667] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-17T02:22:05.354121] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T02:22:05.357780] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-17T02:22:05.358288] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-17T02:22:05.499837] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-17T02:22:05.722701] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:06.218854] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T02:22:06.290175] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-17T02:22:07.090157] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-17T02:22:07.210879] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:22:07.212939] [INFO ] [REMOTE ] BGSF: Full fetch complete (7233 records). [2025-09-17T02:22:07.213042] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-17T02:22:07.582610] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-17T02:22:07.582737] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-17T02:22:07.582943] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-17T02:22:07.582995] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-17T02:22:07.583444] [DEBUG] [LOCAL ] BGSF: Trimmed 7233 records to 5765 (keeping 200 days of data) [2025-09-17T02:22:07.619307] [DEBUG] [LOCAL ] BGSF: Primary data saved (5765 records). [2025-09-17T02:22:07.619508] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-17T02:22:07.619664] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGSF took 37.2s. Estimated remaining: 5h 3m 6s. Rate: 6.9 symbols/min [2025-09-17T02:22:07.791246] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:07.809595] [DEBUG] [LOCAL ] BH: Loaded 13261 existing records from primary storage. [2025-09-17T02:22:07.809809] [INFO ] [MAIN ] BH: Loaded 13261 existing records. [2025-09-17T02:22:07.895259] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-17T02:22:07.966722] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:22:08.001851] [INFO ] [REMOTE ] BGX: Full fetch complete (15710 records). [2025-09-17T02:22:08.006949] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:08.007084] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-17T02:22:08.007316] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-17T02:22:08.007392] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-17T02:22:08.039329] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-17T02:22:08.083611] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-17T02:22:08.714589] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-11. [2025-09-17T02:22:08.740500] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-17T02:22:08.740619] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-17T02:22:08.744261] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-17T02:22:08.747682] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:08.748188] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-17T02:22:08.748874] [DEBUG] [LOCAL ] BGX: Trimmed 15710 records to 10884 (keeping 200 days of data) [2025-09-17T02:22:08.815764] [DEBUG] [LOCAL ] BGX: Primary data saved (10884 records). [2025-09-17T02:22:08.815903] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-17T02:22:08.815996] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGX took 20.6s. Estimated remaining: 5h 1m 58s. Rate: 7.0 symbols/min [2025-09-17T02:22:08.981957] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:09.015613] [DEBUG] [LOCAL ] BHC: Loaded 34553 existing records from primary storage. [2025-09-17T02:22:09.015825] [INFO ] [MAIN ] BHC: Loaded 34553 existing records. [2025-09-17T02:22:09.195263] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:09.195540] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-17T02:22:09.195600] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-17T02:22:09.196395] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-17T02:22:09.196456] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-17T02:22:09.494690] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-11. [2025-09-17T02:22:09.554331] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:09.588542] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T02:22:09.830984] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:22:09.997134] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T02:22:10.290181] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-11. [2025-09-17T02:22:11.090154] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-17T02:22:11.827604] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:22:11.890122] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-17T02:22:12.690182] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-17T02:22:12.858831] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:22:12.928900] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T02:22:13.490137] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-17T02:22:13.778056] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:22:14.290176] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-17T02:22:15.006858] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T02:22:15.013450] [INFO ] [REMOTE ] BGS: Full fetch complete (72247 records). [2025-09-17T02:22:15.013612] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-17T02:22:15.095320] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-17T02:22:15.411059] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-17T02:22:15.411321] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-17T02:22:15.412101] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-17T02:22:15.412193] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-17T02:22:15.426418] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T02:22:15.431965] [DEBUG] [LOCAL ] BGS: Trimmed 72247 records to 50432 (keeping 200 days of data) [2025-09-17T02:22:15.721284] [DEBUG] [LOCAL ] BGS: Primary data saved (50432 records). [2025-09-17T02:22:15.721446] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-17T02:22:15.722226] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGS took 46.5s. Estimated remaining: 5h 1m 36s. Rate: 7.0 symbols/min [2025-09-17T02:22:15.895053] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:15.895184] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-17T02:22:15.917475] [DEBUG] [LOCAL ] BHE: Loaded 17617 existing records from primary storage. [2025-09-17T02:22:15.917635] [INFO ] [MAIN ] BHE: Loaded 17617 existing records. [2025-09-17T02:22:16.092497] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:16.092758] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-17T02:22:16.092840] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-17T02:22:16.093500] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-17T02:22:16.093562] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-17T02:22:16.443010] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:16.690139] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-17T02:22:16.754774] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:22:16.797090] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:22:17.490231] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-17T02:22:17.504837] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:22:18.290140] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-17T02:22:18.418379] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:22:19.090133] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-17T02:22:19.770037] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T02:22:19.890137] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-17T02:22:20.319707] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T02:22:20.501410] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T02:22:20.690165] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-11. [2025-09-17T02:22:21.490102] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-17T02:22:21.875229] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:22:22.290134] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-17T02:22:22.703677] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T02:22:23.090199] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-17T02:22:23.105308] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:22:23.890165] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-17T02:22:24.695231] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-17T02:22:24.710568] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T02:22:25.158636] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:22:25.455250] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T02:22:25.490120] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-17T02:22:26.290132] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-17T02:22:26.490529] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T02:22:27.090104] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-17T02:22:27.482835] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T02:22:27.890138] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-17T02:22:28.690133] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-17T02:22:28.890625] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T02:22:28.913669] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:22:29.490143] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-17T02:22:29.526055] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T02:22:30.290136] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-17T02:22:30.548925] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T02:22:31.090101] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-17T02:22:31.419232] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T02:22:31.890167] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-17T02:22:32.449819] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T02:22:32.690129] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-17T02:22:33.127028] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T02:22:33.490160] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-17T02:22:34.160335] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:22:34.290114] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-17T02:22:34.726540] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:22:35.090155] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-17T02:22:35.621447] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T02:22:35.880792] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:22:35.890083] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-17T02:22:36.690185] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-17T02:22:36.700445] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:22:36.703202] [INFO ] [REMOTE ] BH: Full fetch complete (19012 records). [2025-09-17T02:22:36.703292] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-17T02:22:37.068438] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-17T02:22:37.068566] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-17T02:22:37.068936] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-17T02:22:37.069012] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-17T02:22:37.069973] [DEBUG] [LOCAL ] BH: Trimmed 19012 records to 15192 (keeping 200 days of data) [2025-09-17T02:22:37.160208] [DEBUG] [LOCAL ] BH: Primary data saved (15192 records). [2025-09-17T02:22:37.160375] [INFO ] [MAIN ] BH: Full history saved. [2025-09-17T02:22:37.160471] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BH took 29.5s. Estimated remaining: 5h 3m 9s. Rate: 6.9 symbols/min [2025-09-17T02:22:37.333843] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:37.351553] [DEBUG] [LOCAL ] BHK: Loaded 18457 existing records from primary storage. [2025-09-17T02:22:37.351719] [INFO ] [MAIN ] BHK: Loaded 18457 existing records. [2025-09-17T02:22:37.499813] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-17T02:22:37.529435] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:37.529719] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-17T02:22:37.529779] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-17T02:22:37.530405] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-17T02:22:37.530465] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-17T02:22:37.884540] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:38.059268] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T02:22:38.290136] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-17T02:22:39.090160] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-11. [2025-09-17T02:22:39.245515] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:22:39.474431] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:22:39.683516] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T02:22:39.890133] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-17T02:22:40.690169] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-17T02:22:40.962980] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:22:41.490188] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-17T02:22:41.798016] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:22:42.290195] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-17T02:22:42.369536] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:22:42.372237] [INFO ] [REMOTE ] BGY: Full fetch complete (33960 records). [2025-09-17T02:22:42.372338] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-17T02:22:42.759923] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-17T02:22:42.760032] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-17T02:22:42.760461] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-17T02:22:42.760513] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-17T02:22:42.761305] [DEBUG] [LOCAL ] BGY: Trimmed 33960 records to 23194 (keeping 200 days of data) [2025-09-17T02:22:42.895355] [DEBUG] [LOCAL ] BGY: Primary data saved (23194 records). [2025-09-17T02:22:42.895518] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-17T02:22:42.895629] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BGY took 37.9s. Estimated remaining: 5h 2m 37s. Rate: 6.9 symbols/min [2025-09-17T02:22:43.074369] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:43.097347] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-17T02:22:43.114324] [DEBUG] [LOCAL ] BHP: Loaded 39761 existing records from primary storage. [2025-09-17T02:22:43.114519] [INFO ] [MAIN ] BHP: Loaded 39761 existing records. [2025-09-17T02:22:43.296295] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:43.296608] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-17T02:22:43.296811] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-17T02:22:43.302982] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-17T02:22:43.309832] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-17T02:22:43.342539] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:22:43.684741] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:43.890144] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-17T02:22:44.690159] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-11. [2025-09-17T02:22:44.829223] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:22:44.932587] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T02:22:45.490156] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-17T02:22:46.290122] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-17T02:22:46.520168] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T02:22:46.553851] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:22:47.090187] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-17T02:22:47.219685] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T02:22:47.890150] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-17T02:22:48.100928] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T02:22:48.690113] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-17T02:22:49.490197] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-17T02:22:49.692972] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:22:49.696059] [INFO ] [REMOTE ] BHE: Full fetch complete (36338 records). [2025-09-17T02:22:49.696182] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-17T02:22:50.117976] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-17T02:22:50.120238] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-17T02:22:50.120167] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T02:22:50.121066] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-17T02:22:50.131432] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-17T02:22:50.133175] [DEBUG] [LOCAL ] BHE: Trimmed 36338 records to 25454 (keeping 200 days of data) [2025-09-17T02:22:50.290399] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-17T02:22:50.290494] [DEBUG] [LOCAL ] BHE: Primary data saved (25454 records). [2025-09-17T02:22:50.291585] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-17T02:22:50.291704] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHE took 34.6s. Estimated remaining: 5h 2m 19s. Rate: 6.9 symbols/min [2025-09-17T02:22:50.468638] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:50.484457] [DEBUG] [LOCAL ] BHR: Loaded 15316 existing records from primary storage. [2025-09-17T02:22:50.484616] [INFO ] [MAIN ] BHR: Loaded 15316 existing records. [2025-09-17T02:22:50.667879] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:50.668126] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-17T02:22:50.668197] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-17T02:22:50.668749] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-17T02:22:50.668824] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-17T02:22:51.040387] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:51.055942] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:22:51.061976] [INFO ] [REMOTE ] BHC: Full fetch complete (66532 records). [2025-09-17T02:22:51.062106] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-17T02:22:51.095216] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-17T02:22:51.539837] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-17T02:22:51.540011] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-17T02:22:51.541260] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-17T02:22:51.541375] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-17T02:22:51.543946] [DEBUG] [LOCAL ] BHC: Trimmed 66532 records to 46774 (keeping 200 days of data) [2025-09-17T02:22:51.891791] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-11. [2025-09-17T02:22:52.001746] [DEBUG] [LOCAL ] BHC: Primary data saved (46774 records). [2025-09-17T02:22:52.002011] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-17T02:22:52.002189] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHC took 43.2s. Estimated remaining: 5h 1m 16s. Rate: 7.0 symbols/min [2025-09-17T02:22:52.319880] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:52.326176] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-17T02:22:52.337706] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T02:22:52.336623] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-17T02:22:52.344547] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-17T02:22:52.345989] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-17T02:22:52.346191] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-17T02:22:52.346624] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-17T02:22:52.551026] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T02:22:52.698759] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-17T02:22:52.840925] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:52.855934] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:22:53.490141] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-17T02:22:53.728715] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T02:22:54.290119] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-17T02:22:54.575117] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T02:22:55.090132] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-17T02:22:55.863104] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:22:55.890083] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-17T02:22:56.299399] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:22:56.690119] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-17T02:22:57.490159] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-17T02:22:57.783239] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T02:22:57.995943] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T02:22:58.125853] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T02:22:58.290167] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-17T02:22:59.090138] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-11. [2025-09-17T02:22:59.215554] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:22:59.443712] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T02:22:59.890137] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-17T02:23:00.318757] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T02:23:00.690130] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-17T02:23:01.490158] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-17T02:23:01.749213] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T02:23:02.290129] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-17T02:23:03.090130] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-17T02:23:03.890152] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-17T02:23:04.888007] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (3.40 seconds). [2025-09-17T02:23:04.889015] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-17T02:23:05.034611] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:23:05.247773] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T02:23:05.260859] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-17T02:23:05.490119] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-17T02:23:05.895560] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (3.61 seconds). [2025-09-17T02:23:06.290151] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-17T02:23:06.576420] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T02:23:07.090123] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-17T02:23:07.483265] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T02:23:07.890200] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-17T02:23:08.164964] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T02:23:08.250588] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-17T02:23:08.690138] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-17T02:23:09.089353] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T02:23:09.490168] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-17T02:23:10.290104] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-17T02:23:10.700825] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:23:11.090178] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-17T02:23:11.890105] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-17T02:23:12.237153] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:23:12.287968] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T02:23:12.690235] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-17T02:23:13.014019] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T02:23:13.018031] [INFO ] [REMOTE ] BHK: Full fetch complete (29517 records). [2025-09-17T02:23:13.018160] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-17T02:23:13.402885] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-17T02:23:13.403034] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-17T02:23:13.403471] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-17T02:23:13.403540] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-17T02:23:13.404945] [DEBUG] [LOCAL ] BHK: Trimmed 29517 records to 22400 (keeping 200 days of data) [2025-09-17T02:23:13.501579] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-17T02:23:13.550047] [DEBUG] [LOCAL ] BHK: Primary data saved (22400 records). [2025-09-17T02:23:13.550209] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-17T02:23:13.550328] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHK took 36.4s. Estimated remaining: 5h 2m 48s. Rate: 6.9 symbols/min [2025-09-17T02:23:13.719467] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:13.761085] [DEBUG] [LOCAL ] BHVN: Loaded 37493 existing records from primary storage. [2025-09-17T02:23:13.761298] [INFO ] [MAIN ] BHVN: Loaded 37493 existing records. [2025-09-17T02:23:13.893513] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T02:23:13.947543] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:13.947811] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-17T02:23:13.947881] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-17T02:23:13.948835] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-17T02:23:13.948900] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-17T02:23:14.290942] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-17T02:23:14.312264] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:14.687505] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T02:23:14.804367] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T02:23:15.090153] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-11. [2025-09-17T02:23:15.890172] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-17T02:23:16.297917] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:23:16.690115] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-17T02:23:16.949783] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T02:23:17.490164] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-17T02:23:18.243481] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:23:18.290090] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-17T02:23:19.070455] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:23:19.090088] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-17T02:23:19.536943] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:23:19.724269] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T02:23:19.732216] [INFO ] [REMOTE ] BHP: Full fetch complete (77085 records). [2025-09-17T02:23:19.732433] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-17T02:23:19.894171] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-17T02:23:20.131700] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-17T02:23:20.131825] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-17T02:23:20.132706] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-17T02:23:20.132784] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-17T02:23:20.134377] [DEBUG] [LOCAL ] BHP: Trimmed 77085 records to 53394 (keeping 200 days of data) [2025-09-17T02:23:20.469555] [DEBUG] [LOCAL ] BHP: Primary data saved (53394 records). [2025-09-17T02:23:20.469734] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-17T02:23:20.469830] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHP took 37.6s. Estimated remaining: 5h 2m 26s. Rate: 6.9 symbols/min [2025-09-17T02:23:20.636147] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:20.672242] [DEBUG] [LOCAL ] BILL: Loaded 39007 existing records from primary storage. [2025-09-17T02:23:20.672413] [INFO ] [MAIN ] BILL: Loaded 39007 existing records. [2025-09-17T02:23:20.695207] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-17T02:23:20.855250] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:20.855594] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-17T02:23:20.855700] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-17T02:23:20.856694] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-17T02:23:20.856761] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-17T02:23:21.162993] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T02:23:21.186539] [INFO ] [REMOTE ] BHV: Full fetch complete (1387 records). [2025-09-17T02:23:21.220377] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:21.220501] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-17T02:23:21.418596] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T02:23:21.418971] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:23:21.419145] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:23:21.419224] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-17T02:23:21.419320] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-17T02:23:21.419378] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-17T02:23:21.419486] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-17T02:23:21.419580] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHV took 29.4s. Estimated remaining: 5h 1m 18s. Rate: 7.0 symbols/min [2025-09-17T02:23:21.495330] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-11. [2025-09-17T02:23:21.616045] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:21.620551] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T02:23:21.646729] [DEBUG] [LOCAL ] BIO: Loaded 18405 existing records from primary storage. [2025-09-17T02:23:21.646911] [INFO ] [MAIN ] BIO: Loaded 18405 existing records. [2025-09-17T02:23:21.825928] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:21.826249] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-17T02:23:21.826340] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-17T02:23:21.826958] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-17T02:23:21.827034] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-17T02:23:22.181670] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:22.290121] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-11. [2025-09-17T02:23:23.090140] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-17T02:23:23.316703] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T02:23:23.424490] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T02:23:23.890146] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-17T02:23:24.539854] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:23:24.690138] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-17T02:23:24.934302] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T02:23:25.490137] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-17T02:23:26.290185] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-17T02:23:26.492544] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:23:26.523894] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T02:23:27.090157] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-17T02:23:27.346106] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T02:23:27.890136] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-17T02:23:28.690137] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-17T02:23:28.913453] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:23:29.476383] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:23:29.482188] [INFO ] [REMOTE ] BHR: Full fetch complete (30265 records). [2025-09-17T02:23:29.482482] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-17T02:23:29.495470] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-17T02:23:29.811109] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:23:29.901073] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-17T02:23:29.901196] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-17T02:23:29.901666] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-17T02:23:29.901740] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-17T02:23:29.902817] [DEBUG] [LOCAL ] BHR: Trimmed 30265 records to 21378 (keeping 200 days of data) [2025-09-17T02:23:30.028377] [DEBUG] [LOCAL ] BHR: Primary data saved (21378 records). [2025-09-17T02:23:30.028552] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-17T02:23:30.028691] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHR took 39.7s. Estimated remaining: 5h 1m 9s. Rate: 7.0 symbols/min [2025-09-17T02:23:30.198463] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:30.231434] [DEBUG] [LOCAL ] BIP: Loaded 28099 existing records from primary storage. [2025-09-17T02:23:30.231617] [INFO ] [MAIN ] BIP: Loaded 28099 existing records. [2025-09-17T02:23:30.296842] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-17T02:23:30.418668] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:30.418942] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-17T02:23:30.419008] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-17T02:23:30.419796] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-17T02:23:30.419866] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-17T02:23:30.784721] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:30.798399] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T02:23:31.090158] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-17T02:23:31.890189] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-17T02:23:31.937466] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:23:32.690191] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-17T02:23:32.764636] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:23:33.229935] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T02:23:33.490144] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-17T02:23:34.290182] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-17T02:23:34.348221] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:23:35.090112] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-17T02:23:35.240441] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:23:35.577839] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:23:35.890145] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-17T02:23:36.690118] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-17T02:23:36.831542] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:23:37.135165] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:23:37.490168] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-17T02:23:38.054295] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T02:23:38.290196] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-17T02:23:38.692607] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T02:23:39.090133] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-17T02:23:39.890175] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-17T02:23:40.173771] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T02:23:40.201745] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T02:23:40.690122] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-17T02:23:41.490149] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-17T02:23:41.695396] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T02:23:42.290148] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-11. [2025-09-17T02:23:42.518337] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T02:23:42.625461] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T02:23:43.090133] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-17T02:23:43.431052] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:23:43.890175] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-17T02:23:44.276610] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:23:44.286394] [INFO ] [REMOTE ] BHVN: Full fetch complete (68827 records). [2025-09-17T02:23:44.286693] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-17T02:23:44.698497] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-17T02:23:44.887764] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-17T02:23:44.887945] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-17T02:23:44.889314] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-17T02:23:44.889419] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-17T02:23:44.891417] [DEBUG] [LOCAL ] BHVN: Trimmed 68827 records to 49499 (keeping 200 days of data) [2025-09-17T02:23:45.219798] [DEBUG] [LOCAL ] BHVN: Primary data saved (49499 records). [2025-09-17T02:23:45.219984] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-17T02:23:45.220083] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHVN took 31.7s. Estimated remaining: 5h 1m 50s. Rate: 6.9 symbols/min [2025-09-17T02:23:45.407964] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:45.430167] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:23:45.464943] [DEBUG] [LOCAL ] BIPC: Loaded 30211 existing records from primary storage. [2025-09-17T02:23:45.465124] [INFO ] [MAIN ] BIPC: Loaded 30211 existing records. [2025-09-17T02:23:45.497624] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-17T02:23:45.653767] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:45.654030] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-17T02:23:45.654091] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-17T02:23:45.655146] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-17T02:23:45.655219] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-17T02:23:46.033965] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:46.169100] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:23:46.290136] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-17T02:23:47.024501] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:23:47.090098] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-17T02:23:47.890243] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-17T02:23:48.183203] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:23:48.221154] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T02:23:48.690176] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-17T02:23:48.738688] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T02:23:48.741816] [INFO ] [REMOTE ] BIO: Full fetch complete (34106 records). [2025-09-17T02:23:48.742004] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-17T02:23:49.118468] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-17T02:23:49.118567] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-17T02:23:49.119041] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-17T02:23:49.119098] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-17T02:23:49.119983] [DEBUG] [LOCAL ] BIO: Trimmed 34106 records to 25844 (keeping 200 days of data) [2025-09-17T02:23:49.277820] [DEBUG] [LOCAL ] BIO: Primary data saved (25844 records). [2025-09-17T02:23:49.277978] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-17T02:23:49.278071] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BIO took 27.9s. Estimated remaining: 5h 1m 7s. Rate: 7.0 symbols/min [2025-09-17T02:23:49.448738] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:49.452012] [DEBUG] [LOCAL ] BIPH: Loaded 1585 existing records from primary storage. [2025-09-17T02:23:49.452098] [INFO ] [MAIN ] BIPH: Loaded 1585 existing records. [2025-09-17T02:23:49.495386] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-11. [2025-09-17T02:23:49.637185] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:49.637461] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-17T02:23:49.637522] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-17T02:23:49.637728] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-17T02:23:49.637792] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-17T02:23:50.034978] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:50.290129] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-17T02:23:50.355054] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:23:51.016234] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:23:51.090141] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-17T02:23:51.890139] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-17T02:23:52.224287] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:23:52.489470] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T02:23:52.690131] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-11. [2025-09-17T02:23:53.162873] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T02:23:53.470819] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T02:23:53.490078] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-17T02:23:54.290129] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-17T02:23:54.510394] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T02:23:55.090134] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-17T02:23:55.890185] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-17T02:23:56.161700] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T02:23:56.168239] [INFO ] [REMOTE ] BILL: Full fetch complete (75333 records). [2025-09-17T02:23:56.168413] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-17T02:23:56.497072] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T02:23:56.598019] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-17T02:23:56.598146] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-17T02:23:56.599058] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-17T02:23:56.599130] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-17T02:23:56.600744] [DEBUG] [LOCAL ] BILL: Trimmed 75333 records to 52322 (keeping 200 days of data) [2025-09-17T02:23:56.704940] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-17T02:23:56.907138] [DEBUG] [LOCAL ] BILL: Primary data saved (52322 records). [2025-09-17T02:23:56.907309] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-17T02:23:56.907405] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BILL took 36.4s. Estimated remaining: 5h 0m 51s. Rate: 7.0 symbols/min [2025-09-17T02:23:57.312219] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T02:23:57.490135] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-17T02:23:58.290134] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-17T02:23:58.326571] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:23:58.635688] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:23:58.887920] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T02:23:59.090117] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-17T02:23:59.890175] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-17T02:24:00.541387] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T02:24:00.661037] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:24:00.690087] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-17T02:24:01.490135] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-17T02:24:02.180952] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T02:24:02.290140] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-17T02:24:02.426995] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T02:24:02.432541] [INFO ] [REMOTE ] BIP: Full fetch complete (56039 records). [2025-09-17T02:24:02.432730] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-17T02:24:02.830771] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-17T02:24:02.830886] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-17T02:24:02.831509] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-17T02:24:02.831565] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-17T02:24:02.832876] [DEBUG] [LOCAL ] BIP: Trimmed 56039 records to 39768 (keeping 200 days of data) [2025-09-17T02:24:03.077918] [DEBUG] [LOCAL ] BIP: Primary data saved (39768 records). [2025-09-17T02:24:03.078089] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-17T02:24:03.078182] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIP took 33.0s. Estimated remaining: 5h 0m 24s. Rate: 7.0 symbols/min [2025-09-17T02:24:03.090093] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-17T02:24:03.940097] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T02:24:03.942058] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-17T02:24:04.416494] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T02:24:04.690137] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-17T02:24:05.080678] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T02:24:05.118221] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-17T02:24:05.490139] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-17T02:24:06.290196] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-17T02:24:06.815773] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T02:24:07.062672] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:24:07.090081] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-17T02:24:07.890138] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-17T02:24:08.351459] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T02:24:08.607793] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T02:24:08.690205] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-17T02:24:09.164779] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T02:24:09.490138] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-17T02:24:09.808352] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T02:24:09.809271] [INFO ] [REMOTE ] BIPH: Full fetch complete (4384 records). [2025-09-17T02:24:09.809354] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-17T02:24:10.169425] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-17T02:24:10.169605] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-17T02:24:10.170544] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-17T02:24:10.170613] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-17T02:24:10.171079] [DEBUG] [LOCAL ] BIPH: Trimmed 4384 records to 2628 (keeping 200 days of data) [2025-09-17T02:24:10.187808] [DEBUG] [LOCAL ] BIPH: Primary data saved (2628 records). [2025-09-17T02:24:10.187926] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-17T02:24:10.188032] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIPH took 20.9s. Estimated remaining: 5h 0m 4s. Rate: 7.0 symbols/min [2025-09-17T02:24:10.290142] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-17T02:24:11.818437] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:24:11.827351] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-17T02:24:13.421904] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T02:24:13.431582] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-17T02:24:16.232135] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-17T02:24:16.241531] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-17T02:24:17.136935] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:24:17.142455] [INFO ] [REMOTE ] BIPC: Full fetch complete (59342 records). [2025-09-17T02:24:17.142724] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-17T02:24:17.533030] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-17T02:24:17.533141] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-17T02:24:17.533777] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-17T02:24:17.533865] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-17T02:24:17.535108] [DEBUG] [LOCAL ] BIPC: Trimmed 59342 records to 41793 (keeping 200 days of data) [2025-09-17T02:24:17.806506] [DEBUG] [LOCAL ] BIPC: Primary data saved (41793 records). [2025-09-17T02:24:17.806951] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-17T02:24:17.807061] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 32.6s. Estimated remaining: 4h 59m 48s. Rate: 7.0 symbols/min [2025-09-17T02:24:18.459320] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.467831] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.506150] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.507700] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.513784] [DEBUG] [LOCAL ] BIPJ: Loaded 2171 existing records from primary storage. [2025-09-17T02:24:18.515769] [DEBUG] [LOCAL ] BIPI: Loaded 2076 existing records from primary storage. [2025-09-17T02:24:18.516177] [INFO ] [MAIN ] BIPI: Loaded 2076 existing records. [2025-09-17T02:24:18.516065] [INFO ] [MAIN ] BIPJ: Loaded 2171 existing records. [2025-09-17T02:24:18.907229] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:18.876111] [DEBUG] [LOCAL ] BIT: Loaded 16575 existing records from primary storage. [2025-09-17T02:24:18.938781] [INFO ] [MAIN ] BIT: Loaded 16575 existing records. [2025-09-17T02:24:18.937698] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:18.979597] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-17T02:24:18.986487] [DEBUG] [LOCAL ] BIRK: Loaded 37975 existing records from primary storage. [2025-09-17T02:24:19.004154] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-17T02:24:19.019980] [INFO ] [MAIN ] BIRK: Loaded 37975 existing records. [2025-09-17T02:24:19.009625] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-17T02:24:19.046572] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-17T02:24:19.078996] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-17T02:24:19.079369] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-17T02:24:19.151198] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-17T02:24:19.239518] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-17T02:24:19.414711] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:19.499267] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:19.469846] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-17T02:24:19.540619] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-17T02:24:19.596477] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-17T02:24:19.602135] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-17T02:24:19.640483] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-17T02:24:19.680734] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-17T02:24:19.706101] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-17T02:24:19.767093] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-17T02:24:20.205369] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.250049] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-11. [2025-09-17T02:24:20.539024] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.586630] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-11. [2025-09-17T02:24:20.797946] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.816918] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.817211] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-11. [2025-09-17T02:24:20.817633] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-11. [2025-09-17T02:24:21.151775] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T02:24:21.153101] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-17T02:24:21.189169] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T02:24:21.190685] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-17T02:24:21.736957] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T02:24:21.739252] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-17T02:24:21.760237] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T02:24:21.761867] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-17T02:24:21.925311] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:24:21.929744] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-17T02:24:22.241945] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T02:24:22.243239] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-17T02:24:22.342285] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:24:22.351808] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-17T02:24:22.356837] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T02:24:22.358458] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-17T02:24:22.567346] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T02:24:22.751243] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T02:24:22.765778] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:24:23.090167] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-17T02:24:23.890179] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-17T02:24:24.092198] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T02:24:24.158471] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T02:24:24.255595] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T02:24:24.690238] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-17T02:24:25.490218] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-17T02:24:26.198368] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T02:24:26.298723] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-17T02:24:26.316812] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:24:26.998949] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T02:24:27.090119] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-17T02:24:27.605005] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T02:24:27.890149] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-17T02:24:27.996031] [DEBUG] [REMOTE ] BIT: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T02:24:27.996383] [WARN ] [REMOTE ] BIT: No data returned for month 2025-02 [2025-09-17T02:24:28.690178] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-17T02:24:29.490149] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-17T02:24:29.728844] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T02:24:30.009489] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-17T02:24:30.290148] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-17T02:24:30.841074] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T02:24:31.090164] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-17T02:24:31.890133] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-17T02:24:32.648168] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:24:32.674127] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T02:24:32.690091] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-17T02:24:33.249584] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T02:24:33.250722] [INFO ] [REMOTE ] BIPI: Full fetch complete (5345 records). [2025-09-17T02:24:33.250804] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-17T02:24:33.495355] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-17T02:24:33.607294] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-17T02:24:33.607413] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-17T02:24:33.607625] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-17T02:24:33.607707] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-17T02:24:33.608113] [DEBUG] [LOCAL ] BIPI: Trimmed 5345 records to 3447 (keeping 200 days of data) [2025-09-17T02:24:33.630447] [DEBUG] [LOCAL ] BIPI: Primary data saved (3447 records). [2025-09-17T02:24:33.630569] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-17T02:24:33.630688] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 15.8s. Estimated remaining: 5h 0m 33s. Rate: 6.9 symbols/min [2025-09-17T02:24:33.805809] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:33.844139] [DEBUG] [LOCAL ] BJ: Loaded 38269 existing records from primary storage. [2025-09-17T02:24:33.844346] [INFO ] [MAIN ] BJ: Loaded 38269 existing records. [2025-09-17T02:24:34.024848] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:34.025112] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-17T02:24:34.025173] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-17T02:24:34.026240] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-17T02:24:34.026319] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-17T02:24:34.146942] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T02:24:34.295258] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-17T02:24:34.394407] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:35.090094] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-17T02:24:35.461807] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:24:35.890138] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-17T02:24:36.667893] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T02:24:36.690074] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-17T02:24:36.900820] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T02:24:37.490158] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-11. [2025-09-17T02:24:37.739747] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:24:38.290200] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-17T02:24:39.090203] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-17T02:24:39.139579] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:24:39.407096] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T02:24:39.542764] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T02:24:39.890190] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-17T02:24:40.690128] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-17T02:24:41.178093] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:24:41.490172] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-17T02:24:42.001298] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T02:24:42.290179] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-17T02:24:42.864714] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T02:24:43.090150] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-17T02:24:43.162134] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:24:43.890152] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-17T02:24:44.690169] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-17T02:24:44.836505] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:24:45.249110] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T02:24:45.253574] [INFO ] [REMOTE ] BIT: Full fetch complete (27792 records). [2025-09-17T02:24:45.253713] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-17T02:24:45.360062] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T02:24:45.445155] [WARN ] [VALIDATOR ] BIT: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T02:24:45.445533] [FATAL] [MAIN ] BIT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:24:45.445587] [WARN ] [MAIN ] BIT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:24:45.445632] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-17T02:24:45.445731] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-09-17T02:24:45.445776] [INFO ] [LOCAL ] BIT: Starting deletion of derivative data. [2025-09-17T02:24:45.446180] [DEBUG] [LOCAL ] BIT: Deleted derivative data file. [2025-09-17T02:24:45.446279] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIT took 27.6s. Estimated remaining: 5h 0m 48s. Rate: 6.9 symbols/min [2025-09-17T02:24:45.499625] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-17T02:24:45.618660] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:45.618898] [DEBUG] [LOCAL ] BK: No existing data file found in primary storage. [2025-09-17T02:24:45.618950] [WARN ] [MAIN ] BK: No existing data found, performing full refresh instead. [2025-09-17T02:24:45.619055] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-17T02:24:45.619136] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-17T02:24:45.619193] [DEBUG] [LOCAL ] BK: No primary data file found to delete. [2025-09-17T02:24:45.619234] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-17T02:24:45.977279] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:46.290159] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-17T02:24:46.738429] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:24:47.090143] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-17T02:24:47.545100] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:24:47.890110] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-11. [2025-09-17T02:24:47.952540] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:24:48.690128] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-17T02:24:49.490113] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-17T02:24:49.604163] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:24:50.266095] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T02:24:50.290075] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-17T02:24:50.930542] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T02:24:51.090138] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-17T02:24:51.895254] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-17T02:24:51.916203] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:24:52.690095] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-17T02:24:52.970337] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T02:24:53.065985] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T02:24:53.067018] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4258 records). [2025-09-17T02:24:53.067101] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-17T02:24:53.418349] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-17T02:24:53.418446] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-17T02:24:53.418560] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-17T02:24:53.418615] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-17T02:24:53.418996] [DEBUG] [LOCAL ] BIPJ: Trimmed 4258 records to 2907 (keeping 200 days of data) [2025-09-17T02:24:53.437402] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2907 records). [2025-09-17T02:24:53.437480] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-17T02:24:53.437561] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIPJ took 35.6s. Estimated remaining: 5h 0m 34s. Rate: 6.9 symbols/min [2025-09-17T02:24:53.495213] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-17T02:24:53.629237] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:53.670834] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:24:53.709106] [DEBUG] [LOCAL ] BKD: Loaded 37399 existing records from primary storage. [2025-09-17T02:24:53.709304] [INFO ] [MAIN ] BKD: Loaded 37399 existing records. [2025-09-17T02:24:53.884414] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:53.884706] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-17T02:24:53.884763] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-17T02:24:53.885617] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-17T02:24:53.885707] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-17T02:24:54.257298] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:54.290146] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-17T02:24:55.090202] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-11. [2025-09-17T02:24:55.227627] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T02:24:55.709910] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:24:55.890134] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-17T02:24:56.695382] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-17T02:24:56.715383] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:24:57.490176] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-17T02:24:57.727933] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T02:24:58.290174] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-17T02:24:58.561127] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T02:24:59.062600] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:24:59.068822] [INFO ] [REMOTE ] BIRK: Full fetch complete (72438 records). [2025-09-17T02:24:59.068961] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-17T02:24:59.100606] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-17T02:24:59.474335] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-17T02:24:59.474436] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-17T02:24:59.475306] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-17T02:24:59.475373] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-17T02:24:59.476812] [DEBUG] [LOCAL ] BIRK: Trimmed 72438 records to 50829 (keeping 200 days of data) [2025-09-17T02:24:59.771714] [DEBUG] [LOCAL ] BIRK: Primary data saved (50829 records). [2025-09-17T02:24:59.771951] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-17T02:24:59.772155] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIRK took 42.0s. Estimated remaining: 5h 0m 9s. Rate: 6.9 symbols/min [2025-09-17T02:24:59.891080] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-17T02:24:59.945923] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:59.982732] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:25:00.014475] [DEBUG] [LOCAL ] BKE: Loaded 25000 existing records from primary storage. [2025-09-17T02:25:00.014680] [INFO ] [MAIN ] BKE: Loaded 25000 existing records. [2025-09-17T02:25:00.191361] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:00.191600] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-17T02:25:00.191677] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-17T02:25:00.192427] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-17T02:25:00.192487] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-17T02:25:00.549982] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:00.587965] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T02:25:00.690101] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-11. [2025-09-17T02:25:01.490164] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-17T02:25:01.577535] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T02:25:02.175266] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T02:25:02.290161] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-17T02:25:03.090147] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-17T02:25:03.466166] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T02:25:03.646511] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T02:25:03.890130] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-17T02:25:04.283274] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T02:25:04.690156] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-17T02:25:05.381197] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:25:05.490115] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-17T02:25:06.290095] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-17T02:25:06.291788] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:25:06.892052] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T02:25:07.090139] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-17T02:25:07.800280] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T02:25:07.890134] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-17T02:25:08.690180] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-17T02:25:08.718076] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:25:09.490184] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-17T02:25:09.798845] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T02:25:10.232274] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T02:25:10.290171] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-17T02:25:10.548633] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T02:25:11.090230] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-17T02:25:11.890149] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-17T02:25:12.339044] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T02:25:12.690179] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-17T02:25:12.745503] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:25:13.324619] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T02:25:13.490157] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-17T02:25:14.290151] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-17T02:25:14.443164] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:25:14.748600] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T02:25:15.090101] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-17T02:25:15.130041] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T02:25:15.890179] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-17T02:25:16.690146] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-17T02:25:16.813247] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T02:25:16.819754] [INFO ] [REMOTE ] BJ: Full fetch complete (73547 records). [2025-09-17T02:25:16.819927] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-17T02:25:17.233217] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-17T02:25:17.233428] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-17T02:25:17.234242] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-17T02:25:17.234413] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-17T02:25:17.253206] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T02:25:17.259352] [DEBUG] [LOCAL ] BJ: Trimmed 73547 records to 51453 (keeping 200 days of data) [2025-09-17T02:25:17.260448] [INFO ] [REMOTE ] BK: Full fetch complete (77330 records). [2025-09-17T02:25:17.260887] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-17T02:25:17.502491] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-17T02:25:17.778863] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-17T02:25:17.779700] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-17T02:25:17.780870] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-17T02:25:17.781792] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-17T02:25:17.788774] [DEBUG] [LOCAL ] BK: Trimmed 77330 records to 53569 (keeping 200 days of data) [2025-09-17T02:25:18.006909] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T02:25:18.251709] [DEBUG] [LOCAL ] BJ: Primary data saved (51453 records). [2025-09-17T02:25:18.253972] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-17T02:25:18.255051] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BJ took 44.6s. Estimated remaining: 5h 1m 12s. Rate: 6.9 symbols/min [2025-09-17T02:25:18.295936] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-17T02:25:18.442772] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:18.537100] [DEBUG] [LOCAL ] BKH: Loaded 27582 existing records from primary storage. [2025-09-17T02:25:18.538580] [INFO ] [MAIN ] BKH: Loaded 27582 existing records. [2025-09-17T02:25:18.734687] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:18.737784] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-17T02:25:18.739979] [DEBUG] [LOCAL ] BK: Primary data saved (53569 records). [2025-09-17T02:25:18.740080] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-17T02:25:18.740254] [INFO ] [MAIN ] BK: Full history saved. [2025-09-17T02:25:18.740406] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BK took 33.3s. Estimated remaining: 5h 0m 4s. Rate: 6.9 symbols/min [2025-09-17T02:25:18.784336] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-17T02:25:18.816440] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-17T02:25:19.070045] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:19.296184] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:19.308748] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-11. [2025-09-17T02:25:19.310397] [DEBUG] [LOCAL ] BKKT: Loaded 26158 existing records from primary storage. [2025-09-17T02:25:19.310853] [INFO ] [MAIN ] BKKT: Loaded 26158 existing records. [2025-09-17T02:25:19.493988] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:19.494389] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-17T02:25:19.494513] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-17T02:25:19.504461] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-17T02:25:19.521566] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-17T02:25:19.556770] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T02:25:19.908536] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-17T02:25:19.908456] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:19.931587] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T02:25:20.466942] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:25:20.690166] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-11. [2025-09-17T02:25:21.490143] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-17T02:25:21.640284] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T02:25:22.126452] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T02:25:22.290133] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-17T02:25:22.816851] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:25:22.821364] [INFO ] [REMOTE ] BKE: Full fetch complete (50292 records). [2025-09-17T02:25:22.821483] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-17T02:25:23.095305] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-17T02:25:23.209800] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-17T02:25:23.209904] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-17T02:25:23.210515] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-17T02:25:23.210571] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-17T02:25:23.213098] [DEBUG] [LOCAL ] BKE: Trimmed 50292 records to 35017 (keeping 200 days of data) [2025-09-17T02:25:23.423835] [DEBUG] [LOCAL ] BKE: Primary data saved (35017 records). [2025-09-17T02:25:23.424029] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-17T02:25:23.424128] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BKE took 23.7s. Estimated remaining: 4h 59m 26s. Rate: 7.0 symbols/min [2025-09-17T02:25:23.595469] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:23.595697] [DEBUG] [LOCAL ] BKN: No existing data file found in primary storage. [2025-09-17T02:25:23.595928] [WARN ] [MAIN ] BKN: No existing data found, performing full refresh instead. [2025-09-17T02:25:23.596121] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-17T02:25:23.596266] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-17T02:25:23.596472] [DEBUG] [LOCAL ] BKN: No primary data file found to delete. [2025-09-17T02:25:23.596535] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-17T02:25:23.785388] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T02:25:23.899460] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-17T02:25:23.991833] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:24.690113] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-11. [2025-09-17T02:25:25.101190] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T02:25:25.376714] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:25:25.441167] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T02:25:25.490120] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-17T02:25:26.290220] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-17T02:25:27.090100] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-17T02:25:27.157845] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T02:25:27.599982] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T02:25:27.857156] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:25:27.890175] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-17T02:25:28.690143] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-17T02:25:28.818760] [DEBUG] [REMOTE ] BKN: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T02:25:28.819183] [WARN ] [REMOTE ] BKN: No data returned for month 2025-01 [2025-09-17T02:25:28.928895] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T02:25:29.490333] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-17T02:25:30.283999] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:25:30.290094] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-17T02:25:31.090179] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-17T02:25:31.890111] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-17T02:25:31.949307] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:25:32.471528] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T02:25:32.496098] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:25:32.690130] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-17T02:25:33.490145] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-17T02:25:33.870121] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T02:25:34.290139] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-17T02:25:35.090140] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-17T02:25:35.141725] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T02:25:35.217976] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:25:35.890116] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-17T02:25:36.137181] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T02:25:36.648120] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T02:25:36.690100] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-17T02:25:37.490129] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-17T02:25:38.129842] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:25:38.240166] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T02:25:38.290144] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-17T02:25:39.017516] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T02:25:39.090097] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-17T02:25:39.890120] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-17T02:25:40.515585] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:25:40.690110] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-17T02:25:41.302273] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:25:41.490156] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-17T02:25:42.242399] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T02:25:42.290103] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-17T02:25:42.505881] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T02:25:43.090153] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-17T02:25:43.785380] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:25:43.890117] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-17T02:25:44.658631] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:25:44.665033] [INFO ] [REMOTE ] BKD: Full fetch complete (71093 records). [2025-09-17T02:25:44.665213] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-17T02:25:44.698576] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-17T02:25:45.070191] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-17T02:25:45.070309] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-17T02:25:45.071056] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-17T02:25:45.071141] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-17T02:25:45.072601] [DEBUG] [LOCAL ] BKD: Trimmed 71093 records to 50081 (keeping 200 days of data) [2025-09-17T02:25:45.375550] [DEBUG] [LOCAL ] BKD: Primary data saved (50081 records). [2025-09-17T02:25:45.375764] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-17T02:25:45.375881] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKD took 51.9s. Estimated remaining: 5h 0m 54s. Rate: 6.9 symbols/min [2025-09-17T02:25:45.495205] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-17T02:25:45.549006] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:45.592916] [DEBUG] [LOCAL ] BKSY: Loaded 36256 existing records from primary storage. [2025-09-17T02:25:45.593080] [INFO ] [MAIN ] BKSY: Loaded 36256 existing records. [2025-09-17T02:25:45.771856] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:45.772104] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-17T02:25:45.772181] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-17T02:25:45.773126] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-17T02:25:45.773198] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-17T02:25:46.065078] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T02:25:46.092699] [INFO ] [REMOTE ] BKN: Full fetch complete (10385 records). [2025-09-17T02:25:46.114526] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-17T02:25:46.150432] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:46.297982] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-11. [2025-09-17T02:25:46.335099] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-17T02:25:46.369238] [WARN ] [VALIDATOR ] BKN: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T02:25:46.378275] [FATAL] [MAIN ] BKN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:25:46.378795] [WARN ] [MAIN ] BKN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:25:46.378966] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-17T02:25:46.379241] [DEBUG] [LOCAL ] BKN: No primary data file found to delete. [2025-09-17T02:25:46.379328] [INFO ] [LOCAL ] BKN: Starting deletion of derivative data. [2025-09-17T02:25:46.379433] [DEBUG] [LOCAL ] BKN: No derivative data file found to delete. [2025-09-17T02:25:46.379549] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKN took 23.0s. Estimated remaining: 4h 59m 50s. Rate: 6.9 symbols/min [2025-09-17T02:25:46.474414] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:25:46.598115] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:46.609445] [DEBUG] [LOCAL ] BKT: Loaded 8064 existing records from primary storage. [2025-09-17T02:25:46.609613] [INFO ] [MAIN ] BKT: Loaded 8064 existing records. [2025-09-17T02:25:46.796249] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:46.796506] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-17T02:25:46.796567] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-17T02:25:46.797021] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-17T02:25:46.797105] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-17T02:25:47.095280] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-17T02:25:47.168482] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:47.890138] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-17T02:25:48.114950] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T02:25:48.690133] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-11. [2025-09-17T02:25:48.754670] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T02:25:49.430064] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T02:25:49.490086] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-17T02:25:49.736521] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T02:25:50.168447] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T02:25:50.290116] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-17T02:25:51.033973] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T02:25:51.090101] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-17T02:25:51.885851] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:25:51.890396] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-17T02:25:52.649938] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T02:25:52.690195] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-17T02:25:53.490234] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-17T02:25:54.259605] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:25:54.266163] [INFO ] [REMOTE ] BKKT: Full fetch complete (49363 records). [2025-09-17T02:25:54.266341] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-17T02:25:54.299338] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-17T02:25:54.428294] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T02:25:54.688332] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-17T02:25:54.688439] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-17T02:25:54.689018] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-17T02:25:54.689077] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-17T02:25:54.690153] [DEBUG] [LOCAL ] BKKT: Trimmed 49363 records to 33804 (keeping 200 days of data) [2025-09-17T02:25:54.899977] [DEBUG] [LOCAL ] BKKT: Primary data saved (33804 records). [2025-09-17T02:25:54.900165] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-17T02:25:54.900313] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKKT took 36.2s. Estimated remaining: 4h 59m 40s. Rate: 6.9 symbols/min [2025-09-17T02:25:55.078600] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:55.090124] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-17T02:25:55.116166] [DEBUG] [LOCAL ] BKU: Loaded 30997 existing records from primary storage. [2025-09-17T02:25:55.116353] [INFO ] [MAIN ] BKU: Loaded 30997 existing records. [2025-09-17T02:25:55.303224] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:55.303509] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-17T02:25:55.303577] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-17T02:25:55.304423] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-17T02:25:55.304519] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-17T02:25:55.724193] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:55.890141] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-11. [2025-09-17T02:25:55.964064] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:25:56.690120] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-17T02:25:56.802975] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T02:25:57.017546] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T02:25:57.490139] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-17T02:25:58.041828] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:25:58.046505] [INFO ] [REMOTE ] BKH: Full fetch complete (51764 records). [2025-09-17T02:25:58.046620] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-17T02:25:58.300083] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-17T02:25:58.442311] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T02:25:58.442588] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-17T02:25:58.442864] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-17T02:25:58.447278] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-17T02:25:58.447546] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-17T02:25:58.449551] [DEBUG] [LOCAL ] BKH: Trimmed 51764 records to 36686 (keeping 200 days of data) [2025-09-17T02:25:58.676147] [DEBUG] [LOCAL ] BKH: Primary data saved (36686 records). [2025-09-17T02:25:58.676328] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-17T02:25:58.676456] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKH took 40.4s. Estimated remaining: 4h 58m 57s. Rate: 7.0 symbols/min [2025-09-17T02:25:58.865352] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:58.889382] [DEBUG] [LOCAL ] BKV: Loaded 21066 existing records from primary storage. [2025-09-17T02:25:58.889567] [INFO ] [MAIN ] BKV: Loaded 21066 existing records. [2025-09-17T02:25:59.086066] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:59.086371] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-17T02:25:59.086430] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-17T02:25:59.087087] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-17T02:25:59.087169] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-17T02:25:59.099040] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-17T02:25:59.472798] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:59.826733] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T02:25:59.890107] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-11. [2025-09-17T02:26:00.079039] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T02:26:00.690094] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-17T02:26:00.768890] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T02:26:01.490153] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-17T02:26:01.792429] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T02:26:02.290128] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-17T02:26:03.090140] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-17T02:26:03.503328] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T02:26:03.610611] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:26:03.893379] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-17T02:26:03.897190] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:26:04.690130] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-17T02:26:05.490134] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-17T02:26:05.884672] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T02:26:05.919014] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T02:26:06.290132] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-17T02:26:06.390325] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T02:26:07.090135] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-17T02:26:07.698194] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:26:07.890119] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-17T02:26:08.416795] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:26:08.690111] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-17T02:26:09.490158] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-17T02:26:09.608160] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T02:26:10.028020] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T02:26:10.290153] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-17T02:26:10.886558] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:26:11.090154] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-17T02:26:11.890180] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-17T02:26:11.982712] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T02:26:11.985659] [INFO ] [REMOTE ] BKT: Full fetch complete (14533 records). [2025-09-17T02:26:11.985749] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-17T02:26:12.357796] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-17T02:26:12.358044] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-17T02:26:12.358408] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-17T02:26:12.372422] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-17T02:26:12.382724] [DEBUG] [LOCAL ] BKT: Trimmed 14533 records to 10412 (keeping 200 days of data) [2025-09-17T02:26:12.383999] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T02:26:12.460316] [DEBUG] [LOCAL ] BKT: Primary data saved (10412 records). [2025-09-17T02:26:12.460484] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-17T02:26:12.460576] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKT took 26.1s. Estimated remaining: 4h 59m 25s. Rate: 6.9 symbols/min [2025-09-17T02:26:12.631751] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:12.658101] [DEBUG] [LOCAL ] BLCO: Loaded 26549 existing records from primary storage. [2025-09-17T02:26:12.658276] [INFO ] [MAIN ] BLCO: Loaded 26549 existing records. [2025-09-17T02:26:12.700081] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-17T02:26:12.837538] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:12.837802] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-17T02:26:12.837854] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-17T02:26:12.838627] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-17T02:26:12.838719] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-17T02:26:13.194543] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:13.213585] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:26:13.490186] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-17T02:26:14.105547] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T02:26:14.290196] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-17T02:26:14.817509] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T02:26:15.090154] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-11. [2025-09-17T02:26:15.818462] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:26:15.890133] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-17T02:26:16.351273] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:26:16.690111] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-17T02:26:17.439615] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T02:26:17.490077] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-17T02:26:17.846164] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T02:26:18.290217] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-17T02:26:18.679262] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:26:19.090143] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-17T02:26:19.614920] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T02:26:19.890159] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-17T02:26:20.484127] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:26:20.491073] [INFO ] [REMOTE ] BKU: Full fetch complete (59413 records). [2025-09-17T02:26:20.491267] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-17T02:26:20.700426] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-17T02:26:20.885909] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-17T02:26:20.886035] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-17T02:26:20.886752] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-17T02:26:20.886828] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-17T02:26:20.888275] [DEBUG] [LOCAL ] BKU: Trimmed 59413 records to 42061 (keeping 200 days of data) [2025-09-17T02:26:21.143482] [DEBUG] [LOCAL ] BKU: Primary data saved (42061 records). [2025-09-17T02:26:21.143653] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-17T02:26:21.143752] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKU took 26.2s. Estimated remaining: 4h 59m 17s. Rate: 6.9 symbols/min [2025-09-17T02:26:21.318594] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:21.338951] [DEBUG] [LOCAL ] BLD: Loaded 20558 existing records from primary storage. [2025-09-17T02:26:21.339115] [INFO ] [MAIN ] BLD: Loaded 20558 existing records. [2025-09-17T02:26:21.495242] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-17T02:26:21.525298] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:21.526432] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-17T02:26:21.526529] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-17T02:26:21.527284] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-17T02:26:21.527366] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-17T02:26:21.892107] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:21.922627] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T02:26:22.100431] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T02:26:22.290171] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-11. [2025-09-17T02:26:22.988522] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T02:26:23.090183] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-17T02:26:23.698922] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T02:26:23.890165] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-17T02:26:24.133506] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:26:24.690176] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-17T02:26:25.180725] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:26:25.490171] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-17T02:26:26.200602] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T02:26:26.290143] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-17T02:26:26.365710] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T02:26:27.090175] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-17T02:26:27.766503] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:26:27.890093] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-17T02:26:28.690162] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-17T02:26:29.119169] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T02:26:29.421247] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:26:29.483143] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:26:29.490082] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-17T02:26:30.290190] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-17T02:26:31.017388] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:26:31.033385] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:26:31.037559] [INFO ] [REMOTE ] BKV: Full fetch complete (45006 records). [2025-09-17T02:26:31.037688] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-17T02:26:31.095212] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-17T02:26:31.443618] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-17T02:26:31.443781] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-17T02:26:31.444355] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-17T02:26:31.444425] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-17T02:26:31.445433] [DEBUG] [LOCAL ] BKV: Trimmed 45006 records to 30298 (keeping 200 days of data) [2025-09-17T02:26:31.617359] [DEBUG] [LOCAL ] BKV: Primary data saved (30298 records). [2025-09-17T02:26:31.617517] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-17T02:26:31.617608] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKV took 32.9s. Estimated remaining: 4h 59m 21s. Rate: 6.9 symbols/min [2025-09-17T02:26:31.790176] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:31.833139] [DEBUG] [LOCAL ] BLDR: Loaded 38691 existing records from primary storage. [2025-09-17T02:26:31.833337] [INFO ] [MAIN ] BLDR: Loaded 38691 existing records. [2025-09-17T02:26:31.899490] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-17T02:26:32.028486] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:32.028753] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-17T02:26:32.028837] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-17T02:26:32.029959] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-17T02:26:32.030030] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-17T02:26:32.397256] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:32.690102] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-17T02:26:33.194752] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T02:26:33.310812] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:26:33.490174] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-17T02:26:33.733107] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:26:34.290134] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-17T02:26:35.090108] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-17T02:26:35.150009] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T02:26:35.156072] [INFO ] [REMOTE ] BKSY: Full fetch complete (69039 records). [2025-09-17T02:26:35.156223] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-17T02:26:35.540552] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-17T02:26:35.540681] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-17T02:26:35.541406] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-17T02:26:35.541473] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-17T02:26:35.542937] [DEBUG] [LOCAL ] BKSY: Trimmed 69039 records to 48305 (keeping 200 days of data) [2025-09-17T02:26:35.680871] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T02:26:35.851617] [DEBUG] [LOCAL ] BKSY: Primary data saved (48305 records). [2025-09-17T02:26:35.851789] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-17T02:26:35.851912] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKSY took 50.5s. Estimated remaining: 4h 58m 41s. Rate: 6.9 symbols/min [2025-09-17T02:26:35.895279] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-17T02:26:36.022639] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:36.033223] [DEBUG] [LOCAL ] BLE: Loaded 10217 existing records from primary storage. [2025-09-17T02:26:36.033360] [INFO ] [MAIN ] BLE: Loaded 10217 existing records. [2025-09-17T02:26:36.210232] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:36.210707] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-17T02:26:36.210817] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-17T02:26:36.211274] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-17T02:26:36.211416] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-17T02:26:36.518305] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:26:36.607114] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:36.690093] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-11. [2025-09-17T02:26:36.944370] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T02:26:37.490174] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-17T02:26:38.290109] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-11. [2025-09-17T02:26:38.382919] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T02:26:38.865017] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:26:38.907835] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T02:26:39.090114] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-17T02:26:39.890115] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-17T02:26:40.690145] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-17T02:26:40.896454] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T02:26:41.217139] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T02:26:41.490168] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-17T02:26:41.738512] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:26:42.290226] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-17T02:26:43.090162] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-17T02:26:43.126410] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:26:43.191211] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:26:43.195391] [INFO ] [REMOTE ] BLCO: Full fetch complete (52540 records). [2025-09-17T02:26:43.195502] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-17T02:26:43.570284] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-17T02:26:43.570391] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-17T02:26:43.571007] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-17T02:26:43.571065] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-17T02:26:43.572166] [DEBUG] [LOCAL ] BLCO: Trimmed 52540 records to 36497 (keeping 200 days of data) [2025-09-17T02:26:43.793165] [DEBUG] [LOCAL ] BLCO: Primary data saved (36497 records). [2025-09-17T02:26:43.793334] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-17T02:26:43.793429] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BLCO took 31.3s. Estimated remaining: 4h 58m 27s. Rate: 6.9 symbols/min [2025-09-17T02:26:43.892758] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-17T02:26:43.965305] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:43.973304] [DEBUG] [LOCAL ] BLK: No existing data file found in primary storage. [2025-09-17T02:26:43.973898] [WARN ] [MAIN ] BLK: No existing data found, performing full refresh instead. [2025-09-17T02:26:43.974198] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T02:26:43.977536] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-17T02:26:43.977949] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-17T02:26:43.978013] [DEBUG] [LOCAL ] BLK: No primary data file found to delete. [2025-09-17T02:26:43.978063] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-17T02:26:44.361850] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:44.690791] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-17T02:26:45.174927] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T02:26:45.466907] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T02:26:45.490109] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-17T02:26:46.290206] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-17T02:26:46.522016] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T02:26:47.090165] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-11. [2025-09-17T02:26:47.636062] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:26:47.890217] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-17T02:26:48.690213] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-17T02:26:48.874568] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T02:26:49.490230] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-17T02:26:49.646406] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T02:26:50.090045] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T02:26:50.290132] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-17T02:26:50.410356] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T02:26:51.090198] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-17T02:26:51.471580] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:26:51.890209] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-17T02:26:52.690201] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-17T02:26:52.738453] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T02:26:52.931719] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T02:26:53.490164] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-17T02:26:53.563824] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T02:26:53.568556] [INFO ] [REMOTE ] BLD: Full fetch complete (40268 records). [2025-09-17T02:26:53.569008] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-17T02:26:53.978270] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-17T02:26:53.978437] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-17T02:26:53.979029] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-17T02:26:53.979093] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-17T02:26:53.980135] [DEBUG] [LOCAL ] BLD: Trimmed 40268 records to 28206 (keeping 200 days of data) [2025-09-17T02:26:54.156356] [DEBUG] [LOCAL ] BLD: Primary data saved (28206 records). [2025-09-17T02:26:54.156532] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-17T02:26:54.156672] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 33.0s. Estimated remaining: 4h 58m 31s. Rate: 6.9 symbols/min [2025-09-17T02:26:54.298571] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-17T02:26:54.330366] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:54.377359] [DEBUG] [LOCAL ] BLND: Loaded 36409 existing records from primary storage. [2025-09-17T02:26:54.377552] [INFO ] [MAIN ] BLND: Loaded 36409 existing records. [2025-09-17T02:26:54.567254] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:54.567760] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-17T02:26:54.567853] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-17T02:26:54.573870] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-17T02:26:54.579357] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-17T02:26:54.644029] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:26:54.941557] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:55.090097] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-11. [2025-09-17T02:26:55.890152] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-17T02:26:56.122288] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:26:56.690148] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-17T02:26:56.785753] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:26:56.863287] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T02:26:57.490136] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-17T02:26:58.293738] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-17T02:26:58.294787] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T02:26:58.502025] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T02:26:59.090149] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-17T02:26:59.890177] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-17T02:26:59.920525] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T02:26:59.930257] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:26:59.932737] [INFO ] [REMOTE ] BLE: Full fetch complete (20440 records). [2025-09-17T02:26:59.932829] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-17T02:27:00.296706] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-17T02:27:00.296993] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-17T02:27:00.297343] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-17T02:27:00.297393] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-17T02:27:00.298065] [DEBUG] [LOCAL ] BLE: Trimmed 20440 records to 14696 (keeping 200 days of data) [2025-09-17T02:27:00.387069] [DEBUG] [LOCAL ] BLE: Primary data saved (14696 records). [2025-09-17T02:27:00.387226] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-17T02:27:00.387324] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLE took 24.5s. Estimated remaining: 4h 58m 5s. Rate: 6.9 symbols/min [2025-09-17T02:27:00.556943] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:00.557149] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-17T02:27:00.557199] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-17T02:27:00.557308] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-17T02:27:00.557358] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-17T02:27:00.557408] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-17T02:27:00.557542] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-17T02:27:00.700181] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-17T02:27:00.915875] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:01.490190] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-11. [2025-09-17T02:27:01.851624] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T02:27:02.290195] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-17T02:27:02.631157] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:02.631498] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-11 [2025-09-17T02:27:03.090146] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-17T02:27:03.456936] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-17T02:27:03.595956] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:03.596311] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-17T02:27:03.890133] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-17T02:27:04.351505] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:04.351927] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-17T02:27:04.690099] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-17T02:27:05.105749] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-17T02:27:05.490151] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-17T02:27:05.710211] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:05.710538] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-17T02:27:05.983090] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:27:06.290139] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-17T02:27:06.510940] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:06.511254] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-17T02:27:07.090142] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-17T02:27:07.890113] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-17T02:27:08.089254] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:08.089499] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-17T02:27:08.690112] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-17T02:27:08.994381] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T02:27:09.490142] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-17T02:27:10.290170] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-17T02:27:10.516391] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:10.516770] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-17T02:27:10.614364] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T02:27:11.090161] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-17T02:27:11.174454] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T02:27:11.302291] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:11.302658] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-17T02:27:11.890131] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-17T02:27:12.100788] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:12.101158] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-17T02:27:12.690193] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-17T02:27:13.490154] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-17T02:27:14.290216] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-17T02:27:14.496971] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T02:27:15.090227] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-17T02:27:15.890223] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-17T02:27:15.993529] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T02:27:16.680329] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-17T02:27:16.690070] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-17T02:27:17.394270] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:27:17.401015] [INFO ] [REMOTE ] BLDR: Full fetch complete (73824 records). [2025-09-17T02:27:17.401210] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-17T02:27:17.499528] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-17T02:27:17.815962] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-17T02:27:17.816151] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-17T02:27:17.817015] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-17T02:27:17.817090] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-17T02:27:17.840978] [DEBUG] [LOCAL ] BLDR: Trimmed 73824 records to 51613 (keeping 200 days of data) [2025-09-17T02:27:17.842168] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-17T02:27:18.168819] [DEBUG] [LOCAL ] BLDR: Primary data saved (51613 records). [2025-09-17T02:27:18.169008] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-17T02:27:18.169122] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLDR took 46.6s. Estimated remaining: 4h 59m 0s. Rate: 6.9 symbols/min [2025-09-17T02:27:18.295340] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-17T02:27:18.344513] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:18.382165] [DEBUG] [LOCAL ] BLW: Loaded 9090 existing records from primary storage. [2025-09-17T02:27:18.382564] [INFO ] [MAIN ] BLW: Loaded 9090 existing records. [2025-09-17T02:27:18.415664] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T02:27:18.572175] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:18.572440] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-17T02:27:18.572529] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-17T02:27:18.572973] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-17T02:27:18.573035] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-17T02:27:18.932673] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:19.090181] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-17T02:27:19.890172] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-11. [2025-09-17T02:27:19.928437] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-17T02:27:19.937791] [INFO ] [REMOTE ] BLSH: Full fetch complete (9102 records). [2025-09-17T02:27:19.938020] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-17T02:27:20.146773] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 24 unique days, need 200 days [2025-09-17T02:27:20.147159] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:27:20.147593] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:27:20.148542] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:27:20.148681] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-17T02:27:20.155742] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-17T02:27:20.156028] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-17T02:27:20.156100] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-17T02:27:20.156174] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLSH took 19.8s. Estimated remaining: 4h 58m 5s. Rate: 6.9 symbols/min [2025-09-17T02:27:20.327095] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:20.327275] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-09-17T02:27:20.327337] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-09-17T02:27:20.327463] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-17T02:27:20.327529] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-17T02:27:20.327583] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-17T02:27:20.327620] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-17T02:27:20.657956] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T02:27:20.696853] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-17T02:27:20.716195] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:20.746132] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:27:21.490136] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-11. [2025-09-17T02:27:22.290108] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-17T02:27:22.372156] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:27:22.451775] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:27:23.090198] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-17T02:27:23.890140] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-17T02:27:24.050629] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T02:27:24.690165] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-17T02:27:24.748354] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T02:27:24.930537] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:27:25.474755] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:27:25.490111] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-17T02:27:26.290142] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-17T02:27:26.498378] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:27:27.090132] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-17T02:27:27.218728] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:27:27.890185] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-17T02:27:28.443958] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T02:27:28.690218] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-17T02:27:28.723371] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T02:27:29.490134] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-17T02:27:30.263193] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:27:30.290083] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-17T02:27:30.956392] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T02:27:30.960511] [INFO ] [REMOTE ] BLK: Full fetch complete (53279 records). [2025-09-17T02:27:30.960662] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-17T02:27:31.101950] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-17T02:27:31.349186] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-17T02:27:31.349312] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-17T02:27:31.349984] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-17T02:27:31.350045] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-17T02:27:31.351219] [DEBUG] [LOCAL ] BLK: Trimmed 53279 records to 35450 (keeping 200 days of data) [2025-09-17T02:27:31.596465] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T02:27:31.618690] [DEBUG] [LOCAL ] BLK: Primary data saved (35450 records). [2025-09-17T02:27:31.618841] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-17T02:27:31.618924] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLK took 47.8s. Estimated remaining: 4h 58m 16s. Rate: 6.9 symbols/min [2025-09-17T02:27:31.790171] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:31.815453] [DEBUG] [LOCAL ] BMA: Loaded 25533 existing records from primary storage. [2025-09-17T02:27:31.815610] [INFO ] [MAIN ] BMA: Loaded 25533 existing records. [2025-09-17T02:27:31.895250] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-17T02:27:32.031003] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:32.031421] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-17T02:27:32.031498] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-17T02:27:32.038563] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-17T02:27:32.040251] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-17T02:27:32.047101] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T02:27:32.406682] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:32.690168] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-17T02:27:32.817605] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T02:27:33.490150] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-17T02:27:33.811945] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:27:34.290153] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-17T02:27:34.313891] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:27:35.090210] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-11. [2025-09-17T02:27:35.127439] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T02:27:35.890166] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-17T02:27:36.105260] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T02:27:36.690151] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-17T02:27:37.490219] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-17T02:27:37.625956] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T02:27:37.891281] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T02:27:38.085825] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:27:38.290177] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-17T02:27:39.090135] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-17T02:27:39.706977] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T02:27:39.721266] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T02:27:39.890146] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-17T02:27:40.690130] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-17T02:27:41.384015] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T02:27:41.390197] [INFO ] [REMOTE ] BLND: Full fetch complete (72167 records). [2025-09-17T02:27:41.390335] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-17T02:27:41.495963] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-17T02:27:41.787296] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-17T02:27:41.787399] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-17T02:27:41.788146] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-17T02:27:41.788203] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-17T02:27:41.789688] [DEBUG] [LOCAL ] BLND: Trimmed 72167 records to 49537 (keeping 200 days of data) [2025-09-17T02:27:42.100095] [DEBUG] [LOCAL ] BLND: Primary data saved (49537 records). [2025-09-17T02:27:42.100253] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-17T02:27:42.100346] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLND took 47.9s. Estimated remaining: 4h 58m 20s. Rate: 6.9 symbols/min [2025-09-17T02:27:42.273616] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:42.296570] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:27:42.295153] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-17T02:27:42.310732] [DEBUG] [LOCAL ] BME: Loaded 8162 existing records from primary storage. [2025-09-17T02:27:42.310826] [INFO ] [MAIN ] BME: Loaded 8162 existing records. [2025-09-17T02:27:42.488116] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:42.488365] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-17T02:27:42.488416] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-17T02:27:42.488862] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-17T02:27:42.488927] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-17T02:27:42.822157] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T02:27:42.863408] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:43.090103] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-11. [2025-09-17T02:27:43.232396] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T02:27:43.667457] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:27:43.890175] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-17T02:27:44.690140] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-17T02:27:44.896261] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T02:27:45.490140] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-17T02:27:46.123359] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:27:46.290143] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-17T02:27:46.386023] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:27:47.090139] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-17T02:27:47.348374] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T02:27:47.890163] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-17T02:27:48.031090] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T02:27:48.033795] [INFO ] [REMOTE ] BLW: Full fetch complete (18914 records). [2025-09-17T02:27:48.033918] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-17T02:27:48.409963] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-17T02:27:48.410126] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-17T02:27:48.410536] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-17T02:27:48.410594] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-17T02:27:48.411454] [DEBUG] [LOCAL ] BLW: Trimmed 18914 records to 12961 (keeping 200 days of data) [2025-09-17T02:27:48.492387] [DEBUG] [LOCAL ] BLW: Primary data saved (12961 records). [2025-09-17T02:27:48.492568] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-17T02:27:48.492699] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLW took 30.3s. Estimated remaining: 4h 57m 56s. Rate: 6.9 symbols/min [2025-09-17T02:27:48.663740] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:48.682561] [DEBUG] [LOCAL ] BMEZ: Loaded 17832 existing records from primary storage. [2025-09-17T02:27:48.682753] [INFO ] [MAIN ] BMEZ: Loaded 17832 existing records. [2025-09-17T02:27:48.695516] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-17T02:27:48.865714] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:48.866009] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-17T02:27:48.866079] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-17T02:27:48.866719] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-17T02:27:48.866788] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-17T02:27:49.236937] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:49.390054] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T02:27:49.466597] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T02:27:49.490152] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-11. [2025-09-17T02:27:50.290148] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-17T02:27:50.634558] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:27:51.090140] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-17T02:27:51.637366] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T02:27:51.890187] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-17T02:27:52.322595] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T02:27:52.520580] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T02:27:52.690116] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-17T02:27:53.490204] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-17T02:27:53.514151] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T02:27:54.290184] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-17T02:27:54.953721] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:27:55.090129] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-17T02:27:55.219171] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:27:55.890183] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-17T02:27:56.463979] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:27:56.479713] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T02:27:56.690203] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-17T02:27:57.490137] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-17T02:27:57.551961] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T02:27:58.290136] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-17T02:27:58.531893] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T02:27:59.090153] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-17T02:27:59.474619] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:27:59.662316] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T02:27:59.890134] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-17T02:28:00.690185] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-17T02:28:00.834120] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T02:28:01.490171] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-17T02:28:02.059977] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T02:28:02.290209] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-17T02:28:02.463377] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T02:28:03.049692] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T02:28:03.051760] [INFO ] [REMOTE ] BME: Full fetch complete (16176 records). [2025-09-17T02:28:03.051847] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-17T02:28:03.095230] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-17T02:28:03.431310] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-17T02:28:03.431415] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-17T02:28:03.431734] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-17T02:28:03.431789] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-17T02:28:03.432520] [DEBUG] [LOCAL ] BME: Trimmed 16176 records to 10803 (keeping 200 days of data) [2025-09-17T02:28:03.508523] [DEBUG] [LOCAL ] BME: Primary data saved (10803 records). [2025-09-17T02:28:03.508781] [INFO ] [MAIN ] BME: Full history saved. [2025-09-17T02:28:03.508933] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BME took 21.4s. Estimated remaining: 4h 58m 30s. Rate: 6.9 symbols/min [2025-09-17T02:28:03.679112] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:03.679331] [DEBUG] [LOCAL ] BMI: No existing data file found in primary storage. [2025-09-17T02:28:03.679382] [WARN ] [MAIN ] BMI: No existing data found, performing full refresh instead. [2025-09-17T02:28:03.679488] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-17T02:28:03.679538] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-17T02:28:03.679586] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-17T02:28:03.679632] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-17T02:28:03.897593] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-17T02:28:04.036027] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:04.048088] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T02:28:04.690149] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-11. [2025-09-17T02:28:05.338330] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:28:05.490133] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-17T02:28:05.854339] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:28:06.290108] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-17T02:28:06.597453] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T02:28:07.090129] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-17T02:28:07.357827] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T02:28:07.890115] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-17T02:28:07.920598] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:28:08.690145] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-17T02:28:08.991459] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T02:28:09.490166] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-17T02:28:09.599603] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:28:10.279393] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:28:10.290088] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-17T02:28:11.090082] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-17T02:28:11.524813] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T02:28:11.707814] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T02:28:11.890155] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-17T02:28:12.690197] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-17T02:28:13.058163] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:28:13.490150] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-17T02:28:14.036566] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:28:14.290157] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-17T02:28:14.557866] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T02:28:14.561245] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40917 records). [2025-09-17T02:28:14.561417] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-17T02:28:14.939768] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-17T02:28:14.939893] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-17T02:28:14.940480] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-17T02:28:14.940563] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-17T02:28:14.941705] [DEBUG] [LOCAL ] BMEZ: Trimmed 40917 records to 26034 (keeping 200 days of data) [2025-09-17T02:28:15.091062] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-17T02:28:15.115798] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26034 records). [2025-09-17T02:28:15.115962] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-17T02:28:15.116104] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BMEZ took 26.6s. Estimated remaining: 4h 58m 42s. Rate: 6.9 symbols/min [2025-09-17T02:28:15.293256] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:15.293494] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-09-17T02:28:15.293544] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-09-17T02:28:15.293674] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-17T02:28:15.293727] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-17T02:28:15.293773] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-17T02:28:15.293816] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-17T02:28:15.646440] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:15.734106] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T02:28:15.744771] [INFO ] [REMOTE ] BMA: Full fetch complete (50596 records). [2025-09-17T02:28:15.744937] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-17T02:28:15.898331] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-11. [2025-09-17T02:28:16.137209] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T02:28:16.155211] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-17T02:28:16.155438] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-17T02:28:16.156129] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-17T02:28:16.156204] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-17T02:28:16.156297] [INFO ] [REMOTE ] BLX: Full fetch complete (22634 records). [2025-09-17T02:28:16.156598] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-17T02:28:16.232763] [DEBUG] [LOCAL ] BMA: Trimmed 50596 records to 34448 (keeping 200 days of data) [2025-09-17T02:28:16.461485] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T02:28:16.663250] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-17T02:28:16.664127] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-17T02:28:16.665120] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-17T02:28:16.666721] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-17T02:28:16.671103] [DEBUG] [LOCAL ] BLX: Trimmed 22634 records to 16056 (keeping 200 days of data) [2025-09-17T02:28:16.721023] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-17T02:28:16.856013] [DEBUG] [LOCAL ] BMA: Primary data saved (34448 records). [2025-09-17T02:28:16.856523] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-17T02:28:16.856694] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BMA took 45.2s. Estimated remaining: 4h 57m 46s. Rate: 6.9 symbols/min [2025-09-17T02:28:17.034913] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:17.036298] [DEBUG] [LOCAL ] BMO: No existing data file found in primary storage. [2025-09-17T02:28:17.037318] [WARN ] [MAIN ] BMO: No existing data found, performing full refresh instead. [2025-09-17T02:28:17.038663] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-17T02:28:17.039433] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-17T02:28:17.039784] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-09-17T02:28:17.040065] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-17T02:28:17.327341] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T02:28:17.376228] [DEBUG] [LOCAL ] BLX: Primary data saved (16056 records). [2025-09-17T02:28:17.411240] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-17T02:28:17.420480] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BLX took 57.3s. Estimated remaining: 4h 56m 43s. Rate: 6.9 symbols/min [2025-09-17T02:28:17.440669] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:17.495478] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-17T02:28:17.615732] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:17.673376] [DEBUG] [LOCAL ] BMY: Loaded 40107 existing records from primary storage. [2025-09-17T02:28:17.673564] [INFO ] [MAIN ] BMY: Loaded 40107 existing records. [2025-09-17T02:28:17.852356] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:28:17.852637] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-17T02:28:17.852712] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-17T02:28:17.853756] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-17T02:28:17.853819] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-17T02:28:18.208795] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:18.290110] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-11. [2025-09-17T02:28:18.714418] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T02:28:19.090186] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-11. [2025-09-17T02:28:19.890149] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-17T02:28:20.220525] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T02:28:20.387068] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T02:28:20.610690] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:28:20.690110] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-17T02:28:21.490206] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-17T02:28:22.290220] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-17T02:28:22.541575] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:28:22.773280] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T02:28:23.090184] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-17T02:28:23.381759] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T02:28:23.890158] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-17T02:28:24.024854] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:28:24.690133] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-17T02:28:24.988752] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-17T02:28:25.253939] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:28:25.490126] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-17T02:28:26.290107] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-17T02:28:26.655245] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:28:26.701194] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T02:28:27.090135] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-17T02:28:27.489350] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T02:28:27.890150] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-17T02:28:28.690141] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-17T02:28:29.194277] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T02:28:29.490183] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-17T02:28:29.866110] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T02:28:30.290163] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-17T02:28:30.622800] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:28:30.626686] [INFO ] [REMOTE ] BMI: Full fetch complete (32053 records). [2025-09-17T02:28:30.626816] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-17T02:28:30.997606] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-17T02:28:30.997738] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-17T02:28:30.998203] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-17T02:28:30.998259] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-17T02:28:30.999324] [DEBUG] [LOCAL ] BMI: Trimmed 32053 records to 23761 (keeping 200 days of data) [2025-09-17T02:28:31.096715] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-17T02:28:31.157703] [DEBUG] [LOCAL ] BMI: Primary data saved (23761 records). [2025-09-17T02:28:31.157884] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-17T02:28:31.157992] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 27.6s. Estimated remaining: 4h 57m 9s. Rate: 6.9 symbols/min [2025-09-17T02:28:31.337002] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:31.383307] [DEBUG] [LOCAL ] BN: Loaded 39392 existing records from primary storage. [2025-09-17T02:28:31.383505] [INFO ] [MAIN ] BN: Loaded 39392 existing records. [2025-09-17T02:28:31.561940] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:28:31.562213] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-17T02:28:31.562283] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-17T02:28:31.563266] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-17T02:28:31.563336] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-17T02:28:31.898745] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-17T02:28:31.928996] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:32.162187] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T02:28:32.417343] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:28:32.640592] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T02:28:32.690076] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-17T02:28:33.490143] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-11. [2025-09-17T02:28:33.940217] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:28:34.290144] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-17T02:28:35.090188] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-17T02:28:35.382330] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T02:28:35.661210] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T02:28:35.890103] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-17T02:28:36.000357] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:28:36.690156] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-17T02:28:37.495792] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-17T02:28:37.500940] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T02:28:37.991864] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:28:37.992930] [INFO ] [REMOTE ] BMN: Full fetch complete (3751 records). [2025-09-17T02:28:37.993018] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-17T02:28:38.295269] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-17T02:28:38.355558] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-17T02:28:38.355695] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-17T02:28:38.355884] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-17T02:28:38.355934] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-17T02:28:38.356386] [DEBUG] [LOCAL ] BMN: Trimmed 3751 records to 2573 (keeping 200 days of data) [2025-09-17T02:28:38.375351] [DEBUG] [LOCAL ] BMN: Primary data saved (2573 records). [2025-09-17T02:28:38.375479] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-17T02:28:38.375563] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMN took 23.3s. Estimated remaining: 4h 56m 50s. Rate: 6.9 symbols/min [2025-09-17T02:28:38.557659] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:38.557927] [DEBUG] [LOCAL ] BNED: No existing data file found in primary storage. [2025-09-17T02:28:38.557990] [WARN ] [MAIN ] BNED: No existing data found, performing full refresh instead. [2025-09-17T02:28:38.558162] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-17T02:28:38.558230] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-17T02:28:38.558302] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-09-17T02:28:38.558364] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-17T02:28:38.936844] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:38.972187] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-17T02:28:39.090149] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-17T02:28:39.890166] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-17T02:28:40.264685] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T02:28:40.690188] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-11. [2025-09-17T02:28:40.854677] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T02:28:41.495493] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-17T02:28:41.498076] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:28:41.600975] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T02:28:42.290127] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-17T02:28:42.939688] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T02:28:43.090112] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-17T02:28:43.719932] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T02:28:43.890136] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-17T02:28:44.503587] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:28:44.690132] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-17T02:28:45.284226] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T02:28:45.490142] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-17T02:28:46.290190] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-17T02:28:46.427441] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:28:46.589970] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T02:28:47.090164] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-17T02:28:47.431019] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T02:28:47.890133] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-17T02:28:48.599454] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T02:28:48.690207] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-17T02:28:49.053241] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T02:28:49.490144] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-17T02:28:50.274025] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:28:50.290081] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-17T02:28:51.090117] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-17T02:28:51.145591] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:28:51.841864] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:28:51.890099] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-17T02:28:52.453238] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T02:28:52.690135] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-17T02:28:53.293024] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:28:53.298413] [INFO ] [REMOTE ] BMO: Full fetch complete (59890 records). [2025-09-17T02:28:53.298540] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-17T02:28:53.495210] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-17T02:28:53.725699] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-17T02:28:53.725814] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-17T02:28:53.726468] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-17T02:28:53.726524] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-17T02:28:53.727817] [DEBUG] [LOCAL ] BMO: Trimmed 59890 records to 41443 (keeping 200 days of data) [2025-09-17T02:28:53.988614] [DEBUG] [LOCAL ] BMO: Primary data saved (41443 records). [2025-09-17T02:28:53.988787] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-17T02:28:53.988877] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 37.1s. Estimated remaining: 4h 57m 28s. Rate: 6.9 symbols/min [2025-09-17T02:28:54.158860] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:54.163537] [DEBUG] [LOCAL ] BNH: Loaded 3128 existing records from primary storage. [2025-09-17T02:28:54.163672] [INFO ] [MAIN ] BNH: Loaded 3128 existing records. [2025-09-17T02:28:54.302384] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-17T02:28:54.341458] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:28:54.341878] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-17T02:28:54.341944] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-17T02:28:54.342211] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-17T02:28:54.342267] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-17T02:28:54.700271] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:54.971872] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T02:28:55.090138] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-11. [2025-09-17T02:28:55.520617] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T02:28:55.671947] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:28:55.672849] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:28:55.890167] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-17T02:28:56.690210] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-17T02:28:57.490093] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-17T02:28:57.836769] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T02:28:57.879941] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T02:28:58.290129] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-17T02:28:59.090139] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-17T02:28:59.520355] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T02:28:59.744249] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T02:28:59.765565] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T02:28:59.890092] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-17T02:29:00.690142] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-17T02:29:01.339398] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:29:01.490168] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-17T02:29:02.290131] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-17T02:29:02.546707] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T02:29:02.553204] [INFO ] [REMOTE ] BMY: Full fetch complete (77647 records). [2025-09-17T02:29:02.553373] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-17T02:29:02.927181] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:29:02.960417] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-17T02:29:02.961015] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-17T02:29:02.961933] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-17T02:29:02.961994] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-17T02:29:02.963561] [DEBUG] [LOCAL ] BMY: Trimmed 77647 records to 53757 (keeping 200 days of data) [2025-09-17T02:29:03.090423] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-17T02:29:03.318112] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:29:03.342011] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-17T02:29:03.342179] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-17T02:29:03.343027] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BMY took 45.9s. Estimated remaining: 4h 57m 24s. Rate: 6.9 symbols/min [2025-09-17T02:29:03.511082] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:03.514502] [DEBUG] [LOCAL ] BNJ: Loaded 1747 existing records from primary storage. [2025-09-17T02:29:03.514638] [INFO ] [MAIN ] BNJ: Loaded 1747 existing records. [2025-09-17T02:29:03.695412] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:03.695675] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-17T02:29:03.695734] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-17T02:29:03.695994] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-17T02:29:03.696052] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-17T02:29:03.895284] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-17T02:29:04.056146] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:04.066885] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T02:29:04.071196] [INFO ] [REMOTE ] BNED: Full fetch complete (44345 records). [2025-09-17T02:29:04.071344] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-17T02:29:04.385543] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T02:29:04.478096] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-17T02:29:04.478211] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-17T02:29:04.478787] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-17T02:29:04.478850] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-17T02:29:04.480020] [DEBUG] [LOCAL ] BNED: Trimmed 44345 records to 30086 (keeping 200 days of data) [2025-09-17T02:29:04.665254] [DEBUG] [LOCAL ] BNED: Primary data saved (30086 records). [2025-09-17T02:29:04.665430] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-17T02:29:04.665520] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BNED took 26.3s. Estimated remaining: 4h 56m 27s. Rate: 6.9 symbols/min [2025-09-17T02:29:04.697742] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-17T02:29:04.847895] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:04.886544] [DEBUG] [LOCAL ] BNL: Loaded 34783 existing records from primary storage. [2025-09-17T02:29:04.886769] [INFO ] [MAIN ] BNL: Loaded 34783 existing records. [2025-09-17T02:29:05.073017] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:05.073277] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-17T02:29:05.073336] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-17T02:29:05.074280] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-17T02:29:05.074343] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-17T02:29:05.432869] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:05.437300] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T02:29:05.490111] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-11. [2025-09-17T02:29:06.290134] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-17T02:29:07.091697] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-11. [2025-09-17T02:29:07.097528] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:29:07.676879] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T02:29:07.890115] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-17T02:29:08.233595] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T02:29:08.277791] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-17T02:29:08.690147] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-17T02:29:09.175720] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T02:29:09.490203] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-17T02:29:10.290160] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-17T02:29:11.090175] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-17T02:29:11.432549] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:29:11.605344] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T02:29:11.842437] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T02:29:11.890151] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-17T02:29:12.489043] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T02:29:12.690142] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-17T02:29:13.490156] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-17T02:29:14.050261] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T02:29:14.295246] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-17T02:29:14.312497] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T02:29:14.876992] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T02:29:15.090154] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-17T02:29:15.890138] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-17T02:29:16.508012] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T02:29:16.690102] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-17T02:29:16.771318] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T02:29:16.778345] [INFO ] [REMOTE ] BN: Full fetch complete (76479 records). [2025-09-17T02:29:16.778508] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-17T02:29:17.178967] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-17T02:29:17.179085] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-17T02:29:17.179875] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-17T02:29:17.179933] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-17T02:29:17.181484] [DEBUG] [LOCAL ] BN: Trimmed 76479 records to 53015 (keeping 200 days of data) [2025-09-17T02:29:17.285392] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T02:29:17.503317] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-17T02:29:17.529621] [DEBUG] [LOCAL ] BN: Primary data saved (53015 records). [2025-09-17T02:29:17.529774] [INFO ] [MAIN ] BN: Full history saved. [2025-09-17T02:29:17.529894] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BN took 46.4s. Estimated remaining: 4h 56m 46s. Rate: 6.9 symbols/min [2025-09-17T02:29:17.702550] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:17.739801] [DEBUG] [LOCAL ] BNS: Loaded 38179 existing records from primary storage. [2025-09-17T02:29:17.739962] [INFO ] [MAIN ] BNS: Loaded 38179 existing records. [2025-09-17T02:29:17.916250] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:17.916504] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-17T02:29:17.916563] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-17T02:29:17.917508] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-17T02:29:17.917571] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-17T02:29:18.219628] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T02:29:18.282787] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:18.290089] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-17T02:29:18.801868] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T02:29:19.090142] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-17T02:29:19.416187] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T02:29:19.890151] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-17T02:29:20.411891] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:29:20.690186] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-17T02:29:21.490162] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-17T02:29:21.925481] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T02:29:21.942274] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:29:22.290174] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-17T02:29:22.889225] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T02:29:23.090198] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-17T02:29:23.890135] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-11. [2025-09-17T02:29:24.702008] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-17T02:29:24.708479] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T02:29:25.209398] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T02:29:25.210458] [INFO ] [REMOTE ] BNH: Full fetch complete (6775 records). [2025-09-17T02:29:25.210546] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-17T02:29:25.495281] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-17T02:29:25.582280] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-17T02:29:25.582388] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-17T02:29:25.582912] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-17T02:29:25.582976] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-17T02:29:25.583506] [DEBUG] [LOCAL ] BNH: Trimmed 6775 records to 4836 (keeping 200 days of data) [2025-09-17T02:29:25.614062] [DEBUG] [LOCAL ] BNH: Primary data saved (4836 records). [2025-09-17T02:29:25.614208] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-17T02:29:25.614605] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BNH took 31.6s. Estimated remaining: 4h 56m 33s. Rate: 6.9 symbols/min [2025-09-17T02:29:25.723216] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T02:29:25.824386] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:25.828266] [DEBUG] [LOCAL ] BNT: Loaded 2089 existing records from primary storage. [2025-09-17T02:29:25.828365] [INFO ] [MAIN ] BNT: Loaded 2089 existing records. [2025-09-17T02:29:26.008210] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:26.010733] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T02:29:26.011873] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-17T02:29:26.011947] [INFO ] [REMOTE ] BNJ: Full fetch complete (4445 records). [2025-09-17T02:29:26.012053] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-17T02:29:26.012097] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-17T02:29:26.012590] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-17T02:29:26.056222] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-17T02:29:26.292013] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-17T02:29:26.757866] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-17T02:29:26.761584] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-17T02:29:26.761419] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:26.762113] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-17T02:29:26.762182] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-17T02:29:26.762688] [DEBUG] [LOCAL ] BNJ: Trimmed 4445 records to 2609 (keeping 200 days of data) [2025-09-17T02:29:26.786941] [DEBUG] [LOCAL ] BNJ: Primary data saved (2609 records). [2025-09-17T02:29:26.787035] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-17T02:29:26.787122] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNJ took 23.4s. Estimated remaining: 4h 55m 36s. Rate: 6.9 symbols/min [2025-09-17T02:29:26.962283] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:26.970595] [DEBUG] [LOCAL ] BNY: Loaded 5332 existing records from primary storage. [2025-09-17T02:29:26.970767] [INFO ] [MAIN ] BNY: Loaded 5332 existing records. [2025-09-17T02:29:27.095299] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-17T02:29:27.170698] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:27.171153] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-17T02:29:27.171216] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-17T02:29:27.171503] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-17T02:29:27.171559] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-17T02:29:27.523724] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:27.890162] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-11. [2025-09-17T02:29:28.326096] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T02:29:28.391046] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T02:29:28.690166] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-17T02:29:28.929416] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:29:29.175038] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T02:29:29.490167] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-17T02:29:30.290152] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-17T02:29:30.935983] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T02:29:31.000483] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:29:31.090092] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-17T02:29:31.890152] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-17T02:29:32.629078] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T02:29:32.690141] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-11. [2025-09-17T02:29:33.315894] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T02:29:33.490181] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-17T02:29:33.749290] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T02:29:34.052784] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T02:29:34.290139] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-17T02:29:35.090208] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-17T02:29:35.849421] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T02:29:35.890080] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-17T02:29:36.024067] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:29:36.678853] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T02:29:36.690073] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-17T02:29:37.385070] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T02:29:37.490159] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-17T02:29:38.131066] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T02:29:38.290116] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-17T02:29:39.090180] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-17T02:29:39.126118] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T02:29:39.505048] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T02:29:39.890138] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-17T02:29:40.384934] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T02:29:40.690196] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-17T02:29:41.436035] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T02:29:41.490219] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-17T02:29:42.290139] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-17T02:29:43.061284] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:29:43.090101] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-17T02:29:43.895303] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-17T02:29:43.920353] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T02:29:44.148025] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:29:44.153889] [INFO ] [REMOTE ] BNL: Full fetch complete (66473 records). [2025-09-17T02:29:44.154044] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-17T02:29:44.565278] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-17T02:29:44.565405] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-17T02:29:44.566137] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-17T02:29:44.566216] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-17T02:29:44.567672] [DEBUG] [LOCAL ] BNL: Trimmed 66473 records to 46995 (keeping 200 days of data) [2025-09-17T02:29:44.669294] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T02:29:44.696464] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-17T02:29:44.698954] [INFO ] [REMOTE ] BNY: Full fetch complete (10577 records). [2025-09-17T02:29:44.701447] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-17T02:29:45.205551] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-17T02:29:45.205673] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-17T02:29:45.205963] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-17T02:29:45.206539] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-17T02:29:45.207802] [DEBUG] [LOCAL ] BNY: Trimmed 10577 records to 7359 (keeping 200 days of data) [2025-09-17T02:29:45.310135] [DEBUG] [LOCAL ] BNL: Primary data saved (46995 records). [2025-09-17T02:29:45.311246] [DEBUG] [LOCAL ] BNY: Primary data saved (7359 records). [2025-09-17T02:29:45.311377] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-17T02:29:45.311597] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNL took 40.6s. Estimated remaining: 4h 56m 32s. Rate: 6.9 symbols/min [2025-09-17T02:29:45.311471] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-17T02:29:45.312065] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNY took 18.5s. Estimated remaining: 4h 55m 27s. Rate: 6.9 symbols/min [2025-09-17T02:29:45.484232] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:45.492157] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-17T02:29:45.499928] [DEBUG] [LOCAL ] BOC: Loaded 13393 existing records from primary storage. [2025-09-17T02:29:45.500052] [INFO ] [MAIN ] BOC: Loaded 13393 existing records. [2025-09-17T02:29:45.679801] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:45.680073] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-17T02:29:45.680126] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-17T02:29:45.680588] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-17T02:29:45.680680] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-17T02:29:45.965637] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T02:29:46.049218] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:46.151724] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:29:46.290089] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-17T02:29:47.090165] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-11. [2025-09-17T02:29:47.890186] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-17T02:29:48.083469] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:29:48.146958] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:29:48.511461] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T02:29:48.690177] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-17T02:29:49.490138] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-17T02:29:49.795717] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:29:50.290158] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-17T02:29:51.090185] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-17T02:29:51.109137] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T02:29:51.392451] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T02:29:51.508737] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T02:29:51.890138] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-17T02:29:52.690177] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-17T02:29:53.265283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:29:53.490140] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-17T02:29:53.684449] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T02:29:54.290377] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-17T02:29:54.336419] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:29:55.090139] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-17T02:29:55.890116] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-17T02:29:56.077895] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:29:56.124209] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:29:56.194372] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T02:29:56.690161] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-17T02:29:57.460878] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T02:29:57.490104] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-17T02:29:58.080446] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T02:29:58.290139] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-17T02:29:58.595307] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T02:29:59.090131] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-17T02:29:59.428466] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T02:29:59.429684] [INFO ] [REMOTE ] BNT: Full fetch complete (4495 records). [2025-09-17T02:29:59.429766] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-17T02:29:59.797086] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-17T02:29:59.797212] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-17T02:29:59.797363] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-17T02:29:59.797410] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-17T02:29:59.797821] [DEBUG] [LOCAL ] BNT: Trimmed 4495 records to 3333 (keeping 200 days of data) [2025-09-17T02:29:59.821114] [DEBUG] [LOCAL ] BNT: Primary data saved (3333 records). [2025-09-17T02:29:59.821198] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-17T02:29:59.821276] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNT took 34.2s. Estimated remaining: 4h 55m 56s. Rate: 6.9 symbols/min [2025-09-17T02:29:59.890151] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-17T02:30:00.690174] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-17T02:30:00.859349] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:30:01.490194] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-17T02:30:02.894982] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T02:30:02.907439] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-17T02:30:03.268979] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:30:03.273341] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-17T02:30:05.910848] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-17T02:30:05.915881] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-17T02:30:06.101069] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (3.19 seconds). [2025-09-17T02:30:06.107974] [INFO ] [REMOTE ] BNS: Full fetch complete (74072 records). [2025-09-17T02:30:06.108175] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-17T02:30:06.548155] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-17T02:30:06.548294] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-17T02:30:06.549325] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-17T02:30:06.549403] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-17T02:30:06.551447] [DEBUG] [LOCAL ] BNS: Trimmed 74072 records to 51521 (keeping 200 days of data) [2025-09-17T02:30:06.876252] [DEBUG] [LOCAL ] BNS: Primary data saved (51521 records). [2025-09-17T02:30:06.876587] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-17T02:30:06.876763] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNS took 49.3s. Estimated remaining: 4h 55m 37s. Rate: 6.9 symbols/min [2025-09-17T02:30:06.894830] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:30:06.902108] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-17T02:30:07.885135] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T02:30:07.889572] [INFO ] [REMOTE ] BOC: Full fetch complete (25721 records). [2025-09-17T02:30:07.889922] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-17T02:30:08.267033] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-17T02:30:08.267138] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-17T02:30:08.267555] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-17T02:30:08.267617] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-17T02:30:08.268267] [DEBUG] [LOCAL ] BOC: Trimmed 25721 records to 18393 (keeping 200 days of data) [2025-09-17T02:30:08.375895] [DEBUG] [LOCAL ] BOC: Primary data saved (18393 records). [2025-09-17T02:30:08.376061] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-17T02:30:08.376154] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 23.1s. Estimated remaining: 4h 54m 43s. Rate: 7.0 symbols/min [2025-09-17T02:30:09.096386] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.112780] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.106241] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.171689] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.187610] [DEBUG] [LOCAL ] BOE: Loaded 11979 existing records from primary storage. [2025-09-17T02:30:09.187891] [INFO ] [MAIN ] BOE: Loaded 11979 existing records. [2025-09-17T02:30:09.349077] [DEBUG] [LOCAL ] BOOT: Loaded 29529 existing records from primary storage. [2025-09-17T02:30:09.349437] [DEBUG] [LOCAL ] BOND: Loaded 23774 existing records from primary storage. [2025-09-17T02:30:09.370314] [INFO ] [MAIN ] BOOT: Loaded 29529 existing records. [2025-09-17T02:30:09.370707] [DEBUG] [LOCAL ] BOH: Loaded 22048 existing records from primary storage. [2025-09-17T02:30:09.400240] [INFO ] [MAIN ] BOND: Loaded 23774 existing records. [2025-09-17T02:30:09.414469] [INFO ] [MAIN ] BOH: Loaded 22048 existing records. [2025-09-17T02:30:09.733553] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:09.802092] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-17T02:30:09.877601] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-17T02:30:09.882719] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:09.924245] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-17T02:30:09.924377] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-17T02:30:09.977162] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-17T02:30:09.996839] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-17T02:30:10.054428] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:10.054309] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-17T02:30:10.089606] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:10.105143] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-17T02:30:10.111489] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-17T02:30:10.134075] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-17T02:30:10.116993] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-17T02:30:10.147144] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-17T02:30:10.175998] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-17T02:30:10.243335] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-17T02:30:10.232027] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-17T02:30:10.264219] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-17T02:30:11.165312] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.268451] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-11. [2025-09-17T02:30:11.393704] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.417254] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.417761] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-11. [2025-09-17T02:30:11.418272] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-11. [2025-09-17T02:30:11.498287] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.498578] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-11. [2025-09-17T02:30:12.535090] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T02:30:12.542447] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-17T02:30:12.844938] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:30:12.851578] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-17T02:30:12.929194] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:30:12.938550] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-17T02:30:13.150818] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:30:13.159748] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-17T02:30:13.641912] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T02:30:13.647359] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-17T02:30:13.820633] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T02:30:13.827464] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-17T02:30:13.876319] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T02:30:13.882428] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-17T02:30:15.067163] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:30:15.075515] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-17T02:30:15.089616] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T02:30:15.095019] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-17T02:30:15.753507] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T02:30:15.890144] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-17T02:30:16.017349] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T02:30:16.501424] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:30:16.690205] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-17T02:30:16.949154] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:30:17.490197] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-17T02:30:17.557713] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T02:30:17.679509] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-17T02:30:18.290142] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-17T02:30:18.928147] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:30:19.095225] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-17T02:30:19.098434] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:30:19.890169] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-17T02:30:20.598387] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T02:30:20.690101] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-17T02:30:21.000552] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T02:30:21.490187] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-17T02:30:22.295263] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-17T02:30:22.311286] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:30:22.960268] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T02:30:23.090117] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-17T02:30:23.667518] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:30:23.890173] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-17T02:30:24.428804] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:30:24.690185] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-17T02:30:25.490192] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-17T02:30:25.604741] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T02:30:25.652227] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:30:26.290083] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-17T02:30:26.682541] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T02:30:27.090135] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-17T02:30:27.890169] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-17T02:30:28.393746] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T02:30:28.517135] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:30:28.690164] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-17T02:30:28.859100] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:30:29.490155] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-17T02:30:30.173972] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:30:30.222073] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T02:30:30.290152] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-17T02:30:31.090198] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-17T02:30:31.738111] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T02:30:31.890174] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-17T02:30:32.518899] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:30:32.690169] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-17T02:30:33.317518] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:30:33.490212] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-17T02:30:33.978927] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T02:30:34.290207] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-17T02:30:34.526504] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T02:30:35.090191] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-17T02:30:35.816866] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:30:35.890096] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-17T02:30:36.464145] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:30:36.690159] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-17T02:30:37.214445] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T02:30:37.219004] [INFO ] [REMOTE ] BOOT: Full fetch complete (60556 records). [2025-09-17T02:30:37.219183] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-17T02:30:37.499022] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-17T02:30:37.624323] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-17T02:30:37.624458] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-17T02:30:37.625285] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-17T02:30:37.625355] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-17T02:30:37.626818] [DEBUG] [LOCAL ] BOOT: Trimmed 60556 records to 41539 (keeping 200 days of data) [2025-09-17T02:30:37.864939] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:30:37.910357] [DEBUG] [LOCAL ] BOOT: Primary data saved (41539 records). [2025-09-17T02:30:37.910539] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-17T02:30:37.910713] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOOT took 29.5s. Estimated remaining: 4h 56m 47s. Rate: 6.9 symbols/min [2025-09-17T02:30:38.083590] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:38.120986] [DEBUG] [LOCAL ] BORR: Loaded 38074 existing records from primary storage. [2025-09-17T02:30:38.121169] [INFO ] [MAIN ] BORR: Loaded 38074 existing records. [2025-09-17T02:30:38.295355] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-17T02:30:38.300610] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:38.301624] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-17T02:30:38.301717] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-17T02:30:38.302670] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-17T02:30:38.302744] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-17T02:30:38.630795] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:30:38.688180] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:39.090129] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-17T02:30:39.269187] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:30:39.274188] [INFO ] [REMOTE ] BOH: Full fetch complete (44446 records). [2025-09-17T02:30:39.274311] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-17T02:30:39.664071] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-17T02:30:39.664182] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-17T02:30:39.664891] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-17T02:30:39.664982] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-17T02:30:39.666039] [DEBUG] [LOCAL ] BOH: Trimmed 44446 records to 31453 (keeping 200 days of data) [2025-09-17T02:30:39.863283] [DEBUG] [LOCAL ] BOH: Primary data saved (31453 records). [2025-09-17T02:30:39.864183] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-17T02:30:39.864301] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOH took 31.5s. Estimated remaining: 4h 55m 56s. Rate: 6.9 symbols/min [2025-09-17T02:30:39.895321] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-11. [2025-09-17T02:30:40.042024] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:40.058774] [DEBUG] [LOCAL ] BOW: Loaded 16305 existing records from primary storage. [2025-09-17T02:30:40.058921] [INFO ] [MAIN ] BOW: Loaded 16305 existing records. [2025-09-17T02:30:40.252389] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:40.252815] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-17T02:30:40.252975] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-17T02:30:40.258688] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-17T02:30:40.264862] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-17T02:30:40.270959] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T02:30:40.358469] [INFO ] [REMOTE ] BOND: Full fetch complete (46011 records). [2025-09-17T02:30:40.377820] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-17T02:30:40.708465] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-17T02:30:40.936263] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:41.018515] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-17T02:30:41.018620] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-17T02:30:41.019183] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-17T02:30:41.019238] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-17T02:30:41.020363] [DEBUG] [LOCAL ] BOND: Trimmed 46011 records to 32137 (keeping 200 days of data) [2025-09-17T02:30:41.231966] [DEBUG] [LOCAL ] BOND: Primary data saved (32137 records). [2025-09-17T02:30:41.232168] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-17T02:30:41.232355] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOND took 32.9s. Estimated remaining: 4h 55m 1s. Rate: 6.9 symbols/min [2025-09-17T02:30:41.410877] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:41.459861] [DEBUG] [LOCAL ] BOX: Loaded 37385 existing records from primary storage. [2025-09-17T02:30:41.460040] [INFO ] [MAIN ] BOX: Loaded 37385 existing records. [2025-09-17T02:30:41.502627] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-11. [2025-09-17T02:30:41.638940] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:41.639228] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-17T02:30:41.639289] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-17T02:30:41.640136] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-17T02:30:41.640197] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-17T02:30:41.822679] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:30:41.928705] [INFO ] [REMOTE ] BOE: Full fetch complete (26687 records). [2025-09-17T02:30:41.934342] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-17T02:30:42.060794] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:42.218689] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-17T02:30:42.297850] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-17T02:30:42.426498] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-17T02:30:42.426604] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-17T02:30:42.427136] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-17T02:30:42.427210] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-17T02:30:42.428528] [DEBUG] [LOCAL ] BOE: Trimmed 26687 records to 17559 (keeping 200 days of data) [2025-09-17T02:30:42.542629] [DEBUG] [LOCAL ] BOE: Primary data saved (17559 records). [2025-09-17T02:30:42.542854] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-17T02:30:42.543010] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOE took 34.2s. Estimated remaining: 4h 54m 6s. Rate: 7.0 symbols/min [2025-09-17T02:30:42.715825] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:42.763926] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:30:42.782213] [DEBUG] [LOCAL ] BP: Loaded 40061 existing records from primary storage. [2025-09-17T02:30:42.782396] [INFO ] [MAIN ] BP: Loaded 40061 existing records. [2025-09-17T02:30:42.956956] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:42.957210] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-17T02:30:42.957300] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-17T02:30:42.958317] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-17T02:30:42.958394] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-17T02:30:43.096059] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-11. [2025-09-17T02:30:43.313245] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:43.890189] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-11. [2025-09-17T02:30:44.382750] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T02:30:44.698988] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-17T02:30:44.702531] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:30:45.490179] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-17T02:30:46.087617] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T02:30:46.290254] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-17T02:30:46.522767] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:30:46.891731] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T02:30:47.090139] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-17T02:30:47.363400] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T02:30:47.890129] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-17T02:30:48.659251] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:30:48.690091] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-17T02:30:49.490146] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-17T02:30:50.096136] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-17T02:30:50.300580] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-17T02:30:50.305672] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:30:51.090146] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-17T02:30:51.261913] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:30:51.890144] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-17T02:30:52.108402] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:30:52.690188] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-17T02:30:52.827495] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:30:52.846987] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T02:30:53.490135] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-17T02:30:54.290125] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-17T02:30:54.661879] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T02:30:55.090142] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-17T02:30:55.238979] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T02:30:55.311694] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:30:55.890133] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-17T02:30:56.690140] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-17T02:30:56.825550] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:30:57.291022] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T02:30:57.490164] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-17T02:30:58.291110] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-17T02:30:58.297757] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:30:58.822815] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T02:30:59.090130] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-17T02:30:59.890150] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-17T02:31:00.404630] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T02:31:00.591388] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:31:00.690131] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-17T02:31:01.331977] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:31:01.490134] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-17T02:31:02.290144] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-17T02:31:03.079213] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T02:31:03.090495] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-17T02:31:03.286886] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:31:03.733204] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:31:03.890103] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-17T02:31:04.264596] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T02:31:04.690121] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-17T02:31:05.490109] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-17T02:31:05.781215] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:31:05.810168] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:31:06.290120] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-17T02:31:07.090142] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-17T02:31:07.662536] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T02:31:07.890120] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-17T02:31:08.156476] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:31:08.502724] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:31:08.690117] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-17T02:31:09.490142] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-17T02:31:10.124405] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-17T02:31:10.290133] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-17T02:31:10.444980] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:31:10.451434] [INFO ] [REMOTE ] BORR: Full fetch complete (74674 records). [2025-09-17T02:31:10.451622] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-17T02:31:10.854328] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-17T02:31:10.854435] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-17T02:31:10.855250] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-17T02:31:10.855317] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-17T02:31:10.856804] [DEBUG] [LOCAL ] BORR: Trimmed 74674 records to 51200 (keeping 200 days of data) [2025-09-17T02:31:11.095786] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-17T02:31:11.163550] [DEBUG] [LOCAL ] BORR: Primary data saved (51200 records). [2025-09-17T02:31:11.163744] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-17T02:31:11.163858] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BORR took 33.3s. Estimated remaining: 4h 56m 3s. Rate: 6.9 symbols/min [2025-09-17T02:31:11.339370] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:11.372910] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T02:31:11.402577] [DEBUG] [LOCAL ] BR: Loaded 25280 existing records from primary storage. [2025-09-17T02:31:11.402777] [INFO ] [MAIN ] BR: Loaded 25280 existing records. [2025-09-17T02:31:11.581091] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:11.581380] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-17T02:31:11.581440] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-17T02:31:11.582213] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-17T02:31:11.582277] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-17T02:31:11.900229] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-17T02:31:11.941608] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:11.954886] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T02:31:12.141158] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T02:31:12.690157] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-11. [2025-09-17T02:31:13.490170] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-17T02:31:13.587280] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T02:31:13.596332] [INFO ] [REMOTE ] BOX: Full fetch complete (71987 records). [2025-09-17T02:31:13.596614] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-17T02:31:14.006423] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-17T02:31:14.006530] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-17T02:31:14.007304] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-17T02:31:14.007359] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-17T02:31:14.008872] [DEBUG] [LOCAL ] BOX: Trimmed 71987 records to 50349 (keeping 200 days of data) [2025-09-17T02:31:14.243716] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T02:31:14.302730] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-17T02:31:14.338795] [DEBUG] [LOCAL ] BOX: Primary data saved (50349 records). [2025-09-17T02:31:14.338939] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-17T02:31:14.339042] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BOX took 33.1s. Estimated remaining: 4h 55m 20s. Rate: 6.9 symbols/min [2025-09-17T02:31:14.543492] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:14.580188] [DEBUG] [LOCAL ] BRBR: Loaded 38872 existing records from primary storage. [2025-09-17T02:31:14.580380] [INFO ] [MAIN ] BRBR: Loaded 38872 existing records. [2025-09-17T02:31:14.759213] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:14.759451] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-17T02:31:14.759501] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-17T02:31:14.760356] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-17T02:31:14.760418] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-17T02:31:15.091827] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-17T02:31:15.113115] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:15.179615] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T02:31:15.570078] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T02:31:15.890133] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-11. [2025-09-17T02:31:16.279125] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T02:31:16.690150] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-17T02:31:17.109300] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T02:31:17.490162] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-17T02:31:18.290178] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-17T02:31:18.345375] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T02:31:18.351952] [INFO ] [REMOTE ] BP: Full fetch complete (77650 records). [2025-09-17T02:31:18.352136] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-17T02:31:18.752760] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-17T02:31:18.752885] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-17T02:31:18.753827] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-17T02:31:18.753900] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-17T02:31:18.755522] [DEBUG] [LOCAL ] BP: Trimmed 77650 records to 53711 (keeping 200 days of data) [2025-09-17T02:31:18.991923] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T02:31:19.013091] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:31:19.013850] [INFO ] [REMOTE ] BOW: Full fetch complete (31040 records). [2025-09-17T02:31:19.020776] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-17T02:31:19.093371] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-17T02:31:19.425561] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-17T02:31:19.428076] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-17T02:31:19.428889] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-17T02:31:19.465045] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-17T02:31:19.496451] [DEBUG] [LOCAL ] BOW: Trimmed 31040 records to 23758 (keeping 200 days of data) [2025-09-17T02:31:19.606404] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-17T02:31:19.608246] [INFO ] [MAIN ] BP: Full history saved. [2025-09-17T02:31:19.610617] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BP took 37.1s. Estimated remaining: 4h 54m 50s. Rate: 6.9 symbols/min [2025-09-17T02:31:19.806517] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:19.842904] [DEBUG] [LOCAL ] BRC: Loaded 13406 existing records from primary storage. [2025-09-17T02:31:19.842616] [DEBUG] [LOCAL ] BOW: Primary data saved (23758 records). [2025-09-17T02:31:19.843053] [INFO ] [MAIN ] BRC: Loaded 13406 existing records. [2025-09-17T02:31:19.843095] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-17T02:31:19.897364] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-17T02:31:19.911191] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BOW took 40.0s. Estimated remaining: 4h 53m 49s. Rate: 6.9 symbols/min [2025-09-17T02:31:20.142892] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:20.177870] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-17T02:31:20.195752] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:20.195843] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-17T02:31:20.195951] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-09-17T02:31:20.196097] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-09-17T02:31:20.196211] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-17T02:31:20.196258] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-17T02:31:20.196307] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-09-17T02:31:20.196346] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-17T02:31:20.227317] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-17T02:31:20.270630] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-17T02:31:20.810585] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:20.831320] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-11. [2025-09-17T02:31:20.912113] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:20.938336] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:31:21.159263] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:31:21.490181] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-11. [2025-09-17T02:31:22.290113] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-17T02:31:22.552340] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T02:31:22.613353] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:31:23.090193] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-17T02:31:23.792011] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T02:31:23.890200] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-17T02:31:24.243380] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:31:24.690191] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-17T02:31:25.425056] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:31:25.490309] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-17T02:31:25.898837] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:31:26.290185] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-17T02:31:26.972073] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:31:27.090209] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-17T02:31:27.836325] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T02:31:27.890189] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-17T02:31:28.132102] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:31:28.690237] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-17T02:31:29.241246] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:31:29.490149] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-17T02:31:30.290142] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-17T02:31:30.476408] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T02:31:30.821471] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T02:31:31.090201] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-17T02:31:31.465301] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:31:31.890212] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-17T02:31:32.193901] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T02:31:32.690191] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-17T02:31:33.490164] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-17T02:31:34.290159] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-17T02:31:38.171039] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (5.48 seconds). [2025-09-17T02:31:38.177084] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-17T02:31:38.352681] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (4.06 seconds). [2025-09-17T02:31:38.361732] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-17T02:31:38.538098] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (5.05 seconds). [2025-09-17T02:31:38.548793] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-17T02:31:38.979915] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (7.09 seconds). [2025-09-17T02:31:38.990272] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-17T02:31:39.032427] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T02:31:39.037663] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-17T02:31:39.873049] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T02:31:39.880952] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-17T02:31:39.926028] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T02:31:39.930841] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-17T02:31:40.090625] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T02:31:40.359327] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:31:40.690192] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-17T02:31:41.137148] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T02:31:41.349493] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T02:31:41.490140] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-17T02:31:42.076942] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T02:31:42.290161] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-17T02:31:43.087741] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:31:43.095764] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-17T02:31:43.856173] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T02:31:43.890076] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-17T02:31:44.115722] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:31:44.690167] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-17T02:31:44.854043] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T02:31:45.490140] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-17T02:31:46.276503] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:31:46.290079] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-17T02:31:46.367351] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:31:46.370038] [INFO ] [REMOTE ] BRC: Full fetch complete (29239 records). [2025-09-17T02:31:46.370127] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-17T02:31:46.752404] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-17T02:31:46.752506] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-17T02:31:46.752931] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-17T02:31:46.752987] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-17T02:31:46.753795] [DEBUG] [LOCAL ] BRC: Trimmed 29239 records to 19870 (keeping 200 days of data) [2025-09-17T02:31:46.876859] [DEBUG] [LOCAL ] BRC: Primary data saved (19870 records). [2025-09-17T02:31:46.877041] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-17T02:31:46.877140] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BRC took 27.3s. Estimated remaining: 4h 55m 34s. Rate: 6.9 symbols/min [2025-09-17T02:31:47.056968] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:47.087014] [DEBUG] [LOCAL ] BRFS: Loaded 30222 existing records from primary storage. [2025-09-17T02:31:47.087183] [INFO ] [MAIN ] BRFS: Loaded 30222 existing records. [2025-09-17T02:31:47.098361] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-17T02:31:47.273850] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:47.274135] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-17T02:31:47.274207] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-17T02:31:47.275036] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-17T02:31:47.275113] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-17T02:31:47.635065] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:47.890182] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-11. [2025-09-17T02:31:47.941789] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T02:31:48.690128] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-17T02:31:49.102255] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T02:31:49.490140] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-17T02:31:49.602657] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:31:50.249462] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T02:31:50.290142] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-12. [2025-09-17T02:31:50.722689] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:31:50.729439] [INFO ] [REMOTE ] BR: Full fetch complete (48512 records). [2025-09-17T02:31:50.729635] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-17T02:31:51.095273] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-17T02:31:51.146430] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-17T02:31:51.146531] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-17T02:31:51.147152] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-17T02:31:51.147215] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-17T02:31:51.148555] [DEBUG] [LOCAL ] BR: Trimmed 48512 records to 34763 (keeping 200 days of data) [2025-09-17T02:31:51.375375] [DEBUG] [LOCAL ] BR: Primary data saved (34763 records). [2025-09-17T02:31:51.375557] [INFO ] [MAIN ] BR: Full history saved. [2025-09-17T02:31:51.375668] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BR took 40.2s. Estimated remaining: 4h 54m 60s. Rate: 6.9 symbols/min [2025-09-17T02:31:51.558172] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:51.589775] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T02:31:51.633106] [DEBUG] [LOCAL ] BRO: Loaded 38727 existing records from primary storage. [2025-09-17T02:31:51.633287] [INFO ] [MAIN ] BRO: Loaded 38727 existing records. [2025-09-17T02:31:51.810036] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:51.810326] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-17T02:31:51.810387] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-17T02:31:51.811479] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-17T02:31:51.811545] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-17T02:31:51.895293] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-17T02:31:52.173346] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:52.357947] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T02:31:52.363550] [INFO ] [REMOTE ] BRCC: Full fetch complete (57738 records). [2025-09-17T02:31:52.363712] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-17T02:31:52.698154] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-11. [2025-09-17T02:31:52.751477] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-17T02:31:52.751585] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-17T02:31:52.752247] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-17T02:31:52.752306] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-17T02:31:52.753774] [DEBUG] [LOCAL ] BRCC: Trimmed 57738 records to 40368 (keeping 200 days of data) [2025-09-17T02:31:52.995500] [DEBUG] [LOCAL ] BRCC: Primary data saved (40368 records). [2025-09-17T02:31:52.995694] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-17T02:31:52.995792] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRCC took 33.1s. Estimated remaining: 4h 54m 7s. Rate: 6.9 symbols/min [2025-09-17T02:31:53.173917] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:53.221126] [DEBUG] [LOCAL ] BROS: Loaded 39721 existing records from primary storage. [2025-09-17T02:31:53.221309] [INFO ] [MAIN ] BROS: Loaded 39721 existing records. [2025-09-17T02:31:53.403544] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:53.403805] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-17T02:31:53.403864] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-17T02:31:53.404921] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-17T02:31:53.404992] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-17T02:31:53.500327] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-17T02:31:53.790094] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:53.806908] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T02:31:53.813600] [INFO ] [REMOTE ] BRBR: Full fetch complete (71365 records). [2025-09-17T02:31:53.813793] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-17T02:31:54.211955] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-17T02:31:54.212199] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-17T02:31:54.213038] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-17T02:31:54.213192] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-17T02:31:54.214988] [DEBUG] [LOCAL ] BRBR: Trimmed 71365 records to 51173 (keeping 200 days of data) [2025-09-17T02:31:54.299844] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-11. [2025-09-17T02:31:54.331695] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:31:54.562569] [DEBUG] [LOCAL ] BRBR: Primary data saved (51173 records). [2025-09-17T02:31:54.562816] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-17T02:31:54.562972] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRBR took 40.2s. Estimated remaining: 4h 53m 15s. Rate: 6.9 symbols/min [2025-09-17T02:31:54.734768] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:54.734998] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-17T02:31:54.735061] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-17T02:31:54.735193] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-17T02:31:54.735252] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-17T02:31:54.735318] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-17T02:31:54.735372] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-17T02:31:55.094071] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:55.094208] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-17T02:31:55.123465] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T02:31:55.895221] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-11. [2025-09-17T02:31:55.912249] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:31:56.166817] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:31:56.167181] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-11 [2025-09-17T02:31:56.690201] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-17T02:31:56.807203] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T02:31:56.908041] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:31:56.908375] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-17T02:31:57.490142] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-17T02:31:57.724824] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:31:57.725168] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-17T02:31:58.290140] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-17T02:31:59.090231] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-17T02:31:59.890182] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-17T02:32:00.275616] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T02:32:00.459132] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:32:00.690190] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-17T02:32:01.152668] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:32:01.490136] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-17T02:32:02.290141] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-17T02:32:02.455530] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:32:03.090126] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-17T02:32:03.442980] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T02:32:03.598712] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T02:32:03.890185] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-17T02:32:04.114007] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:04.114339] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-17T02:32:04.582097] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:32:04.690090] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-17T02:32:05.490130] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-17T02:32:05.718496] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:05.718847] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-17T02:32:06.290125] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-17T02:32:06.620715] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T02:32:07.090126] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-17T02:32:07.313171] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:07.313799] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-17T02:32:07.901034] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-17T02:32:07.906051] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T02:32:08.690170] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-17T02:32:09.490180] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-17T02:32:09.719018] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:09.719618] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-17T02:32:09.820352] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T02:32:10.290179] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-17T02:32:10.500401] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T02:32:11.090193] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-17T02:32:11.890249] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-17T02:32:11.967242] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T02:32:12.114555] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:12.114929] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-17T02:32:12.690137] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-17T02:32:12.767411] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T02:32:13.490181] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-17T02:32:14.290201] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-17T02:32:14.590423] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T02:32:15.090143] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-17T02:32:15.568188] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T02:32:15.603407] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T02:32:15.890130] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-17T02:32:16.690123] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-17T02:32:16.868718] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:32:17.490141] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-17T02:32:18.033564] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T02:32:18.213917] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:32:18.290149] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-17T02:32:18.987614] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:32:18.994371] [INFO ] [REMOTE ] BRSL: Full fetch complete (19399 records). [2025-09-17T02:32:18.994546] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-17T02:32:19.097301] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-17T02:32:19.198466] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 53 unique days, need 200 days [2025-09-17T02:32:19.198784] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:32:19.198850] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:32:19.198895] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-17T02:32:19.198993] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-17T02:32:19.199039] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-17T02:32:19.199094] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-17T02:32:19.199164] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRSL took 24.6s. Estimated remaining: 4h 54m 44s. Rate: 6.9 symbols/min [2025-09-17T02:32:19.367364] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:19.392378] [DEBUG] [LOCAL ] BRSP: Loaded 26482 existing records from primary storage. [2025-09-17T02:32:19.392546] [INFO ] [MAIN ] BRSP: Loaded 26482 existing records. [2025-09-17T02:32:19.585316] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:19.585756] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-17T02:32:19.585938] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-17T02:32:19.594883] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-17T02:32:19.610689] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-17T02:32:19.661350] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:32:19.895225] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-17T02:32:19.983620] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:20.690104] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-11. [2025-09-17T02:32:20.780109] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:32:21.166041] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T02:32:21.170563] [INFO ] [REMOTE ] BRFS: Full fetch complete (60825 records). [2025-09-17T02:32:21.170722] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-17T02:32:21.495211] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-17T02:32:21.580358] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-17T02:32:21.580458] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-17T02:32:21.581181] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-17T02:32:21.581257] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-17T02:32:21.582704] [DEBUG] [LOCAL ] BRFS: Trimmed 60825 records to 41078 (keeping 200 days of data) [2025-09-17T02:32:21.821371] [DEBUG] [LOCAL ] BRFS: Primary data saved (41078 records). [2025-09-17T02:32:21.821565] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-17T02:32:21.821699] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRFS took 34.9s. Estimated remaining: 4h 53m 59s. Rate: 6.9 symbols/min [2025-09-17T02:32:21.994177] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:21.999526] [DEBUG] [LOCAL ] BRT: Loaded 3507 existing records from primary storage. [2025-09-17T02:32:21.999628] [INFO ] [MAIN ] BRT: Loaded 3507 existing records. [2025-09-17T02:32:22.183241] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:22.183604] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-17T02:32:22.183712] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-17T02:32:22.184231] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-17T02:32:22.200056] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-17T02:32:22.248812] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:32:22.295176] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-17T02:32:22.578703] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:23.090136] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-11. [2025-09-17T02:32:23.711146] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T02:32:23.832633] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T02:32:23.890098] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-17T02:32:23.939547] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T02:32:24.690177] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-17T02:32:25.312090] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T02:32:25.490139] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-17T02:32:25.848894] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T02:32:26.290144] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-17T02:32:27.090190] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-17T02:32:27.621942] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T02:32:27.732734] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:32:27.890131] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-17T02:32:28.171946] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T02:32:28.236164] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T02:32:28.690175] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-17T02:32:29.490166] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-17T02:32:30.098990] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T02:32:30.290132] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-17T02:32:30.607307] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T02:32:30.614258] [INFO ] [REMOTE ] BROS: Full fetch complete (76795 records). [2025-09-17T02:32:30.614451] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-17T02:32:31.029909] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-17T02:32:31.030591] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T02:32:31.030672] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-17T02:32:31.033550] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-17T02:32:31.033664] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-17T02:32:31.035177] [DEBUG] [LOCAL ] BROS: Trimmed 76795 records to 53282 (keeping 200 days of data) [2025-09-17T02:32:31.096820] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-17T02:32:31.391898] [DEBUG] [LOCAL ] BROS: Primary data saved (53282 records). [2025-09-17T02:32:31.392098] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-17T02:32:31.392204] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BROS took 38.4s. Estimated remaining: 4h 53m 56s. Rate: 6.9 symbols/min [2025-09-17T02:32:31.561053] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:31.575618] [DEBUG] [LOCAL ] BRW: Loaded 14443 existing records from primary storage. [2025-09-17T02:32:31.575801] [INFO ] [MAIN ] BRW: Loaded 14443 existing records. [2025-09-17T02:32:31.750952] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:31.751213] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-17T02:32:31.751289] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-17T02:32:31.751909] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-17T02:32:31.751984] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-17T02:32:31.895215] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-17T02:32:32.137975] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:32.670342] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:32:32.677022] [INFO ] [REMOTE ] BRO: Full fetch complete (73771 records). [2025-09-17T02:32:32.677178] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-17T02:32:32.695292] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-17T02:32:33.082225] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-17T02:32:33.082338] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-17T02:32:33.083121] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-17T02:32:33.083185] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-17T02:32:33.084740] [DEBUG] [LOCAL ] BRO: Trimmed 73771 records to 51909 (keeping 200 days of data) [2025-09-17T02:32:33.413438] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T02:32:33.441951] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T02:32:33.455735] [DEBUG] [LOCAL ] BRO: Primary data saved (51909 records). [2025-09-17T02:32:33.455890] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-17T02:32:33.455990] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRO took 42.1s. Estimated remaining: 4h 53m 7s. Rate: 6.9 symbols/min [2025-09-17T02:32:33.499446] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-11. [2025-09-17T02:32:33.636245] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:33.636478] [DEBUG] [LOCAL ] BRX: No existing data file found in primary storage. [2025-09-17T02:32:33.636533] [WARN ] [MAIN ] BRX: No existing data found, performing full refresh instead. [2025-09-17T02:32:33.636728] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-17T02:32:33.636792] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-17T02:32:33.636846] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-09-17T02:32:33.636895] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-17T02:32:34.008987] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:34.223940] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T02:32:34.290081] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-17T02:32:34.743192] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T02:32:35.090177] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-17T02:32:35.589052] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T02:32:35.890121] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-11. [2025-09-17T02:32:36.690171] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-17T02:32:37.402099] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T02:32:37.490152] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-17T02:32:37.621833] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:32:37.908792] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T02:32:37.909973] [INFO ] [REMOTE ] BRT: Full fetch complete (6736 records). [2025-09-17T02:32:37.910070] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-17T02:32:38.293145] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-17T02:32:38.321210] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-17T02:32:38.322622] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-17T02:32:38.323121] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-17T02:32:38.323246] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-17T02:32:38.324409] [DEBUG] [LOCAL ] BRT: Trimmed 6736 records to 4783 (keeping 200 days of data) [2025-09-17T02:32:38.375741] [DEBUG] [LOCAL ] BRT: Primary data saved (4783 records). [2025-09-17T02:32:38.375995] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-17T02:32:38.376190] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRT took 16.6s. Estimated remaining: 4h 52m 36s. Rate: 6.9 symbols/min [2025-09-17T02:32:38.665530] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:38.707593] [DEBUG] [LOCAL ] BSAC: Loaded 24383 existing records from primary storage. [2025-09-17T02:32:38.707889] [INFO ] [MAIN ] BSAC: Loaded 24383 existing records. [2025-09-17T02:32:39.000071] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:39.000410] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-17T02:32:39.000492] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-17T02:32:39.001328] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-17T02:32:39.002816] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-17T02:32:39.095862] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-17T02:32:39.480596] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:39.500433] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:32:39.890143] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-11. [2025-09-17T02:32:40.594002] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T02:32:40.690131] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-17T02:32:40.715058] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T02:32:41.490161] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-17T02:32:42.290115] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-17T02:32:42.382441] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T02:32:42.691809] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T02:32:43.090152] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-17T02:32:43.445250] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:32:43.890109] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-17T02:32:44.175339] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:32:44.690191] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-17T02:32:45.181792] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:32:45.490253] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-17T02:32:46.290157] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-17T02:32:46.338960] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:32:46.483922] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:32:47.040005] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T02:32:47.090154] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-17T02:32:47.890143] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-17T02:32:48.690143] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-17T02:32:48.734780] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:32:49.490119] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-17T02:32:49.549660] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:32:49.822672] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T02:32:50.290165] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-17T02:32:50.523265] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T02:32:51.090157] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-17T02:32:51.143404] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:32:51.890145] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-17T02:32:52.612225] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T02:32:52.690093] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-17T02:32:53.302441] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:32:53.490160] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-17T02:32:54.225256] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T02:32:54.290086] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-17T02:32:54.810218] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T02:32:55.090188] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-17T02:32:55.867738] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T02:32:55.890071] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-17T02:32:56.531326] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T02:32:56.690156] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-17T02:32:57.490133] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-17T02:32:57.607879] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T02:32:57.952496] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T02:32:57.957935] [INFO ] [REMOTE ] BRSP: Full fetch complete (53799 records). [2025-09-17T02:32:57.958115] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-17T02:32:58.207335] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T02:32:58.295215] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-17T02:32:58.377528] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-17T02:32:58.377634] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-17T02:32:58.378244] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-17T02:32:58.378323] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-17T02:32:58.379578] [DEBUG] [LOCAL ] BRSP: Trimmed 53799 records to 36992 (keeping 200 days of data) [2025-09-17T02:32:58.614375] [DEBUG] [LOCAL ] BRSP: Primary data saved (36992 records). [2025-09-17T02:32:58.614671] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-17T02:32:58.614846] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRSP took 39.4s. Estimated remaining: 4h 53m 37s. Rate: 6.9 symbols/min [2025-09-17T02:32:58.788624] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:58.813870] [DEBUG] [LOCAL ] BSBR: Loaded 26737 existing records from primary storage. [2025-09-17T02:32:58.814025] [INFO ] [MAIN ] BSBR: Loaded 26737 existing records. [2025-09-17T02:32:58.989029] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:58.989276] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-17T02:32:58.989361] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-17T02:32:58.989988] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-17T02:32:58.990056] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-17T02:32:59.095245] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-17T02:32:59.348053] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:59.890180] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-11. [2025-09-17T02:33:00.065615] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T02:33:00.673476] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T02:33:00.690099] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-17T02:33:00.788474] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:33:01.490127] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-17T02:33:02.290139] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-17T02:33:02.711639] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T02:33:02.897696] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:33:03.090137] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-17T02:33:03.890128] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-17T02:33:04.690110] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-17T02:33:05.018332] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-17T02:33:05.044300] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T02:33:05.490085] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-17T02:33:05.610507] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T02:33:05.905726] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T02:33:06.290166] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-17T02:33:06.952376] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:33:07.090122] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-17T02:33:07.890124] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-17T02:33:08.019315] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T02:33:08.472084] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T02:33:08.690110] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-17T02:33:09.043590] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T02:33:09.490135] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-17T02:33:09.828781] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T02:33:09.836628] [INFO ] [REMOTE ] BRX: Full fetch complete (74825 records). [2025-09-17T02:33:09.836827] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-17T02:33:10.232867] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-17T02:33:10.232999] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-17T02:33:10.233790] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-17T02:33:10.233849] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-17T02:33:10.235367] [DEBUG] [LOCAL ] BRX: Trimmed 74825 records to 51877 (keeping 200 days of data) [2025-09-17T02:33:10.295703] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-17T02:33:10.564733] [DEBUG] [LOCAL ] BRX: Primary data saved (51877 records). [2025-09-17T02:33:10.564911] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-17T02:33:10.565025] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BRX took 37.1s. Estimated remaining: 4h 53m 48s. Rate: 6.9 symbols/min [2025-09-17T02:33:10.734859] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:10.742960] [DEBUG] [LOCAL ] BSL: Loaded 5178 existing records from primary storage. [2025-09-17T02:33:10.743090] [INFO ] [MAIN ] BSL: Loaded 5178 existing records. [2025-09-17T02:33:10.922711] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:10.923121] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-17T02:33:10.923217] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-17T02:33:10.923627] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-17T02:33:10.923790] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-17T02:33:11.054029] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T02:33:11.095659] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-17T02:33:11.314830] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:11.751979] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:33:11.890100] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-17T02:33:12.167900] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T02:33:12.171725] [INFO ] [REMOTE ] BRW: Full fetch complete (29165 records). [2025-09-17T02:33:12.171870] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-17T02:33:12.552462] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-17T02:33:12.552573] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-17T02:33:12.553032] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-17T02:33:12.553089] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-17T02:33:12.553928] [DEBUG] [LOCAL ] BRW: Trimmed 29165 records to 18882 (keeping 200 days of data) [2025-09-17T02:33:12.671137] [DEBUG] [LOCAL ] BRW: Primary data saved (18882 records). [2025-09-17T02:33:12.671308] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-17T02:33:12.671411] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BRW took 41.3s. Estimated remaining: 4h 52m 60s. Rate: 6.9 symbols/min [2025-09-17T02:33:12.700184] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-17T02:33:12.846956] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:12.865390] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:33:12.892118] [DEBUG] [LOCAL ] BSM: Loaded 24221 existing records from primary storage. [2025-09-17T02:33:12.892284] [INFO ] [MAIN ] BSM: Loaded 24221 existing records. [2025-09-17T02:33:13.068079] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:13.068318] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-17T02:33:13.068369] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-17T02:33:13.069071] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-17T02:33:13.069134] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-17T02:33:13.423305] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:13.490114] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-11. [2025-09-17T02:33:14.112336] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:33:14.290164] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-17T02:33:14.877618] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T02:33:15.090142] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-17T02:33:15.848502] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:33:15.890083] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-17T02:33:16.690181] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-17T02:33:17.491805] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-11. [2025-09-17T02:33:17.494077] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-17T02:33:18.290180] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-17T02:33:18.463523] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-17T02:33:18.478893] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:33:18.510431] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T02:33:18.514793] [INFO ] [REMOTE ] BSAC: Full fetch complete (43434 records). [2025-09-17T02:33:18.514894] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-17T02:33:18.896505] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-17T02:33:18.896607] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-17T02:33:18.897149] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-17T02:33:18.897204] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-17T02:33:18.898249] [DEBUG] [LOCAL ] BSAC: Trimmed 43434 records to 33089 (keeping 200 days of data) [2025-09-17T02:33:19.090189] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-17T02:33:19.115217] [DEBUG] [LOCAL ] BSAC: Primary data saved (33089 records). [2025-09-17T02:33:19.115378] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-17T02:33:19.115472] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSAC took 40.7s. Estimated remaining: 4h 52m 38s. Rate: 6.9 symbols/min [2025-09-17T02:33:19.300324] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:19.314471] [DEBUG] [LOCAL ] BST: Loaded 13342 existing records from primary storage. [2025-09-17T02:33:19.314609] [INFO ] [MAIN ] BST: Loaded 13342 existing records. [2025-09-17T02:33:19.493793] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:19.494135] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-17T02:33:19.494283] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-17T02:33:19.494922] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-17T02:33:19.495050] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-17T02:33:19.602806] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T02:33:19.874026] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:19.890099] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-17T02:33:20.505183] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:33:20.690101] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-17T02:33:21.382444] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T02:33:21.395847] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T02:33:21.490208] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-17T02:33:22.290186] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-17T02:33:22.817259] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T02:33:22.839105] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:33:23.090198] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-17T02:33:23.890131] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-11. [2025-09-17T02:33:24.048453] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T02:33:24.690169] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-17T02:33:24.989756] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T02:33:25.490147] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-17T02:33:26.089444] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:33:26.290193] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-17T02:33:26.312152] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:33:27.090204] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-17T02:33:27.660688] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T02:33:27.787955] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:33:27.890123] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-17T02:33:28.690152] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-17T02:33:29.348402] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:33:29.490137] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-17T02:33:29.538376] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T02:33:30.290164] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-17T02:33:30.627496] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T02:33:31.071686] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T02:33:31.090321] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-17T02:33:31.890184] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-17T02:33:32.410280] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T02:33:32.415503] [INFO ] [REMOTE ] BSBR: Full fetch complete (50498 records). [2025-09-17T02:33:32.415748] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-17T02:33:32.701787] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-17T02:33:32.833830] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-17T02:33:32.833940] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-17T02:33:32.834517] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-17T02:33:32.834587] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-17T02:33:32.835717] [DEBUG] [LOCAL ] BSBR: Trimmed 50498 records to 35023 (keeping 200 days of data) [2025-09-17T02:33:33.044821] [DEBUG] [LOCAL ] BSBR: Primary data saved (35023 records). [2025-09-17T02:33:33.044996] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-17T02:33:33.045103] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSBR took 34.4s. Estimated remaining: 4h 53m 1s. Rate: 6.9 symbols/min [2025-09-17T02:33:33.220702] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:33.220981] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-09-17T02:33:33.221086] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-09-17T02:33:33.221288] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-17T02:33:33.221378] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-17T02:33:33.221503] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-17T02:33:33.221619] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-17T02:33:33.345662] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:33:33.495312] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-17T02:33:33.567071] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:33:33.624363] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:34.290174] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-11. [2025-09-17T02:33:35.014402] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:33:35.082197] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T02:33:35.090069] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-17T02:33:35.890174] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-17T02:33:36.337907] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:33:36.481742] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T02:33:36.690163] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-17T02:33:37.148857] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T02:33:37.490162] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-17T02:33:38.290148] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-17T02:33:38.877348] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T02:33:38.916144] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:33:38.917580] [INFO ] [REMOTE ] BSL: Full fetch complete (12527 records). [2025-09-17T02:33:38.917690] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-17T02:33:39.096524] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-17T02:33:39.290529] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-17T02:33:39.290632] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-17T02:33:39.290958] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-17T02:33:39.291013] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-17T02:33:39.291495] [DEBUG] [LOCAL ] BSL: Trimmed 12527 records to 8201 (keeping 200 days of data) [2025-09-17T02:33:39.342500] [DEBUG] [LOCAL ] BSL: Primary data saved (8201 records). [2025-09-17T02:33:39.342666] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-17T02:33:39.342765] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSL took 28.8s. Estimated remaining: 4h 52m 38s. Rate: 6.9 symbols/min [2025-09-17T02:33:39.515872] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:39.554934] [DEBUG] [LOCAL ] BSX: Loaded 40038 existing records from primary storage. [2025-09-17T02:33:39.555123] [INFO ] [MAIN ] BSX: Loaded 40038 existing records. [2025-09-17T02:33:39.740003] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:39.740265] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-17T02:33:39.740327] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-17T02:33:39.741367] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-17T02:33:39.741439] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-17T02:33:39.895637] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-17T02:33:40.108485] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:40.632731] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:33:40.690093] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-17T02:33:41.143162] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:33:41.490131] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-11. [2025-09-17T02:33:41.779811] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T02:33:41.784486] [INFO ] [REMOTE ] BSM: Full fetch complete (47649 records). [2025-09-17T02:33:41.784668] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-17T02:33:42.172091] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-17T02:33:42.172203] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-17T02:33:42.172817] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-17T02:33:42.172875] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-17T02:33:42.174015] [DEBUG] [LOCAL ] BSM: Trimmed 47649 records to 32621 (keeping 200 days of data) [2025-09-17T02:33:42.290403] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-17T02:33:42.376327] [DEBUG] [LOCAL ] BSM: Primary data saved (32621 records). [2025-09-17T02:33:42.376491] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-17T02:33:42.376583] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BSM took 29.7s. Estimated remaining: 4h 51m 56s. Rate: 6.9 symbols/min [2025-09-17T02:33:42.547948] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:42.548157] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-09-17T02:33:42.548211] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-09-17T02:33:42.548314] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-17T02:33:42.548366] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-17T02:33:42.548436] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-09-17T02:33:42.548483] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-17T02:33:42.899476] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:43.090161] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-11. [2025-09-17T02:33:43.291132] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:33:43.583692] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T02:33:43.836067] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T02:33:43.890187] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-17T02:33:44.684147] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:33:44.690068] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-17T02:33:45.204299] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T02:33:45.490180] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-17T02:33:46.290121] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-17T02:33:46.844033] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:33:46.988025] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T02:33:47.090163] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-17T02:33:47.890123] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-17T02:33:48.659015] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T02:33:48.690137] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-17T02:33:48.916762] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T02:33:49.490131] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-17T02:33:49.796588] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T02:33:49.838236] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T02:33:50.290149] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-17T02:33:51.090185] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-17T02:33:51.890178] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-17T02:33:52.005064] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T02:33:52.327055] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T02:33:52.690139] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-17T02:33:52.992923] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T02:33:53.490148] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-17T02:33:54.290126] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-17T02:33:54.418933] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:33:54.551726] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:33:55.008797] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T02:33:55.090114] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-17T02:33:55.890158] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-17T02:33:56.341119] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:33:56.488881] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T02:33:56.690124] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-17T02:33:57.299931] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:33:57.490183] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-17T02:33:58.137819] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T02:33:58.290145] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-17T02:33:59.090131] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-17T02:33:59.462697] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:33:59.690697] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T02:33:59.890132] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-17T02:34:00.690130] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-17T02:34:00.951217] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T02:34:01.490139] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-17T02:34:02.290094] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-17T02:34:02.611498] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:34:02.712371] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T02:34:02.883775] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T02:34:02.885636] [INFO ] [REMOTE ] BTA: Full fetch complete (9462 records). [2025-09-17T02:34:02.885774] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-17T02:34:03.097031] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-17T02:34:03.266881] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-17T02:34:03.266990] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-17T02:34:03.267293] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-17T02:34:03.267346] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-17T02:34:03.267833] [DEBUG] [LOCAL ] BTA: Trimmed 9462 records to 5233 (keeping 200 days of data) [2025-09-17T02:34:03.298926] [DEBUG] [LOCAL ] BTA: Primary data saved (5233 records). [2025-09-17T02:34:03.299032] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-17T02:34:03.299114] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BTA took 20.9s. Estimated remaining: 4h 52m 59s. Rate: 6.9 symbols/min [2025-09-17T02:34:03.466000] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:03.479124] [DEBUG] [LOCAL ] BTCM: Loaded 12997 existing records from primary storage. [2025-09-17T02:34:03.479251] [INFO ] [MAIN ] BTCM: Loaded 12997 existing records. [2025-09-17T02:34:03.660462] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:03.660873] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-17T02:34:03.660952] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-17T02:34:03.661450] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-17T02:34:03.661519] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-17T02:34:03.897190] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-17T02:34:04.018725] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:04.030400] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T02:34:04.690178] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-11. [2025-09-17T02:34:05.490099] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-17T02:34:05.877765] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:34:05.954673] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:34:06.161104] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T02:34:06.290123] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-17T02:34:07.090123] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-17T02:34:07.570877] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T02:34:07.890152] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-17T02:34:08.210132] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:34:08.690197] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-17T02:34:08.714285] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T02:34:08.717199] [INFO ] [REMOTE ] BST: Full fetch complete (28741 records). [2025-09-17T02:34:08.717296] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-17T02:34:09.089835] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-17T02:34:09.089938] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-17T02:34:09.090340] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-17T02:34:09.090397] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-17T02:34:09.091158] [DEBUG] [LOCAL ] BST: Trimmed 28741 records to 19513 (keeping 200 days of data) [2025-09-17T02:34:09.208084] [DEBUG] [LOCAL ] BST: Primary data saved (19513 records). [2025-09-17T02:34:09.208248] [INFO ] [MAIN ] BST: Full history saved. [2025-09-17T02:34:09.208345] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BST took 50.1s. Estimated remaining: 4h 52m 34s. Rate: 6.9 symbols/min [2025-09-17T02:34:09.376899] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:09.377135] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-09-17T02:34:09.377182] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-09-17T02:34:09.377290] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-17T02:34:09.377342] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-17T02:34:09.377408] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-09-17T02:34:09.377459] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-17T02:34:09.495238] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-17T02:34:09.744168] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:09.745139] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T02:34:09.748579] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36719 records). [2025-09-17T02:34:09.748686] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-17T02:34:10.121617] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-17T02:34:10.121910] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-17T02:34:10.122398] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-17T02:34:10.122453] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-17T02:34:10.123471] [DEBUG] [LOCAL ] BSTZ: Trimmed 36719 records to 25114 (keeping 200 days of data) [2025-09-17T02:34:10.274959] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25114 records). [2025-09-17T02:34:10.275107] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-17T02:34:10.275189] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSTZ took 37.2s. Estimated remaining: 4h 51m 41s. Rate: 6.9 symbols/min [2025-09-17T02:34:10.295900] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-11. [2025-09-17T02:34:10.446340] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:10.489707] [DEBUG] [LOCAL ] BTI: Loaded 39958 existing records from primary storage. [2025-09-17T02:34:10.489871] [INFO ] [MAIN ] BTI: Loaded 39958 existing records. [2025-09-17T02:34:10.666408] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:10.666724] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-17T02:34:10.667495] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-17T02:34:10.668492] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-17T02:34:10.668555] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-17T02:34:11.025260] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:11.090099] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-11. [2025-09-17T02:34:11.610287] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T02:34:11.890132] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-17T02:34:12.041350] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:34:12.690140] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-17T02:34:12.831519] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T02:34:13.490155] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-17T02:34:13.812150] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T02:34:14.290116] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-17T02:34:14.343180] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T02:34:15.090148] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-17T02:34:15.143541] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T02:34:15.181167] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T02:34:15.890137] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-17T02:34:16.612569] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:34:16.690141] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-17T02:34:17.490140] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-17T02:34:17.848821] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T02:34:17.945114] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T02:34:17.973763] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T02:34:18.290199] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-17T02:34:19.090194] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-17T02:34:19.540589] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:34:19.890139] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-17T02:34:20.055083] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:34:20.690186] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-17T02:34:21.490126] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-17T02:34:21.597516] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T02:34:22.176831] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T02:34:22.290180] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-17T02:34:22.592224] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T02:34:23.029816] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T02:34:23.090098] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-17T02:34:23.708067] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:34:23.890319] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-17T02:34:24.690134] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-17T02:34:25.490132] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-17T02:34:25.639839] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:34:26.290149] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-17T02:34:26.675353] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T02:34:27.090187] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-17T02:34:27.387136] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T02:34:27.890128] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-17T02:34:28.074426] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:34:28.690187] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-17T02:34:29.235727] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-17T02:34:29.490140] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-17T02:34:29.678139] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T02:34:29.685005] [INFO ] [REMOTE ] BSX: Full fetch complete (77524 records). [2025-09-17T02:34:29.685189] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-17T02:34:30.085377] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-17T02:34:30.085541] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-17T02:34:30.086409] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-17T02:34:30.086486] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-17T02:34:30.088184] [DEBUG] [LOCAL ] BSX: Trimmed 77524 records to 53688 (keeping 200 days of data) [2025-09-17T02:34:30.216570] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T02:34:30.293371] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-17T02:34:30.447153] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-17T02:34:30.447317] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-17T02:34:30.447408] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BSX took 51.1s. Estimated remaining: 4h 52m 40s. Rate: 6.9 symbols/min [2025-09-17T02:34:30.622845] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:30.630600] [DEBUG] [LOCAL ] BTO: Loaded 6236 existing records from primary storage. [2025-09-17T02:34:30.630770] [INFO ] [MAIN ] BTO: Loaded 6236 existing records. [2025-09-17T02:34:30.813971] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:30.814233] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-17T02:34:30.814294] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-17T02:34:30.814702] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-17T02:34:30.814767] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-17T02:34:31.099615] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-17T02:34:31.182411] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:31.360571] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:34:31.424931] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:34:31.890139] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-17T02:34:32.690187] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-17T02:34:33.331842] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T02:34:33.490160] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-11. [2025-09-17T02:34:33.716819] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T02:34:33.717763] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:34:33.735952] [INFO ] [REMOTE ] BTCM: Full fetch complete (19229 records). [2025-09-17T02:34:33.736070] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-17T02:34:34.107265] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-17T02:34:34.107399] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-17T02:34:34.107815] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-17T02:34:34.107987] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-17T02:34:34.108712] [DEBUG] [LOCAL ] BTCM: Trimmed 19229 records to 14034 (keeping 200 days of data) [2025-09-17T02:34:34.191304] [DEBUG] [LOCAL ] BTCM: Primary data saved (14034 records). [2025-09-17T02:34:34.191480] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-17T02:34:34.191585] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTCM took 30.9s. Estimated remaining: 4h 52m 2s. Rate: 6.9 symbols/min [2025-09-17T02:34:34.294184] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-17T02:34:34.368333] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:34.376900] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T02:34:34.390273] [DEBUG] [LOCAL ] BTT: Loaded 11485 existing records from primary storage. [2025-09-17T02:34:34.390412] [INFO ] [MAIN ] BTT: Loaded 11485 existing records. [2025-09-17T02:34:34.572299] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:34.572582] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-17T02:34:34.572670] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-17T02:34:34.573176] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-17T02:34:34.573242] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-17T02:34:34.935576] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:35.090130] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-17T02:34:35.516767] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:34:35.523727] [INFO ] [REMOTE ] BTE: Full fetch complete (75805 records). [2025-09-17T02:34:35.523902] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-17T02:34:35.720627] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:34:35.898151] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-11. [2025-09-17T02:34:35.957293] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-17T02:34:35.957406] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-17T02:34:35.958261] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-17T02:34:35.958330] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-17T02:34:35.960284] [DEBUG] [LOCAL ] BTE: Trimmed 75805 records to 52758 (keeping 200 days of data) [2025-09-17T02:34:36.296996] [DEBUG] [LOCAL ] BTE: Primary data saved (52758 records). [2025-09-17T02:34:36.297164] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-17T02:34:36.297255] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTE took 27.1s. Estimated remaining: 4h 51m 16s. Rate: 6.9 symbols/min [2025-09-17T02:34:36.473689] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:36.514491] [DEBUG] [LOCAL ] BTU: Loaded 39703 existing records from primary storage. [2025-09-17T02:34:36.514717] [INFO ] [MAIN ] BTU: Loaded 39703 existing records. [2025-09-17T02:34:36.698101] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-17T02:34:36.702704] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:36.703746] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-17T02:34:36.703812] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-17T02:34:36.704813] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-17T02:34:36.704879] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-17T02:34:36.884141] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:34:37.078348] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:37.490139] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-17T02:34:37.513473] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T02:34:38.290158] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-17T02:34:38.793783] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T02:34:39.076140] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:34:39.090098] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-17T02:34:39.890187] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-17T02:34:39.913047] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:34:40.690133] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-17T02:34:40.853949] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T02:34:41.490147] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-17T02:34:41.533244] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T02:34:42.290171] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-11. [2025-09-17T02:34:43.090141] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-17T02:34:43.578689] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T02:34:43.695191] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T02:34:43.881433] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:34:43.890082] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-17T02:34:44.690136] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-17T02:34:44.847183] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:34:45.490704] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-17T02:34:45.495270] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:34:46.290103] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-17T02:34:46.603166] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T02:34:47.090140] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-17T02:34:47.116336] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:34:47.890137] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-17T02:34:48.659582] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T02:34:48.690091] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-17T02:34:48.785878] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:34:49.490207] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-17T02:34:49.512821] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T02:34:50.290175] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-17T02:34:50.947128] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T02:34:50.948618] [INFO ] [REMOTE ] BTO: Full fetch complete (13315 records). [2025-09-17T02:34:50.948729] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-17T02:34:51.095229] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-17T02:34:51.330818] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-17T02:34:51.331151] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-17T02:34:51.331597] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-17T02:34:51.331855] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-17T02:34:51.332840] [DEBUG] [LOCAL ] BTO: Trimmed 13315 records to 9032 (keeping 200 days of data) [2025-09-17T02:34:51.412769] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T02:34:51.436565] [DEBUG] [LOCAL ] BTO: Primary data saved (9032 records). [2025-09-17T02:34:51.436793] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-17T02:34:51.436919] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTO took 21.0s. Estimated remaining: 4h 51m 44s. Rate: 6.9 symbols/min [2025-09-17T02:34:51.612740] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:51.613003] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-17T02:34:51.613056] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-17T02:34:51.613167] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-17T02:34:51.613221] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-17T02:34:51.613272] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-17T02:34:51.613314] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-17T02:34:51.893301] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-17T02:34:51.998555] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:51.999248] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T02:34:52.690173] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-11. [2025-09-17T02:34:52.902420] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:34:52.902780] [WARN ] [REMOTE ] BTX: No data returned for month 2024-11 [2025-09-17T02:34:53.490134] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-17T02:34:53.783313] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:34:53.783900] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-17T02:34:53.831955] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T02:34:54.290140] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-17T02:34:55.090168] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-17T02:34:55.296426] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:34:55.296822] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-17T02:34:55.890137] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-17T02:34:56.194914] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T02:34:56.678535] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:34:56.690075] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-17T02:34:57.490178] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-17T02:34:58.027529] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T02:34:58.290149] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-17T02:34:59.090117] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-17T02:34:59.608227] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T02:34:59.724476] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:34:59.890079] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-17T02:35:00.690165] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-17T02:35:00.843521] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:35:00.909953] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T02:35:01.490172] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-17T02:35:02.290100] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-17T02:35:02.712179] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T02:35:03.090134] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-17T02:35:03.193956] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T02:35:03.231799] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T02:35:03.750492] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T02:35:03.890126] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-17T02:35:04.690130] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-17T02:35:05.323892] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:35:05.490201] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-17T02:35:06.290224] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-17T02:35:06.510363] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:35:06.684308] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:35:07.090250] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-17T02:35:07.890136] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-17T02:35:08.069763] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:35:08.094200] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:35:08.690163] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-17T02:35:09.089298] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T02:35:09.093028] [INFO ] [REMOTE ] BTX: Full fetch complete (34419 records). [2025-09-17T02:35:09.093266] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-17T02:35:09.312397] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-17T02:35:09.312904] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:35:09.312964] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:35:09.313016] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-17T02:35:09.313086] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-17T02:35:09.313137] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-17T02:35:09.313201] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-17T02:35:09.313295] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTX took 17.9s. Estimated remaining: 4h 52m 28s. Rate: 6.9 symbols/min [2025-09-17T02:35:09.485484] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:09.485760] [DEBUG] [LOCAL ] BTZ: No existing data file found in primary storage. [2025-09-17T02:35:09.485814] [WARN ] [MAIN ] BTZ: No existing data found, performing full refresh instead. [2025-09-17T02:35:09.485921] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-17T02:35:09.485976] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-17T02:35:09.486028] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-09-17T02:35:09.486069] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-17T02:35:09.497226] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-17T02:35:09.807258] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T02:35:09.889895] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:10.290154] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-11. [2025-09-17T02:35:11.090172] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-17T02:35:11.434403] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:35:11.627402] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T02:35:11.890127] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-17T02:35:12.690146] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-17T02:35:12.990910] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T02:35:12.997550] [INFO ] [REMOTE ] BTI: Full fetch complete (77261 records). [2025-09-17T02:35:12.997721] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-17T02:35:13.397709] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-17T02:35:13.397827] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-17T02:35:13.398739] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-17T02:35:13.398801] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-17T02:35:13.400380] [DEBUG] [LOCAL ] BTI: Trimmed 77261 records to 53552 (keeping 200 days of data) [2025-09-17T02:35:13.493594] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-17T02:35:13.735106] [DEBUG] [LOCAL ] BTI: Primary data saved (53552 records). [2025-09-17T02:35:13.735366] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-17T02:35:13.735707] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTI took 1m 3s. Estimated remaining: 4h 51m 55s. Rate: 6.9 symbols/min [2025-09-17T02:35:13.880902] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:35:13.957221] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:13.957921] [DEBUG] [LOCAL ] BUD: No existing data file found in primary storage. [2025-09-17T02:35:13.958112] [WARN ] [MAIN ] BUD: No existing data found, performing full refresh instead. [2025-09-17T02:35:13.958324] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-17T02:35:13.958404] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-17T02:35:13.972418] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-09-17T02:35:13.973082] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-17T02:35:13.973675] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T02:35:14.177578] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:35:14.265528] [INFO ] [REMOTE ] BTT: Full fetch complete (24388 records). [2025-09-17T02:35:14.286943] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-17T02:35:14.293091] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-17T02:35:14.427994] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:14.782397] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-17T02:35:14.782513] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-17T02:35:14.782929] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-17T02:35:14.782985] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-17T02:35:14.784581] [DEBUG] [LOCAL ] BTT: Trimmed 24388 records to 16117 (keeping 200 days of data) [2025-09-17T02:35:14.891309] [DEBUG] [LOCAL ] BTT: Primary data saved (16117 records). [2025-09-17T02:35:14.891490] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-17T02:35:14.891589] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTT took 40.7s. Estimated remaining: 4h 51m 4s. Rate: 6.9 symbols/min [2025-09-17T02:35:15.060920] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:15.070755] [DEBUG] [LOCAL ] BUI: Loaded 8640 existing records from primary storage. [2025-09-17T02:35:15.070889] [INFO ] [MAIN ] BUI: Loaded 8640 existing records. [2025-09-17T02:35:15.100814] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-11. [2025-09-17T02:35:15.251061] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:35:15.251353] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-17T02:35:15.251427] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-17T02:35:15.251854] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-17T02:35:15.251929] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-17T02:35:15.605423] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:15.618797] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T02:35:15.890127] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-17T02:35:16.690146] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-17T02:35:17.121471] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T02:35:17.495371] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-11. [2025-09-17T02:35:17.514652] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:35:17.527169] [INFO ] [REMOTE ] BTU: Full fetch complete (76666 records). [2025-09-17T02:35:17.527442] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-17T02:35:18.043673] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T02:35:18.063392] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-17T02:35:18.068915] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-17T02:35:18.070297] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-17T02:35:18.070384] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-17T02:35:18.073051] [DEBUG] [LOCAL ] BTU: Trimmed 76666 records to 53303 (keeping 200 days of data) [2025-09-17T02:35:18.302606] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-17T02:35:18.358938] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T02:35:18.479401] [DEBUG] [LOCAL ] BTU: Primary data saved (53303 records). [2025-09-17T02:35:18.479602] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-17T02:35:18.480403] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTU took 42.2s. Estimated remaining: 4h 50m 26s. Rate: 6.9 symbols/min [2025-09-17T02:35:18.660492] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:18.660741] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-09-17T02:35:18.660794] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-09-17T02:35:18.660905] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-17T02:35:18.660968] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-17T02:35:18.661019] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-17T02:35:18.661071] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-17T02:35:19.028140] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:19.090143] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-17T02:35:19.830131] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T02:35:19.890182] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-17T02:35:20.299210] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T02:35:20.483910] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T02:35:20.690171] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-11. [2025-09-17T02:35:21.490142] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-17T02:35:22.195332] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T02:35:22.290192] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-17T02:35:22.733998] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T02:35:23.089035] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:35:23.091458] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-17T02:35:23.890164] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-17T02:35:24.318905] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T02:35:24.690208] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-17T02:35:24.753599] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T02:35:25.490190] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-17T02:35:26.148131] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T02:35:26.290179] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-17T02:35:26.691070] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:35:27.090162] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-17T02:35:27.890181] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-17T02:35:28.137414] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:35:28.267436] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T02:35:28.624334] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T02:35:28.690144] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-17T02:35:29.351616] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T02:35:29.490173] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-17T02:35:30.290144] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-17T02:35:31.090169] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-17T02:35:31.415465] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T02:35:31.678993] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T02:35:31.857810] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:35:31.890100] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-17T02:35:32.690137] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-17T02:35:33.387770] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:35:33.490158] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-17T02:35:33.648243] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T02:35:34.290424] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-17T02:35:34.341107] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T02:35:35.090160] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-17T02:35:35.890194] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-17T02:35:36.333938] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T02:35:36.373433] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T02:35:36.578199] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T02:35:36.690157] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-17T02:35:37.490189] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-17T02:35:38.290190] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-17T02:35:38.320037] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T02:35:38.390892] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:35:38.394506] [INFO ] [REMOTE ] BTZ: Full fetch complete (34119 records). [2025-09-17T02:35:38.394725] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-17T02:35:38.779524] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-17T02:35:38.779636] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-17T02:35:38.780184] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-17T02:35:38.780250] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-17T02:35:38.781196] [DEBUG] [LOCAL ] BTZ: Trimmed 34119 records to 23121 (keeping 200 days of data) [2025-09-17T02:35:38.938407] [DEBUG] [LOCAL ] BTZ: Primary data saved (23121 records). [2025-09-17T02:35:38.938607] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-17T02:35:38.938719] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BTZ took 29.6s. Estimated remaining: 4h 51m 24s. Rate: 6.9 symbols/min [2025-09-17T02:35:39.090524] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-17T02:35:39.113046] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:39.151856] [DEBUG] [LOCAL ] BURL: Loaded 33959 existing records from primary storage. [2025-09-17T02:35:39.152020] [INFO ] [MAIN ] BURL: Loaded 33959 existing records. [2025-09-17T02:35:39.338465] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:35:39.338748] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-17T02:35:39.338808] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-17T02:35:39.339576] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-17T02:35:39.339633] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-17T02:35:39.706807] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:39.890138] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-11. [2025-09-17T02:35:39.936596] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:35:40.185165] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:35:40.690143] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-17T02:35:41.490199] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-17T02:35:41.502778] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:35:41.505119] [INFO ] [REMOTE ] BUI: Full fetch complete (16030 records). [2025-09-17T02:35:41.505227] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-17T02:35:41.908974] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T02:35:41.918556] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-17T02:35:41.918691] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-17T02:35:41.919029] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-17T02:35:41.919082] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-17T02:35:41.919678] [DEBUG] [LOCAL ] BUI: Trimmed 16030 records to 11424 (keeping 200 days of data) [2025-09-17T02:35:41.991514] [DEBUG] [LOCAL ] BUI: Primary data saved (11424 records). [2025-09-17T02:35:41.991689] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-17T02:35:41.991784] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUI took 27.1s. Estimated remaining: 4h 50m 44s. Rate: 6.9 symbols/min [2025-09-17T02:35:42.290155] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-17T02:35:43.090134] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-17T02:35:43.158143] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:35:43.670519] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T02:35:43.890143] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-17T02:35:44.690175] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-17T02:35:44.985831] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T02:35:45.047491] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T02:35:45.490158] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-17T02:35:46.290187] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-17T02:35:46.420117] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:35:46.614881] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:35:47.090148] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-17T02:35:47.890133] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-17T02:35:48.089209] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:35:48.690143] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-17T02:35:48.913419] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:35:49.416907] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T02:35:49.490122] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-17T02:35:50.290128] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-17T02:35:50.635532] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:35:51.090147] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-17T02:35:51.203925] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T02:35:51.857712] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:35:51.890078] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-17T02:35:52.690158] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-17T02:35:52.950582] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T02:35:53.490154] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-17T02:35:53.664343] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T02:35:53.769118] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T02:35:53.774756] [INFO ] [REMOTE ] BUR: Full fetch complete (63034 records). [2025-09-17T02:35:53.774904] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-17T02:35:54.165407] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-17T02:35:54.165519] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-17T02:35:54.166249] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-17T02:35:54.166314] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-17T02:35:54.167900] [DEBUG] [LOCAL ] BUR: Trimmed 63034 records to 45181 (keeping 200 days of data) [2025-09-17T02:35:54.290625] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-17T02:35:54.447534] [DEBUG] [LOCAL ] BUR: Primary data saved (45181 records). [2025-09-17T02:35:54.447719] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-17T02:35:54.447817] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BUR took 36.0s. Estimated remaining: 4h 50m 57s. Rate: 6.9 symbols/min [2025-09-17T02:35:55.209596] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T02:35:55.216338] [INFO ] [REMOTE ] BUD: Full fetch complete (76344 records). [2025-09-17T02:35:55.216555] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-17T02:35:55.635294] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-17T02:35:55.635419] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-17T02:35:55.636229] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-17T02:35:55.636291] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-17T02:35:55.637870] [DEBUG] [LOCAL ] BUD: Trimmed 76344 records to 52767 (keeping 200 days of data) [2025-09-17T02:35:55.983058] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T02:35:55.996019] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-17T02:35:56.005223] [DEBUG] [LOCAL ] BUD: Primary data saved (52767 records). [2025-09-17T02:35:56.005417] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-17T02:35:56.005517] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BUD took 42.3s. Estimated remaining: 4h 50m 8s. Rate: 6.9 symbols/min [2025-09-17T02:35:57.271604] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T02:35:57.282166] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-17T02:35:58.952886] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T02:35:58.963062] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-17T02:36:00.416664] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:36:00.422537] [INFO ] [REMOTE ] BURL: Full fetch complete (65687 records). [2025-09-17T02:36:00.422712] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-17T02:36:00.811890] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-17T02:36:00.812018] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-17T02:36:00.812822] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-17T02:36:00.812905] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-17T02:36:00.814284] [DEBUG] [LOCAL ] BURL: Trimmed 65687 records to 46558 (keeping 200 days of data) [2025-09-17T02:36:01.099406] [DEBUG] [LOCAL ] BURL: Primary data saved (46558 records). [2025-09-17T02:36:01.099584] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-17T02:36:01.099697] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BURL took 22.2s. Estimated remaining: 4h 49m 39s. Rate: 6.9 symbols/min [2025-09-17T02:36:01.624570] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.763765] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.801285] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.822058] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.834039] [DEBUG] [LOCAL ] BUXX: Loaded 11499 existing records from primary storage. [2025-09-17T02:36:01.834399] [INFO ] [MAIN ] BUXX: Loaded 11499 existing records. [2025-09-17T02:36:02.049399] [DEBUG] [LOCAL ] BV: Loaded 28578 existing records from primary storage. [2025-09-17T02:36:02.079866] [INFO ] [MAIN ] BV: Loaded 28578 existing records. [2025-09-17T02:36:02.080704] [DEBUG] [LOCAL ] BW: Loaded 28462 existing records from primary storage. [2025-09-17T02:36:02.076485] [DEBUG] [LOCAL ] BVN: Loaded 32229 existing records from primary storage. [2025-09-17T02:36:02.079660] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.080989] [INFO ] [MAIN ] BVN: Loaded 32229 existing records. [2025-09-17T02:36:02.081167] [INFO ] [MAIN ] BW: Loaded 28462 existing records. [2025-09-17T02:36:02.086616] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.204048] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-17T02:36:02.341063] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-17T02:36:02.433835] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-17T02:36:02.690606] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.765587] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.801519] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.804837] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.801660] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.805214] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-17T02:36:02.816009] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-17T02:36:02.821136] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-17T02:36:02.821219] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.855880] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-17T02:36:02.850431] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-17T02:36:02.855839] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-17T02:36:02.900563] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-17T02:36:03.077886] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-17T02:36:03.146776] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-17T02:36:03.750449] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:03.786311] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-11. [2025-09-17T02:36:03.956697] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:03.994697] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-11. [2025-09-17T02:36:04.153281] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:04.192078] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-11. [2025-09-17T02:36:04.191754] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:04.192413] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-11. [2025-09-17T02:36:04.835338] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T02:36:04.838373] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-17T02:36:05.067281] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T02:36:05.074362] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-17T02:36:05.679863] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:36:05.683002] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-17T02:36:05.841557] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:36:05.850183] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-17T02:36:05.897113] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:36:05.905960] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-17T02:36:06.028423] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T02:36:06.035307] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-17T02:36:06.163699] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T02:36:06.166673] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-17T02:36:07.044382] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T02:36:07.047247] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-17T02:36:07.334871] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T02:36:07.342111] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-17T02:36:07.448328] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:36:07.491391] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T02:36:07.598626] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T02:36:07.890158] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-17T02:36:08.690183] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-17T02:36:08.726860] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T02:36:09.039555] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:36:09.490170] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-17T02:36:10.208828] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:36:10.290136] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-17T02:36:10.520433] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T02:36:11.090190] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-17T02:36:11.524716] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T02:36:11.890172] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-17T02:36:12.170791] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T02:36:12.690170] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-17T02:36:12.969347] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T02:36:13.490139] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-17T02:36:13.883015] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T02:36:14.290149] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-17T02:36:15.073909] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T02:36:15.090075] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-17T02:36:15.890201] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-17T02:36:16.656446] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T02:36:16.690160] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-17T02:36:17.492384] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-17T02:36:17.495519] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-17T02:36:17.610259] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:36:17.876405] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:36:18.129681] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:36:18.290192] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-17T02:36:19.090136] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-17T02:36:19.620489] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T02:36:19.890182] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-17T02:36:20.699625] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-17T02:36:20.704942] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:36:20.921863] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T02:36:21.490248] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-17T02:36:21.938453] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:36:22.290154] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-17T02:36:22.407989] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T02:36:23.090187] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-17T02:36:23.788479] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:36:23.890139] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-17T02:36:24.520420] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:36:24.690157] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-17T02:36:25.360209] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:36:25.490148] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-17T02:36:26.282046] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:36:26.290772] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-17T02:36:26.388730] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:36:27.090166] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-17T02:36:27.680030] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:36:27.685159] [INFO ] [REMOTE ] BV: Full fetch complete (53452 records). [2025-09-17T02:36:27.685309] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-17T02:36:27.895940] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-17T02:36:28.098063] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-17T02:36:28.098190] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-17T02:36:28.099465] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-17T02:36:28.099557] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-17T02:36:28.101284] [DEBUG] [LOCAL ] BV: Trimmed 53452 records to 38711 (keeping 200 days of data) [2025-09-17T02:36:28.452242] [DEBUG] [LOCAL ] BV: Primary data saved (38711 records). [2025-09-17T02:36:28.452488] [INFO ] [MAIN ] BV: Full history saved. [2025-09-17T02:36:28.452662] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BV took 27.4s. Estimated remaining: 4h 51m 15s. Rate: 6.9 symbols/min [2025-09-17T02:36:28.700350] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-17T02:36:28.811192] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:28.874725] [DEBUG] [LOCAL ] BWA: Loaded 38799 existing records from primary storage. [2025-09-17T02:36:28.874967] [INFO ] [MAIN ] BWA: Loaded 38799 existing records. [2025-09-17T02:36:29.102220] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:29.103173] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-17T02:36:29.116059] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-17T02:36:29.117574] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T02:36:29.122668] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-17T02:36:29.123345] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-17T02:36:29.278550] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-17T02:36:29.494558] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-17T02:36:29.528846] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:30.025255] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T02:36:30.290140] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-17T02:36:31.044783] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:36:31.090114] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-17T02:36:31.876673] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:36:31.882623] [INFO ] [REMOTE ] BW: Full fetch complete (58426 records). [2025-09-17T02:36:31.882776] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-17T02:36:31.896330] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-11. [2025-09-17T02:36:32.279419] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-17T02:36:32.279533] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-17T02:36:32.280261] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-17T02:36:32.280319] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-17T02:36:32.281731] [DEBUG] [LOCAL ] BW: Trimmed 58426 records to 39416 (keeping 200 days of data) [2025-09-17T02:36:32.512186] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T02:36:32.520689] [INFO ] [REMOTE ] BVN: Full fetch complete (62213 records). [2025-09-17T02:36:32.522298] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-17T02:36:32.716711] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-17T02:36:32.850405] [DEBUG] [LOCAL ] BW: Primary data saved (39416 records). [2025-09-17T02:36:32.852780] [INFO ] [MAIN ] BW: Full history saved. [2025-09-17T02:36:32.853115] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BW took 31.8s. Estimated remaining: 4h 50m 42s. Rate: 6.9 symbols/min [2025-09-17T02:36:33.073988] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-17T02:36:33.089793] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-17T02:36:33.124837] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-17T02:36:33.148308] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:33.148358] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-17T02:36:33.150536] [DEBUG] [LOCAL ] BVN: Trimmed 62213 records to 43450 (keeping 200 days of data) [2025-09-17T02:36:33.249913] [DEBUG] [LOCAL ] BWG: Loaded 9776 existing records from primary storage. [2025-09-17T02:36:33.254702] [INFO ] [MAIN ] BWG: Loaded 9776 existing records. [2025-09-17T02:36:33.451350] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:33.458423] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:36:33.458226] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-17T02:36:33.460443] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-17T02:36:33.461928] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-17T02:36:33.462766] [INFO ] [REMOTE ] BUXX: Full fetch complete (20231 records). [2025-09-17T02:36:33.463633] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-17T02:36:33.464023] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-17T02:36:34.331400] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:34.360978] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-11. [2025-09-17T02:36:34.373524] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-17T02:36:34.386737] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-17T02:36:34.427895] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-17T02:36:34.429054] [DEBUG] [LOCAL ] BVN: Primary data saved (43450 records). [2025-09-17T02:36:34.428927] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-17T02:36:34.432480] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-17T02:36:34.432965] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BVN took 33.3s. Estimated remaining: 4h 49m 54s. Rate: 6.9 symbols/min [2025-09-17T02:36:34.472869] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-11 (2.58 seconds). [2025-09-17T02:36:34.480293] [DEBUG] [LOCAL ] BUXX: Trimmed 20231 records to 15255 (keeping 200 days of data) [2025-09-17T02:36:34.518033] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-17T02:36:34.697537] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:34.698200] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-09-17T02:36:34.698259] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-09-17T02:36:34.698915] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-17T02:36:34.698980] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-17T02:36:34.699538] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-09-17T02:36:34.699590] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-17T02:36:35.071622] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:35.081598] [DEBUG] [LOCAL ] BUXX: Primary data saved (15255 records). [2025-09-17T02:36:35.081724] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-17T02:36:35.081811] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BUXX took 34.0s. Estimated remaining: 4h 49m 1s. Rate: 6.9 symbols/min [2025-09-17T02:36:35.115221] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-11. [2025-09-17T02:36:35.256837] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:36:35.277104] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:35.277221] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-09-17T02:36:35.277281] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-09-17T02:36:35.277420] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-17T02:36:35.277482] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-17T02:36:35.277538] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-17T02:36:35.277587] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-17T02:36:35.653494] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:35.890103] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-11. [2025-09-17T02:36:36.145968] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T02:36:36.390895] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T02:36:36.455440] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T02:36:36.690187] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-17T02:36:37.490191] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-17T02:36:38.291082] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-17T02:36:38.293307] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:36:38.309509] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:36:39.090135] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-17T02:36:39.592550] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T02:36:39.890114] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-17T02:36:40.012301] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:36:40.323717] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T02:36:40.690160] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-17T02:36:41.490165] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-17T02:36:41.900459] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:36:42.271853] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:36:42.290128] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-17T02:36:43.090239] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-17T02:36:43.261306] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T02:36:43.890143] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-17T02:36:44.666587] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T02:36:44.690079] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-17T02:36:44.847949] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T02:36:45.203674] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T02:36:45.490144] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-17T02:36:46.290179] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-17T02:36:46.831152] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T02:36:46.882826] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T02:36:47.090162] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-17T02:36:47.520066] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T02:36:47.890136] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-17T02:36:48.690154] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-17T02:36:48.707173] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T02:36:49.490155] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-17T02:36:50.290502] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-17T02:36:50.291193] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T02:36:50.512653] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:36:51.090196] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-17T02:36:51.779546] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:36:51.890147] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-17T02:36:52.012577] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T02:36:52.690138] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-17T02:36:53.408798] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T02:36:53.490145] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-17T02:36:53.796073] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T02:36:54.290150] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-17T02:36:54.573795] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:36:55.090147] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-17T02:36:55.890121] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-17T02:36:56.123076] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:36:56.322870] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T02:36:56.525577] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:36:56.690141] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-17T02:36:57.215795] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T02:36:57.490158] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-17T02:36:58.290181] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-17T02:36:58.928865] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:36:59.090194] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-17T02:36:59.607675] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T02:36:59.890178] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-17T02:37:00.526964] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T02:37:00.690123] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-17T02:37:01.418870] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T02:37:01.490078] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-17T02:37:01.792971] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T02:37:02.069006] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T02:37:02.290120] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-17T02:37:02.833726] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T02:37:03.090133] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-17T02:37:03.565169] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T02:37:03.566602] [INFO ] [REMOTE ] BWMX: Full fetch complete (9993 records). [2025-09-17T02:37:03.566710] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-17T02:37:03.903379] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-17T02:37:03.947264] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-17T02:37:03.947355] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-17T02:37:03.947669] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-17T02:37:03.947724] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-17T02:37:03.948205] [DEBUG] [LOCAL ] BWMX: Trimmed 9993 records to 7551 (keeping 200 days of data) [2025-09-17T02:37:03.996782] [DEBUG] [LOCAL ] BWMX: Primary data saved (7551 records). [2025-09-17T02:37:03.996944] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-17T02:37:03.997021] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWMX took 28.9s. Estimated remaining: 4h 50m 44s. Rate: 6.9 symbols/min [2025-09-17T02:37:04.169244] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:04.175246] [DEBUG] [LOCAL ] BWNB: Loaded 3471 existing records from primary storage. [2025-09-17T02:37:04.175382] [INFO ] [MAIN ] BWNB: Loaded 3471 existing records. [2025-09-17T02:37:04.358327] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:04.358611] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-17T02:37:04.358727] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-17T02:37:04.359106] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-17T02:37:04.359164] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-17T02:37:04.695157] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-17T02:37:04.732433] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:05.357545] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T02:37:05.360454] [INFO ] [REMOTE ] BWG: Full fetch complete (17447 records). [2025-09-17T02:37:05.360662] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-17T02:37:05.508113] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-11. [2025-09-17T02:37:05.635247] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T02:37:05.761546] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-17T02:37:05.761672] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-17T02:37:05.762108] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-17T02:37:05.762163] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-17T02:37:05.762743] [DEBUG] [LOCAL ] BWG: Trimmed 17447 records to 12291 (keeping 200 days of data) [2025-09-17T02:37:05.834050] [DEBUG] [LOCAL ] BWG: Primary data saved (12291 records). [2025-09-17T02:37:05.834202] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-17T02:37:05.834314] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWG took 33.0s. Estimated remaining: 4h 49m 58s. Rate: 6.9 symbols/min [2025-09-17T02:37:05.938039] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:37:06.007659] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:06.013882] [DEBUG] [LOCAL ] BWSN: Loaded 4093 existing records from primary storage. [2025-09-17T02:37:06.014020] [INFO ] [MAIN ] BWSN: Loaded 4093 existing records. [2025-09-17T02:37:06.189125] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:06.189373] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-17T02:37:06.189433] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-17T02:37:06.189786] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-17T02:37:06.189846] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-17T02:37:06.295228] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-17T02:37:06.545508] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:07.090201] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-17T02:37:07.630264] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T02:37:07.890130] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-17T02:37:08.236930] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:37:08.356519] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T02:37:08.690133] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-11. [2025-09-17T02:37:09.177183] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T02:37:09.490163] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-17T02:37:10.290145] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-17T02:37:10.836881] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:37:10.843342] [INFO ] [REMOTE ] BWA: Full fetch complete (75568 records). [2025-09-17T02:37:10.843544] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-17T02:37:11.100169] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-17T02:37:11.234305] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-17T02:37:11.234409] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-17T02:37:11.235206] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-17T02:37:11.235276] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-17T02:37:11.236759] [DEBUG] [LOCAL ] BWA: Trimmed 75568 records to 52277 (keeping 200 days of data) [2025-09-17T02:37:11.564619] [DEBUG] [LOCAL ] BWA: Primary data saved (52277 records). [2025-09-17T02:37:11.564787] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-17T02:37:11.565783] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWA took 43.1s. Estimated remaining: 4h 49m 33s. Rate: 6.9 symbols/min [2025-09-17T02:37:11.749763] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:11.752805] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T02:37:11.758009] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T02:37:11.762392] [INFO ] [REMOTE ] BWLP: Full fetch complete (48800 records). [2025-09-17T02:37:11.762507] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-17T02:37:11.892265] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-17T02:37:12.068441] [DEBUG] [LOCAL ] BWXT: Loaded 34954 existing records from primary storage. [2025-09-17T02:37:12.089049] [INFO ] [MAIN ] BWXT: Loaded 34954 existing records. [2025-09-17T02:37:12.353897] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-17T02:37:12.354024] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:12.354269] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-17T02:37:12.354325] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-17T02:37:12.355179] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-17T02:37:12.354486] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-17T02:37:12.355332] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-17T02:37:12.356248] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-17T02:37:12.356335] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-17T02:37:12.387057] [DEBUG] [LOCAL ] BWLP: Trimmed 48800 records to 33066 (keeping 200 days of data) [2025-09-17T02:37:12.428307] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T02:37:12.700355] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-17T02:37:12.836997] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:12.932815] [DEBUG] [LOCAL ] BWLP: Primary data saved (33066 records). [2025-09-17T02:37:12.932975] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-17T02:37:12.933062] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWLP took 38.5s. Estimated remaining: 4h 48m 45s. Rate: 6.9 symbols/min [2025-09-17T02:37:13.104801] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:13.146818] [DEBUG] [LOCAL ] BX: Loaded 39866 existing records from primary storage. [2025-09-17T02:37:13.146979] [INFO ] [MAIN ] BX: Loaded 39866 existing records. [2025-09-17T02:37:13.248799] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:37:13.329250] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:13.329529] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-17T02:37:13.329589] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-17T02:37:13.330541] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-17T02:37:13.330601] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-17T02:37:13.502008] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-11. [2025-09-17T02:37:13.688070] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:14.290157] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-17T02:37:14.753501] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:37:15.090107] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-17T02:37:15.307682] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T02:37:15.740508] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T02:37:15.890137] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-17T02:37:16.690148] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-17T02:37:17.132005] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T02:37:17.490095] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-11. [2025-09-17T02:37:17.604191] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T02:37:18.290140] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-17T02:37:18.988201] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:37:19.060317] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T02:37:19.090091] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-17T02:37:19.794420] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T02:37:19.890174] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-17T02:37:20.690192] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-17T02:37:21.490168] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-17T02:37:21.691424] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:37:21.976422] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T02:37:22.290139] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-17T02:37:22.596780] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:37:22.769527] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T02:37:23.090188] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-17T02:37:23.450241] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T02:37:23.451315] [INFO ] [REMOTE ] BWSN: Full fetch complete (6219 records). [2025-09-17T02:37:23.451401] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-17T02:37:23.850430] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-17T02:37:23.850565] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-17T02:37:23.850776] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-17T02:37:23.850832] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-17T02:37:23.851322] [DEBUG] [LOCAL ] BWSN: Trimmed 6219 records to 5150 (keeping 200 days of data) [2025-09-17T02:37:23.883748] [DEBUG] [LOCAL ] BWSN: Primary data saved (5150 records). [2025-09-17T02:37:23.883892] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-17T02:37:23.883987] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWSN took 18.0s. Estimated remaining: 4h 48m 48s. Rate: 6.9 symbols/min [2025-09-17T02:37:23.890092] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-17T02:37:24.056539] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:24.068402] [DEBUG] [LOCAL ] BXC: Loaded 10137 existing records from primary storage. [2025-09-17T02:37:24.068565] [INFO ] [MAIN ] BXC: Loaded 10137 existing records. [2025-09-17T02:37:24.294376] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:24.294744] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-17T02:37:24.294825] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-17T02:37:24.295332] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-17T02:37:24.295415] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-17T02:37:24.661835] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:24.690135] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-17T02:37:24.742789] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T02:37:25.490150] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-11. [2025-09-17T02:37:26.290195] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-17T02:37:26.339397] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T02:37:26.655671] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T02:37:26.869000] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T02:37:27.090136] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-17T02:37:27.890185] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-17T02:37:27.957894] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:37:28.690214] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-17T02:37:29.490167] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-17T02:37:29.757582] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T02:37:30.290140] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-17T02:37:30.350190] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:37:30.379199] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:37:31.090126] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-17T02:37:31.852467] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T02:37:31.890098] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-17T02:37:32.285573] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:37:32.690149] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-17T02:37:33.490138] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-17T02:37:33.508008] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T02:37:33.536581] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:37:34.290184] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-17T02:37:35.090148] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-17T02:37:35.694877] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T02:37:35.890114] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-17T02:37:35.984930] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:37:36.002980] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T02:37:36.690139] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-17T02:37:37.490091] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-17T02:37:37.601121] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T02:37:37.623748] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T02:37:37.881886] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T02:37:38.290193] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-17T02:37:39.090183] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-17T02:37:39.150228] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T02:37:39.560752] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T02:37:39.890228] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-17T02:37:40.690163] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-17T02:37:40.814766] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T02:37:41.490155] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-17T02:37:42.290190] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-17T02:37:42.457894] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T02:37:42.569789] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:37:42.641146] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-17T02:37:43.090154] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-17T02:37:43.661083] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T02:37:43.662238] [INFO ] [REMOTE ] BWNB: Full fetch complete (5687 records). [2025-09-17T02:37:43.662324] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-17T02:37:43.895288] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-17T02:37:44.035224] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-17T02:37:44.035325] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-17T02:37:44.035508] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-17T02:37:44.035565] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-17T02:37:44.036020] [DEBUG] [LOCAL ] BWNB: Trimmed 5687 records to 4520 (keeping 200 days of data) [2025-09-17T02:37:44.064128] [DEBUG] [LOCAL ] BWNB: Primary data saved (4520 records). [2025-09-17T02:37:44.064247] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-17T02:37:44.064333] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWNB took 40.1s. Estimated remaining: 4h 49m 42s. Rate: 6.9 symbols/min [2025-09-17T02:37:44.233128] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:44.269729] [DEBUG] [LOCAL ] BXMT: Loaded 34285 existing records from primary storage. [2025-09-17T02:37:44.269929] [INFO ] [MAIN ] BXMT: Loaded 34285 existing records. [2025-09-17T02:37:44.446770] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:44.447021] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-17T02:37:44.447079] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-17T02:37:44.447886] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-17T02:37:44.447947] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-17T02:37:44.699258] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-17T02:37:44.807914] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:44.949930] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:37:45.490146] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-17T02:37:46.290160] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-17T02:37:46.309290] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T02:37:46.311108] [INFO ] [REMOTE ] BXC: Full fetch complete (17376 records). [2025-09-17T02:37:46.311193] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-17T02:37:46.688514] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-17T02:37:46.688698] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-17T02:37:46.689075] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-17T02:37:46.689196] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-17T02:37:46.689927] [DEBUG] [LOCAL ] BXC: Trimmed 17376 records to 13555 (keeping 200 days of data) [2025-09-17T02:37:46.795685] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T02:37:46.816551] [DEBUG] [LOCAL ] BXC: Primary data saved (13555 records). [2025-09-17T02:37:46.816704] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-17T02:37:46.816792] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BXC took 22.9s. Estimated remaining: 4h 49m 1s. Rate: 6.9 symbols/min [2025-09-17T02:37:46.985245] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:46.999708] [DEBUG] [LOCAL ] BXMX: Loaded 13505 existing records from primary storage. [2025-09-17T02:37:46.999845] [INFO ] [MAIN ] BXMX: Loaded 13505 existing records. [2025-09-17T02:37:47.097682] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-11. [2025-09-17T02:37:47.179431] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:47.179707] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-17T02:37:47.179768] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-17T02:37:47.180294] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-17T02:37:47.180354] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-17T02:37:47.568929] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:47.890148] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-11. [2025-09-17T02:37:48.071852] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T02:37:48.690108] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-17T02:37:48.745012] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:37:48.937359] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T02:37:49.490167] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-17T02:37:50.290183] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-17T02:37:50.557888] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:37:50.580868] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:37:51.090143] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-17T02:37:51.890129] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-17T02:37:51.972562] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T02:37:52.598093] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T02:37:52.690145] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-17T02:37:52.973200] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:37:53.490151] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-17T02:37:53.748755] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:37:54.290146] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-17T02:37:55.090199] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-17T02:37:55.243372] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:37:55.250437] [INFO ] [REMOTE ] BX: Full fetch complete (77261 records). [2025-09-17T02:37:55.250693] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-17T02:37:55.664222] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-17T02:37:55.667049] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:37:55.667113] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-17T02:37:55.673142] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-17T02:37:55.673559] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-17T02:37:55.676798] [DEBUG] [LOCAL ] BX: Trimmed 77261 records to 53502 (keeping 200 days of data) [2025-09-17T02:37:55.897954] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-17T02:37:56.017752] [DEBUG] [LOCAL ] BX: Primary data saved (53502 records). [2025-09-17T02:37:56.017909] [INFO ] [MAIN ] BX: Full history saved. [2025-09-17T02:37:56.018008] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BX took 43.1s. Estimated remaining: 4h 48m 55s. Rate: 6.9 symbols/min [2025-09-17T02:37:56.194048] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:56.233750] [DEBUG] [LOCAL ] BXP: Loaded 36936 existing records from primary storage. [2025-09-17T02:37:56.233952] [INFO ] [MAIN ] BXP: Loaded 36936 existing records. [2025-09-17T02:37:56.411796] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:56.412050] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-17T02:37:56.412108] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-17T02:37:56.412975] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-17T02:37:56.413040] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-17T02:37:56.695200] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-17T02:37:56.813314] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:56.933473] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:37:57.385559] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:37:57.490094] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-17T02:37:57.881677] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T02:37:58.290136] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-17T02:37:59.017049] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T02:37:59.090160] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-17T02:37:59.890156] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-17T02:38:00.288056] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T02:38:00.690110] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-17T02:38:00.815683] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T02:38:00.950775] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T02:38:01.490135] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-17T02:38:02.186570] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:38:02.193352] [INFO ] [REMOTE ] BWXT: Full fetch complete (66713 records). [2025-09-17T02:38:02.193540] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-17T02:38:02.290173] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-17T02:38:02.606424] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-17T02:38:02.606538] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-17T02:38:02.607266] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-17T02:38:02.607327] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-17T02:38:02.608750] [DEBUG] [LOCAL ] BWXT: Trimmed 66713 records to 46628 (keeping 200 days of data) [2025-09-17T02:38:02.928022] [DEBUG] [LOCAL ] BWXT: Primary data saved (46628 records). [2025-09-17T02:38:02.928311] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-17T02:38:02.929072] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BWXT took 51.4s. Estimated remaining: 4h 48m 37s. Rate: 6.9 symbols/min [2025-09-17T02:38:03.109600] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-11. [2025-09-17T02:38:03.112995] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:03.157675] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:38:03.185791] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T02:38:03.231771] [DEBUG] [LOCAL ] BXSL: Loaded 34756 existing records from primary storage. [2025-09-17T02:38:03.232023] [INFO ] [MAIN ] BXSL: Loaded 34756 existing records. [2025-09-17T02:38:03.425761] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:03.426144] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-17T02:38:03.426221] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-17T02:38:03.427226] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-17T02:38:03.427302] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-17T02:38:03.807184] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:03.890141] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-17T02:38:04.638091] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T02:38:04.690117] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-11. [2025-09-17T02:38:04.816434] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:38:05.490130] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-17T02:38:06.290119] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-17T02:38:06.366520] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T02:38:06.834939] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:38:07.090143] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-17T02:38:07.624570] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:38:07.686589] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T02:38:07.890116] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-17T02:38:08.690152] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-17T02:38:09.141098] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:38:09.490204] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-17T02:38:10.290183] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-17T02:38:10.337539] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T02:38:11.090116] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-17T02:38:11.121580] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:38:11.701503] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T02:38:11.703982] [INFO ] [REMOTE ] BXMX: Full fetch complete (28484 records). [2025-09-17T02:38:11.704144] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-17T02:38:11.893341] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-17T02:38:12.087309] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-17T02:38:12.087429] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-17T02:38:12.088091] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-17T02:38:12.088189] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-17T02:38:12.089272] [DEBUG] [LOCAL ] BXMX: Trimmed 28484 records to 19672 (keeping 200 days of data) [2025-09-17T02:38:12.117073] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:38:12.246038] [DEBUG] [LOCAL ] BXMX: Primary data saved (19672 records). [2025-09-17T02:38:12.246201] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-17T02:38:12.246311] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMX took 25.4s. Estimated remaining: 4h 48m 32s. Rate: 6.9 symbols/min [2025-09-17T02:38:12.413972] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:12.414159] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-09-17T02:38:12.414208] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-09-17T02:38:12.414312] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-17T02:38:12.414364] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-17T02:38:12.414415] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-09-17T02:38:12.414457] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-17T02:38:12.695321] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-17T02:38:12.772198] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:13.490201] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-11. [2025-09-17T02:38:13.712294] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T02:38:14.065478] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:38:14.163415] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T02:38:14.290167] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-17T02:38:14.956813] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T02:38:15.090145] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-17T02:38:15.890148] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-17T02:38:16.690184] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-17T02:38:16.894493] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T02:38:17.109038] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:38:17.490170] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-17T02:38:17.716299] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T02:38:18.290150] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-17T02:38:18.664343] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:38:19.090211] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-17T02:38:19.890169] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-17T02:38:19.975819] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:38:20.690143] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-17T02:38:20.740808] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:38:20.801098] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:38:21.490163] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-17T02:38:22.290271] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-17T02:38:22.313156] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:38:22.318987] [INFO ] [REMOTE ] BXMT: Full fetch complete (69179 records). [2025-09-17T02:38:22.319200] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-17T02:38:22.723509] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-17T02:38:22.723628] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-17T02:38:22.724618] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-17T02:38:22.724711] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-17T02:38:22.726187] [DEBUG] [LOCAL ] BXMT: Trimmed 69179 records to 47249 (keeping 200 days of data) [2025-09-17T02:38:23.027027] [DEBUG] [LOCAL ] BXMT: Primary data saved (47249 records). [2025-09-17T02:38:23.027287] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-17T02:38:23.027420] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXMT took 39.0s. Estimated remaining: 4h 48m 34s. Rate: 6.9 symbols/min [2025-09-17T02:38:23.091030] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-17T02:38:23.204498] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:23.218943] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T02:38:23.253172] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T02:38:23.290839] [DEBUG] [LOCAL ] BYD: Loaded 33670 existing records from primary storage. [2025-09-17T02:38:23.291028] [INFO ] [MAIN ] BYD: Loaded 33670 existing records. [2025-09-17T02:38:23.475593] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:23.475901] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-17T02:38:23.475973] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-17T02:38:23.476911] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-17T02:38:23.476977] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-17T02:38:23.832243] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:23.890156] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-17T02:38:24.690120] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-11. [2025-09-17T02:38:24.792695] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:38:25.071956] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T02:38:25.490122] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-17T02:38:26.291176] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-17T02:38:26.296999] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:38:27.091463] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-17T02:38:27.100530] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T02:38:27.890124] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-17T02:38:28.008263] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T02:38:28.361790] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T02:38:28.690143] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-17T02:38:29.126462] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:38:29.490190] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-17T02:38:30.243818] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:38:30.290104] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-17T02:38:30.462763] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:38:31.090179] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-17T02:38:31.511462] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T02:38:31.890155] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-17T02:38:31.891926] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T02:38:32.690172] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-17T02:38:33.269774] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:38:33.490133] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-17T02:38:34.290176] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-17T02:38:34.465556] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:38:34.822856] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:38:34.829397] [INFO ] [REMOTE ] BXSL: Full fetch complete (68866 records). [2025-09-17T02:38:34.829629] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-17T02:38:35.095421] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-17T02:38:35.234832] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-17T02:38:35.234946] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-17T02:38:35.235765] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-17T02:38:35.235831] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-17T02:38:35.237252] [DEBUG] [LOCAL ] BXSL: Trimmed 68866 records to 47311 (keeping 200 days of data) [2025-09-17T02:38:35.531724] [DEBUG] [LOCAL ] BXSL: Primary data saved (47311 records). [2025-09-17T02:38:35.531910] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-17T02:38:35.533255] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXSL took 32.6s. Estimated remaining: 4h 48m 46s. Rate: 6.9 symbols/min [2025-09-17T02:38:35.709988] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:35.722031] [DEBUG] [LOCAL ] BYM: Loaded 8475 existing records from primary storage. [2025-09-17T02:38:35.722196] [INFO ] [MAIN ] BYM: Loaded 8475 existing records. [2025-09-17T02:38:35.910292] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-17T02:38:35.944926] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:35.947464] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:38:35.958419] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-17T02:38:35.958539] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-17T02:38:35.959012] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-17T02:38:35.959098] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-17T02:38:36.328009] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:36.690135] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-17T02:38:36.887069] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:38:37.104278] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:38:37.490137] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-17T02:38:38.019743] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:38:38.290147] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-17T02:38:39.090172] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-17T02:38:39.153417] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T02:38:39.310378] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T02:38:39.890177] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-11. [2025-09-17T02:38:40.678295] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T02:38:40.694698] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-17T02:38:40.695905] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T02:38:41.490157] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-17T02:38:42.095867] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T02:38:42.118489] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:38:42.123564] [INFO ] [REMOTE ] BY: Full fetch complete (28658 records). [2025-09-17T02:38:42.123869] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-17T02:38:42.290285] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-17T02:38:42.531374] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-17T02:38:42.531479] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-17T02:38:42.531926] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-17T02:38:42.531980] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-17T02:38:42.532706] [DEBUG] [LOCAL ] BY: Trimmed 28658 records to 21379 (keeping 200 days of data) [2025-09-17T02:38:42.664385] [DEBUG] [LOCAL ] BY: Primary data saved (21379 records). [2025-09-17T02:38:42.664537] [INFO ] [MAIN ] BY: Full history saved. [2025-09-17T02:38:42.664656] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 30.4s. Estimated remaining: 4h 48m 29s. Rate: 6.9 symbols/min [2025-09-17T02:38:42.870794] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:42.895231] [DEBUG] [LOCAL ] BZH: Loaded 24301 existing records from primary storage. [2025-09-17T02:38:42.895387] [INFO ] [MAIN ] BZH: Loaded 24301 existing records. [2025-09-17T02:38:43.075192] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:43.075459] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-17T02:38:43.075519] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-17T02:38:43.076203] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-17T02:38:43.076264] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-17T02:38:43.096284] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-17T02:38:43.431675] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:43.873349] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T02:38:43.879734] [INFO ] [REMOTE ] BXP: Full fetch complete (70975 records). [2025-09-17T02:38:43.879903] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-17T02:38:43.895309] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-11. [2025-09-17T02:38:44.277259] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T02:38:44.277393] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-17T02:38:44.281320] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-17T02:38:44.282224] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-17T02:38:44.282286] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-17T02:38:44.283795] [DEBUG] [LOCAL ] BXP: Trimmed 70975 records to 49916 (keeping 200 days of data) [2025-09-17T02:38:44.598837] [DEBUG] [LOCAL ] BXP: Primary data saved (49916 records). [2025-09-17T02:38:44.599005] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-17T02:38:44.599101] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BXP took 48.6s. Estimated remaining: 4h 47m 45s. Rate: 6.9 symbols/min [2025-09-17T02:38:44.695365] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-17T02:38:44.769210] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:44.769392] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-09-17T02:38:44.769440] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-09-17T02:38:44.769551] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-17T02:38:44.769595] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-17T02:38:44.769662] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-09-17T02:38:44.769707] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-17T02:38:45.121470] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:45.140124] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:38:45.490141] [INFO ] [REMOTE ] C: Fetching primary data for 2024-11. [2025-09-17T02:38:46.290142] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-17T02:38:46.430518] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T02:38:46.953237] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:38:47.090124] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-17T02:38:47.240553] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:38:47.850942] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T02:38:47.890190] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-17T02:38:48.690262] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-17T02:38:49.375289] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T02:38:49.473127] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T02:38:49.490076] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-17T02:38:50.290132] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-17T02:38:50.861735] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T02:38:50.867323] [INFO ] [REMOTE ] BYD: Full fetch complete (64811 records). [2025-09-17T02:38:50.867511] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-17T02:38:51.095236] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-17T02:38:51.259190] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-17T02:38:51.259297] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-17T02:38:51.260065] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-17T02:38:51.260167] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-17T02:38:51.261550] [DEBUG] [LOCAL ] BYD: Trimmed 64811 records to 45406 (keeping 200 days of data) [2025-09-17T02:38:51.552686] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:38:51.565782] [DEBUG] [LOCAL ] BYD: Primary data saved (45406 records). [2025-09-17T02:38:51.565890] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-17T02:38:51.565999] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYD took 28.5s. Estimated remaining: 4h 47m 27s. Rate: 6.9 symbols/min [2025-09-17T02:38:51.740124] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:51.753919] [DEBUG] [LOCAL ] CAAP: Loaded 13352 existing records from primary storage. [2025-09-17T02:38:51.754101] [INFO ] [MAIN ] CAAP: Loaded 13352 existing records. [2025-09-17T02:38:51.895406] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-17T02:38:51.935186] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:51.935366] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-17T02:38:51.935449] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-17T02:38:51.936000] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-17T02:38:51.936078] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-17T02:38:52.301041] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:52.301966] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T02:38:52.690085] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-17T02:38:53.039854] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T02:38:53.490115] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-17T02:38:53.593214] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T02:38:54.290169] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-17T02:38:54.474954] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T02:38:55.096124] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-11. [2025-09-17T02:38:55.097891] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T02:38:55.890120] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-17T02:38:56.187767] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:38:56.690151] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-17T02:38:57.338012] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:38:57.490128] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-17T02:38:58.290103] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-17T02:38:58.391057] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:38:58.743353] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T02:38:59.090127] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-17T02:38:59.331697] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T02:38:59.849844] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T02:38:59.890083] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-17T02:39:00.690140] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-17T02:39:00.736571] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T02:39:00.738757] [INFO ] [REMOTE ] BYM: Full fetch complete (17968 records). [2025-09-17T02:39:00.738843] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-17T02:39:01.103999] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-17T02:39:01.104102] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-17T02:39:01.104423] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-17T02:39:01.104476] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-17T02:39:01.105119] [DEBUG] [LOCAL ] BYM: Trimmed 17968 records to 12284 (keeping 200 days of data) [2025-09-17T02:39:01.194892] [DEBUG] [LOCAL ] BYM: Primary data saved (12284 records). [2025-09-17T02:39:01.195074] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-17T02:39:01.195168] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BYM took 25.7s. Estimated remaining: 4h 47m 23s. Rate: 6.9 symbols/min [2025-09-17T02:39:01.373279] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:01.373499] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-09-17T02:39:01.373549] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-09-17T02:39:01.373672] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-17T02:39:01.373722] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-17T02:39:01.373771] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-17T02:39:01.373811] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-17T02:39:01.495243] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-17T02:39:01.732319] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:02.290143] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-11. [2025-09-17T02:39:02.441596] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:39:03.090128] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-17T02:39:03.890120] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-17T02:39:04.175835] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-17T02:39:04.690131] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-17T02:39:04.704791] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-17T02:39:05.457320] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:39:05.493429] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-17T02:39:05.498319] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T02:39:05.685120] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-17T02:39:06.290208] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-17T02:39:06.702753] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:39:07.090182] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-17T02:39:07.192932] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:39:07.890197] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-17T02:39:08.448948] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T02:39:08.690181] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-17T02:39:09.490099] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-17T02:39:09.691065] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T02:39:09.992507] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T02:39:10.290147] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-17T02:39:10.680937] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:39:10.685345] [INFO ] [REMOTE ] BZH: Full fetch complete (46846 records). [2025-09-17T02:39:10.685456] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-17T02:39:11.013323] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T02:39:11.093525] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-17T02:39:11.094904] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-17T02:39:11.094993] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-17T02:39:11.095844] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-17T02:39:11.095926] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-17T02:39:11.098012] [DEBUG] [LOCAL ] BZH: Trimmed 46846 records to 32935 (keeping 200 days of data) [2025-09-17T02:39:11.296636] [DEBUG] [LOCAL ] BZH: Primary data saved (32935 records). [2025-09-17T02:39:11.296845] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-17T02:39:11.296951] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. BZH took 28.6s. Estimated remaining: 4h 47m 22s. Rate: 6.9 symbols/min [2025-09-17T02:39:11.465888] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:11.466080] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-09-17T02:39:11.466122] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-09-17T02:39:11.466228] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-17T02:39:11.466279] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-17T02:39:11.466329] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-17T02:39:11.466372] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-17T02:39:11.823653] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:11.890135] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-17T02:39:12.690215] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-17T02:39:13.058997] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T02:39:13.272278] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T02:39:13.329978] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T02:39:13.490130] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-17T02:39:14.290115] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-17T02:39:14.608240] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:39:15.090176] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-17T02:39:15.890173] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-17T02:39:16.522601] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T02:39:16.649013] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T02:39:16.690088] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-17T02:39:17.288844] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T02:39:17.490136] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-17T02:39:18.290203] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-17T02:39:18.461233] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T02:39:18.724860] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T02:39:18.954341] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T02:39:19.090182] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-17T02:39:19.890223] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-17T02:39:20.690147] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-11. [2025-09-17T02:39:21.069082] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:39:21.153977] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T02:39:21.490199] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-17T02:39:21.907181] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T02:39:22.102506] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T02:39:22.290147] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-17T02:39:22.972469] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:39:23.090144] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-17T02:39:23.890177] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-17T02:39:24.690279] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-17T02:39:25.065455] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T02:39:25.439744] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-17T02:39:25.478871] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:39:25.490089] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-17T02:39:26.181375] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T02:39:26.184742] [INFO ] [REMOTE ] CAAP: Full fetch complete (27241 records). [2025-09-17T02:39:26.184862] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-17T02:39:26.293429] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-17T02:39:26.580988] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-17T02:39:26.581091] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-17T02:39:26.581494] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-17T02:39:26.581572] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-17T02:39:26.582371] [DEBUG] [LOCAL ] CAAP: Trimmed 27241 records to 18993 (keeping 200 days of data) [2025-09-17T02:39:26.703449] [DEBUG] [LOCAL ] CAAP: Primary data saved (18993 records). [2025-09-17T02:39:26.703614] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-17T02:39:26.703774] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. CAAP took 35.1s. Estimated remaining: 4h 47m 49s. Rate: 6.9 symbols/min [2025-09-17T02:39:26.875483] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:26.910473] [DEBUG] [LOCAL ] CADE: Loaded 36711 existing records from primary storage. [2025-09-17T02:39:26.910684] [INFO ] [MAIN ] CADE: Loaded 36711 existing records. [2025-09-17T02:39:27.094482] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:27.090633] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-17T02:39:27.095510] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-17T02:39:27.095588] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-17T02:39:27.096773] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-17T02:39:27.096852] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-17T02:39:27.473383] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:27.890100] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-17T02:39:28.432766] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T02:39:28.618178] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:39:28.690138] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-17T02:39:28.888186] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:39:29.490170] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-17T02:39:30.160814] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:39:30.290133] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-11. [2025-09-17T02:39:31.090192] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-17T02:39:31.412744] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T02:39:31.419326] [INFO ] [REMOTE ] C: Full fetch complete (77676 records). [2025-09-17T02:39:31.419468] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-17T02:39:31.822620] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-17T02:39:31.822832] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-17T02:39:31.824036] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-17T02:39:31.824259] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-17T02:39:31.826112] [DEBUG] [LOCAL ] C: Trimmed 77676 records to 53741 (keeping 200 days of data) [2025-09-17T02:39:31.894483] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-17T02:39:31.949801] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:39:32.219934] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-17T02:39:32.220103] [INFO ] [MAIN ] C: Full history saved. [2025-09-17T02:39:32.220191] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. C took 47.6s. Estimated remaining: 4h 47m 23s. Rate: 6.9 symbols/min [2025-09-17T02:39:32.393324] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:32.420822] [DEBUG] [LOCAL ] CAE: Loaded 28505 existing records from primary storage. [2025-09-17T02:39:32.420997] [INFO ] [MAIN ] CAE: Loaded 28505 existing records. [2025-09-17T02:39:32.616184] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:32.616599] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-17T02:39:32.616715] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-17T02:39:32.617519] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-17T02:39:32.617595] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-17T02:39:32.694191] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-17T02:39:32.822015] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T02:39:33.061543] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:33.072289] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:39:33.490188] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-11. [2025-09-17T02:39:34.290167] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-17T02:39:34.422455] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:39:35.032118] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:39:35.090084] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-17T02:39:35.822393] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:39:35.890155] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-17T02:39:36.302954] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:39:36.690173] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-17T02:39:36.800628] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:39:37.490160] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-17T02:39:38.290112] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-17T02:39:38.329225] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:39:38.331410] [INFO ] [REMOTE ] CABO: Full fetch complete (22870 records). [2025-09-17T02:39:38.331513] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-17T02:39:38.693277] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T02:39:38.791928] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-17T02:39:38.792041] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-17T02:39:38.792451] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-17T02:39:38.792505] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-17T02:39:38.793218] [DEBUG] [LOCAL ] CABO: Trimmed 22870 records to 17848 (keeping 200 days of data) [2025-09-17T02:39:38.913937] [DEBUG] [LOCAL ] CABO: Primary data saved (17848 records). [2025-09-17T02:39:38.914125] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-17T02:39:38.914216] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CABO took 37.7s. Estimated remaining: 4h 47m 5s. Rate: 6.9 symbols/min [2025-09-17T02:39:39.087037] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:39.091319] [DEBUG] [LOCAL ] CAF: Loaded 2322 existing records from primary storage. [2025-09-17T02:39:39.091417] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-17T02:39:39.091774] [INFO ] [MAIN ] CAF: Loaded 2322 existing records. [2025-09-17T02:39:39.271189] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:39.271459] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-17T02:39:39.271524] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-17T02:39:39.271753] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-17T02:39:39.271810] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-17T02:39:39.630820] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:39.652422] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T02:39:39.890152] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-11. [2025-09-17T02:39:40.240546] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:39:40.526261] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T02:39:40.690150] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-17T02:39:41.490165] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-17T02:39:42.168801] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T02:39:42.290126] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-17T02:39:42.720021] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:39:43.090102] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-17T02:39:43.658816] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T02:39:43.739318] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T02:39:43.890088] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-17T02:39:44.337274] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:39:44.690132] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-17T02:39:45.490167] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-17T02:39:46.257919] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:39:46.290131] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-17T02:39:46.972948] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:39:47.090120] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-17T02:39:47.466231] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T02:39:47.890161] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-17T02:39:47.933372] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:39:48.690182] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-17T02:39:49.111853] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T02:39:49.490116] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-17T02:39:50.290216] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-17T02:39:50.431162] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:39:50.954931] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:39:51.077989] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:39:51.090089] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-17T02:39:51.890141] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-17T02:39:52.005446] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:39:52.008176] [INFO ] [REMOTE ] CACI: Full fetch complete (39251 records). [2025-09-17T02:39:52.008289] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-17T02:39:52.344455] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:39:52.449280] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-17T02:39:52.449381] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-17T02:39:52.449890] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-17T02:39:52.449947] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-17T02:39:52.450856] [DEBUG] [LOCAL ] CACI: Trimmed 39251 records to 26198 (keeping 200 days of data) [2025-09-17T02:39:52.609749] [DEBUG] [LOCAL ] CACI: Primary data saved (26198 records). [2025-09-17T02:39:52.609908] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-17T02:39:52.609999] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CACI took 41.3s. Estimated remaining: 4h 47m 22s. Rate: 6.9 symbols/min [2025-09-17T02:39:52.695260] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-17T02:39:52.788580] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:52.828205] [DEBUG] [LOCAL ] CAG: Loaded 40018 existing records from primary storage. [2025-09-17T02:39:52.828392] [INFO ] [MAIN ] CAG: Loaded 40018 existing records. [2025-09-17T02:39:53.015343] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:53.015618] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-17T02:39:53.015701] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-17T02:39:53.016728] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-17T02:39:53.016786] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-17T02:39:53.391699] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:53.490147] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-17T02:39:54.068325] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T02:39:54.290314] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-11. [2025-09-17T02:39:54.293506] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T02:39:55.090129] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-17T02:39:55.890164] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-17T02:39:56.083661] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:39:56.496748] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T02:39:56.690134] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-17T02:39:56.763490] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:39:57.490128] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-17T02:39:58.290116] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-17T02:39:58.331490] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T02:39:58.698802] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T02:39:59.090144] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-17T02:39:59.856449] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:39:59.890092] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-17T02:40:00.642034] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:40:00.690123] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-17T02:40:00.807332] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:40:00.811927] [INFO ] [REMOTE ] CAE: Full fetch complete (55498 records). [2025-09-17T02:40:00.812068] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-17T02:40:01.227123] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-17T02:40:01.227261] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-17T02:40:01.228007] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-17T02:40:01.228078] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-17T02:40:01.229710] [DEBUG] [LOCAL ] CAE: Trimmed 55498 records to 38936 (keeping 200 days of data) [2025-09-17T02:40:01.466041] [DEBUG] [LOCAL ] CAE: Primary data saved (38936 records). [2025-09-17T02:40:01.466216] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-17T02:40:01.466314] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CAE took 29.2s. Estimated remaining: 4h 47m 14s. Rate: 6.9 symbols/min [2025-09-17T02:40:01.490706] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-17T02:40:01.650758] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:01.689819] [DEBUG] [LOCAL ] CAH: Loaded 38301 existing records from primary storage. [2025-09-17T02:40:01.690001] [INFO ] [MAIN ] CAH: Loaded 38301 existing records. [2025-09-17T02:40:01.876948] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:01.877262] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-17T02:40:01.877353] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-17T02:40:01.878441] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-17T02:40:01.878516] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-17T02:40:02.160794] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T02:40:02.277880] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:02.290089] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-11. [2025-09-17T02:40:02.514852] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T02:40:03.090136] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-17T02:40:03.591983] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T02:40:03.890131] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-17T02:40:04.133736] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T02:40:04.690147] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-17T02:40:05.201155] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T02:40:05.490124] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-17T02:40:05.605501] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:40:05.858848] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:40:05.859913] [INFO ] [REMOTE ] CAF: Full fetch complete (5904 records). [2025-09-17T02:40:05.859994] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-17T02:40:06.288772] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-17T02:40:06.288899] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-17T02:40:06.289136] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-17T02:40:06.289191] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-17T02:40:06.289845] [DEBUG] [LOCAL ] CAF: Trimmed 5904 records to 3394 (keeping 200 days of data) [2025-09-17T02:40:06.290257] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-17T02:40:06.317151] [DEBUG] [LOCAL ] CAF: Primary data saved (3394 records). [2025-09-17T02:40:06.317357] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-17T02:40:06.317478] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAF took 27.4s. Estimated remaining: 4h 46m 46s. Rate: 6.9 symbols/min [2025-09-17T02:40:06.489434] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:06.524267] [DEBUG] [LOCAL ] CAL: Loaded 31697 existing records from primary storage. [2025-09-17T02:40:06.524446] [INFO ] [MAIN ] CAL: Loaded 31697 existing records. [2025-09-17T02:40:06.703591] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:06.703865] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-17T02:40:06.703917] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-17T02:40:06.704800] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-17T02:40:06.704868] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-17T02:40:07.069600] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:07.090119] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-17T02:40:07.890113] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-11. [2025-09-17T02:40:08.065297] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:40:08.690171] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-17T02:40:08.811282] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:40:09.206090] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T02:40:09.490173] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-17T02:40:10.290159] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-17T02:40:10.497802] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:40:11.066109] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:40:11.090092] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-17T02:40:11.595436] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T02:40:11.601780] [INFO ] [REMOTE ] CADE: Full fetch complete (69399 records). [2025-09-17T02:40:11.601976] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-17T02:40:11.898766] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-17T02:40:12.006352] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-17T02:40:12.006476] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-17T02:40:12.007260] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-17T02:40:12.007324] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-17T02:40:12.008906] [DEBUG] [LOCAL ] CADE: Trimmed 69399 records to 48730 (keeping 200 days of data) [2025-09-17T02:40:12.265037] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T02:40:12.351611] [DEBUG] [LOCAL ] CADE: Primary data saved (48730 records). [2025-09-17T02:40:12.351804] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-17T02:40:12.351933] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CADE took 45.6s. Estimated remaining: 4h 46m 23s. Rate: 6.9 symbols/min [2025-09-17T02:40:12.522697] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:12.551850] [DEBUG] [LOCAL ] CALX: Loaded 28624 existing records from primary storage. [2025-09-17T02:40:12.552024] [INFO ] [MAIN ] CALX: Loaded 28624 existing records. [2025-09-17T02:40:12.695283] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-17T02:40:12.731873] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:12.732099] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-17T02:40:12.732158] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-17T02:40:12.732880] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-17T02:40:12.732940] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-17T02:40:13.102409] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:13.490160] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-11. [2025-09-17T02:40:13.741605] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T02:40:14.290281] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-17T02:40:14.346318] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T02:40:15.005858] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:40:15.090104] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-17T02:40:15.890132] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-17T02:40:15.986965] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T02:40:16.494254] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T02:40:16.690189] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-17T02:40:17.490163] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-17T02:40:17.584677] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:40:18.290140] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-17T02:40:18.605532] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:40:18.905561] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:40:19.090231] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-17T02:40:19.895278] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-17T02:40:19.909026] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T02:40:20.690161] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-17T02:40:20.967988] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T02:40:21.445802] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T02:40:21.490095] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-17T02:40:22.125016] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:40:22.290135] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-17T02:40:23.090171] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-17T02:40:23.218404] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:40:23.890129] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-17T02:40:24.213392] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:40:24.282974] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:40:24.690150] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-17T02:40:25.490177] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-17T02:40:25.635241] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:40:26.290150] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-17T02:40:26.551065] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T02:40:26.629711] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T02:40:27.090143] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-17T02:40:27.877364] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:40:27.890078] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-17T02:40:28.407010] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T02:40:28.690113] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-17T02:40:29.357936] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:40:29.490106] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-17T02:40:30.257405] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:40:30.290101] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-17T02:40:31.025407] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:40:31.090099] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-17T02:40:31.802349] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:40:31.890148] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-17T02:40:32.690744] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T02:40:32.690818] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-17T02:40:32.823566] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:40:33.490196] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-17T02:40:34.296597] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-17T02:40:34.325576] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T02:40:35.090167] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-17T02:40:35.314445] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T02:40:35.818051] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T02:40:35.823937] [INFO ] [REMOTE ] CAL: Full fetch complete (61608 records). [2025-09-17T02:40:35.824093] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-17T02:40:35.895269] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-17T02:40:36.241150] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-17T02:40:36.241277] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-17T02:40:36.241979] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-17T02:40:36.242069] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-17T02:40:36.243521] [DEBUG] [LOCAL ] CAL: Trimmed 61608 records to 43386 (keeping 200 days of data) [2025-09-17T02:40:36.393051] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:40:36.401140] [INFO ] [REMOTE ] CAG: Full fetch complete (77491 records). [2025-09-17T02:40:36.402340] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-17T02:40:36.696166] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-17T02:40:36.917886] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-17T02:40:36.917995] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-17T02:40:36.918853] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-17T02:40:36.919290] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-17T02:40:36.922835] [DEBUG] [LOCAL ] CAG: Trimmed 77491 records to 53658 (keeping 200 days of data) [2025-09-17T02:40:37.290862] [DEBUG] [LOCAL ] CAL: Primary data saved (43386 records). [2025-09-17T02:40:37.295420] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-17T02:40:37.297118] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CAL took 31.0s. Estimated remaining: 4h 47m 37s. Rate: 6.9 symbols/min [2025-09-17T02:40:37.483007] [DEBUG] [LOCAL ] CAG: Primary data saved (53658 records). [2025-09-17T02:40:37.484439] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:37.484615] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-17T02:40:37.485120] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAG took 44.9s. Estimated remaining: 4h 46m 45s. Rate: 6.9 symbols/min [2025-09-17T02:40:37.661506] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:37.669161] [DEBUG] [LOCAL ] CANG: Loaded 20458 existing records from primary storage. [2025-09-17T02:40:37.669708] [INFO ] [MAIN ] CANG: Loaded 20458 existing records. [2025-09-17T02:40:37.774713] [DEBUG] [LOCAL ] CAPL: Loaded 3928 existing records from primary storage. [2025-09-17T02:40:37.868693] [INFO ] [MAIN ] CAPL: Loaded 3928 existing records. [2025-09-17T02:40:37.873968] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T02:40:37.874170] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:37.917199] [INFO ] [REMOTE ] CAH: Full fetch complete (74434 records). [2025-09-17T02:40:37.911919] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-17T02:40:37.961750] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-17T02:40:37.961828] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-17T02:40:37.988897] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-17T02:40:38.034671] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-17T02:40:38.130526] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:38.224216] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-17T02:40:38.281605] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-17T02:40:38.339003] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-17T02:40:38.339290] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-17T02:40:39.160323] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:39.170354] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-17T02:40:39.222601] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-17T02:40:39.225465] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:39.226882] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-17T02:40:39.225765] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-11. [2025-09-17T02:40:39.227591] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-11. [2025-09-17T02:40:39.229019] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-17T02:40:39.239142] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-17T02:40:39.240507] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-17T02:40:39.243794] [DEBUG] [LOCAL ] CAH: Trimmed 74434 records to 51555 (keeping 200 days of data) [2025-09-17T02:40:39.575737] [DEBUG] [LOCAL ] CAH: Primary data saved (51555 records). [2025-09-17T02:40:39.575895] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-17T02:40:39.575990] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CAH took 38.1s. Estimated remaining: 4h 46m 3s. Rate: 6.9 symbols/min [2025-09-17T02:40:39.752320] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:39.803508] [DEBUG] [LOCAL ] CARR: Loaded 39965 existing records from primary storage. [2025-09-17T02:40:39.803697] [INFO ] [MAIN ] CARR: Loaded 39965 existing records. [2025-09-17T02:40:39.991201] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:39.996006] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T02:40:39.995804] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-17T02:40:39.996177] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-17T02:40:39.997978] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-17T02:40:39.999777] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-17T02:40:39.999844] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-17T02:40:40.366171] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:40.448832] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T02:40:40.606001] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:40:40.690084] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-17T02:40:40.785129] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:40:41.490139] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-17T02:40:41.963679] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T02:40:41.968634] [INFO ] [REMOTE ] CALX: Full fetch complete (54164 records). [2025-09-17T02:40:41.968783] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-17T02:40:42.295223] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-17T02:40:42.360139] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-17T02:40:42.360259] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-17T02:40:42.360905] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-17T02:40:42.360970] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-17T02:40:42.362365] [DEBUG] [LOCAL ] CALX: Trimmed 54164 records to 38851 (keeping 200 days of data) [2025-09-17T02:40:42.608025] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:40:42.628130] [DEBUG] [LOCAL ] CALX: Primary data saved (38851 records). [2025-09-17T02:40:42.628298] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-17T02:40:42.628408] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CALX took 30.3s. Estimated remaining: 4h 45m 26s. Rate: 6.9 symbols/min [2025-09-17T02:40:42.800289] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:42.828582] [DEBUG] [LOCAL ] CARS: Loaded 29216 existing records from primary storage. [2025-09-17T02:40:42.828804] [INFO ] [MAIN ] CARS: Loaded 29216 existing records. [2025-09-17T02:40:43.008549] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:43.008811] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-17T02:40:43.008871] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-17T02:40:43.009610] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-17T02:40:43.009696] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-17T02:40:43.099431] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-11. [2025-09-17T02:40:43.227337] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:40:43.380219] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:43.890136] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-11. [2025-09-17T02:40:44.690143] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-17T02:40:44.884714] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:40:44.921923] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T02:40:45.307700] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T02:40:45.490131] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-17T02:40:46.290139] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-17T02:40:46.844252] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T02:40:47.056436] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T02:40:47.090083] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-17T02:40:47.890126] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-17T02:40:47.908959] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T02:40:48.690094] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-17T02:40:49.164847] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T02:40:49.490137] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-17T02:40:50.067898] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T02:40:50.290184] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-17T02:40:50.699687] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T02:40:50.713574] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T02:40:51.090124] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-17T02:40:51.658209] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T02:40:51.890125] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-17T02:40:52.690139] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-17T02:40:53.490225] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-17T02:40:53.533481] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:40:53.817750] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T02:40:54.098420] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T02:40:54.290192] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-17T02:40:55.090161] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-17T02:40:55.890153] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-17T02:40:56.085020] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:40:56.533062] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T02:40:56.698090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-17T02:40:56.721125] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T02:40:57.065897] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:40:57.067146] [INFO ] [REMOTE ] CAPL: Full fetch complete (8944 records). [2025-09-17T02:40:57.067234] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-17T02:40:57.439366] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-17T02:40:57.439471] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-17T02:40:57.439733] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-17T02:40:57.439792] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-17T02:40:57.440435] [DEBUG] [LOCAL ] CAPL: Trimmed 8944 records to 5967 (keeping 200 days of data) [2025-09-17T02:40:57.476894] [DEBUG] [LOCAL ] CAPL: Primary data saved (5967 records). [2025-09-17T02:40:57.477025] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-17T02:40:57.477128] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 20.0s. Estimated remaining: 4h 45m 49s. Rate: 6.9 symbols/min [2025-09-17T02:40:57.498784] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-17T02:40:57.654160] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:57.693472] [DEBUG] [LOCAL ] CAT: Loaded 39407 existing records from primary storage. [2025-09-17T02:40:57.693673] [INFO ] [MAIN ] CAT: Loaded 39407 existing records. [2025-09-17T02:40:57.870938] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:57.871214] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-17T02:40:57.871288] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-17T02:40:57.872376] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-17T02:40:57.872466] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-17T02:40:58.227071] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:58.290124] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-11. [2025-09-17T02:40:58.797497] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T02:40:59.090179] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-17T02:40:59.890121] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-17T02:41:00.155589] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T02:41:00.337101] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T02:41:00.690134] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-17T02:41:01.490186] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-17T02:41:01.683544] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T02:41:02.290188] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-17T02:41:02.324228] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:41:02.761258] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:41:03.090135] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-17T02:41:03.890139] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-17T02:41:03.947402] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:41:04.288732] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T02:41:04.690146] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-17T02:41:05.490153] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-17T02:41:05.926554] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T02:41:06.290140] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-17T02:41:06.661234] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T02:41:06.916751] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:41:07.090103] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-17T02:41:07.890130] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-17T02:41:08.374795] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T02:41:08.575034] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:41:08.690149] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-17T02:41:09.365074] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:41:09.490168] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-17T02:41:10.290140] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-17T02:41:10.741661] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-17T02:41:11.090151] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-17T02:41:11.369133] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T02:41:11.470575] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:41:11.890202] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-17T02:41:12.578850] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:41:12.690181] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-17T02:41:13.490126] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-17T02:41:13.717920] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:41:14.290187] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-17T02:41:14.742859] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T02:41:14.771662] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T02:41:14.775836] [INFO ] [REMOTE ] CANG: Full fetch complete (40389 records). [2025-09-17T02:41:14.775966] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-17T02:41:15.100898] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-17T02:41:15.148966] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-17T02:41:15.149071] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-17T02:41:15.149576] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-17T02:41:15.149629] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-17T02:41:15.150568] [DEBUG] [LOCAL ] CANG: Trimmed 40389 records to 26623 (keeping 200 days of data) [2025-09-17T02:41:15.302713] [DEBUG] [LOCAL ] CANG: Primary data saved (26623 records). [2025-09-17T02:41:15.302991] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-17T02:41:15.303188] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CANG took 38.0s. Estimated remaining: 4h 46m 26s. Rate: 6.9 symbols/min [2025-09-17T02:41:15.511215] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:15.544202] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T02:41:15.560690] [DEBUG] [LOCAL ] CATO: Loaded 5079 existing records from primary storage. [2025-09-17T02:41:15.560817] [INFO ] [MAIN ] CATO: Loaded 5079 existing records. [2025-09-17T02:41:15.738459] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:15.738739] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-17T02:41:15.738804] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-17T02:41:15.739068] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-17T02:41:15.739121] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-17T02:41:15.898490] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-17T02:41:16.106970] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:16.690164] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-11. [2025-09-17T02:41:17.268434] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T02:41:17.273219] [INFO ] [REMOTE ] CARS: Full fetch complete (55181 records). [2025-09-17T02:41:17.273352] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-17T02:41:17.498171] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-17T02:41:17.684364] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-17T02:41:17.684612] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-17T02:41:17.685677] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-17T02:41:17.685802] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-17T02:41:17.694679] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T02:41:17.698854] [DEBUG] [LOCAL ] CARS: Trimmed 55181 records to 40574 (keeping 200 days of data) [2025-09-17T02:41:17.729696] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-17T02:41:17.982439] [DEBUG] [LOCAL ] CARS: Primary data saved (40574 records). [2025-09-17T02:41:17.982592] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-17T02:41:17.982702] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARS took 35.4s. Estimated remaining: 4h 45m 47s. Rate: 6.9 symbols/min [2025-09-17T02:41:18.149264] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:18.149451] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-09-17T02:41:18.149500] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-09-17T02:41:18.149608] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-17T02:41:18.149696] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-17T02:41:18.149837] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-09-17T02:41:18.149941] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-17T02:41:18.292605] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-17T02:41:18.510042] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:19.090109] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-11. [2025-09-17T02:41:19.398460] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:41:19.610755] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T02:41:19.890135] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-17T02:41:20.690139] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-17T02:41:21.143274] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T02:41:21.490168] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-17T02:41:22.060726] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T02:41:22.217221] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:41:22.290126] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-17T02:41:23.090103] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-17T02:41:23.597200] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-17T02:41:23.890139] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-17T02:41:24.238737] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T02:41:24.690168] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-17T02:41:24.841077] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:41:24.847607] [INFO ] [REMOTE ] CARR: Full fetch complete (77432 records). [2025-09-17T02:41:24.847776] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-17T02:41:25.253776] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-17T02:41:25.253931] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-17T02:41:25.254835] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-17T02:41:25.254920] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-17T02:41:25.256539] [DEBUG] [LOCAL ] CARR: Trimmed 77432 records to 53598 (keeping 200 days of data) [2025-09-17T02:41:25.492663] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-17T02:41:25.493967] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T02:41:25.612827] [DEBUG] [LOCAL ] CARR: Primary data saved (53598 records). [2025-09-17T02:41:25.612985] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-17T02:41:25.613081] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CARR took 46.0s. Estimated remaining: 4h 45m 33s. Rate: 6.9 symbols/min [2025-09-17T02:41:25.794638] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:25.824500] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T02:41:25.867589] [DEBUG] [LOCAL ] CB: Loaded 37022 existing records from primary storage. [2025-09-17T02:41:25.867783] [INFO ] [MAIN ] CB: Loaded 37022 existing records. [2025-09-17T02:41:26.046435] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:26.046695] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-17T02:41:26.046756] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-17T02:41:26.047737] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-17T02:41:26.047813] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-17T02:41:26.295366] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-17T02:41:26.414724] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:27.090460] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-11. [2025-09-17T02:41:27.128825] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T02:41:27.661873] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T02:41:27.890149] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-17T02:41:28.690144] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-17T02:41:28.869696] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T02:41:29.246183] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T02:41:29.490215] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-17T02:41:30.091224] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T02:41:30.290124] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-17T02:41:31.049191] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T02:41:31.090156] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-17T02:41:31.304334] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T02:41:31.890143] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-17T02:41:32.690196] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-17T02:41:33.002772] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:41:33.490137] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-17T02:41:34.090847] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-17T02:41:34.128112] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:41:34.243841] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T02:41:34.250257] [INFO ] [REMOTE ] CAT: Full fetch complete (76382 records). [2025-09-17T02:41:34.250409] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-17T02:41:34.295284] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-17T02:41:34.661695] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-17T02:41:34.661811] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-17T02:41:34.662672] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-17T02:41:34.662739] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-17T02:41:34.664275] [DEBUG] [LOCAL ] CAT: Trimmed 76382 records to 52929 (keeping 200 days of data) [2025-09-17T02:41:35.005388] [DEBUG] [LOCAL ] CAT: Primary data saved (52929 records). [2025-09-17T02:41:35.005585] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-17T02:41:35.005701] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CAT took 37.5s. Estimated remaining: 4h 45m 28s. Rate: 6.9 symbols/min [2025-09-17T02:41:35.090244] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-17T02:41:35.890155] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-17T02:41:36.175959] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T02:41:36.566923] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:41:36.690109] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-17T02:41:36.752539] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:41:37.341957] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T02:41:37.490143] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-17T02:41:38.001994] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T02:41:38.290203] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-17T02:41:39.090151] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-17T02:41:39.890189] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-17T02:41:40.018678] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:41:40.676794] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:41:40.678609] [INFO ] [REMOTE ] CATO: Full fetch complete (12676 records). [2025-09-17T02:41:40.678713] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-17T02:41:40.711124] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-17T02:41:41.051358] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-17T02:41:41.051462] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-17T02:41:41.051788] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-17T02:41:41.051843] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-17T02:41:41.052310] [DEBUG] [LOCAL ] CATO: Trimmed 12676 records to 7469 (keeping 200 days of data) [2025-09-17T02:41:41.094808] [DEBUG] [LOCAL ] CATO: Primary data saved (7469 records). [2025-09-17T02:41:41.094975] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-17T02:41:41.095074] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CATO took 25.8s. Estimated remaining: 4h 45m 7s. Rate: 6.9 symbols/min [2025-09-17T02:41:41.215032] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T02:41:41.490112] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-17T02:41:42.597011] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:41:42.607841] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-17T02:41:43.571363] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-17T02:41:43.582416] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-17T02:41:44.142661] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:41:44.153876] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-17T02:41:45.705993] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T02:41:45.718029] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-17T02:41:45.886337] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T02:41:45.899710] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-17T02:41:47.607640] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T02:41:47.618560] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-17T02:41:47.894677] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T02:41:47.906304] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-17T02:41:49.517908] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T02:41:49.529473] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-17T02:41:49.764369] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T02:41:49.770883] [INFO ] [REMOTE ] CAVA: Full fetch complete (77166 records). [2025-09-17T02:41:49.771047] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-17T02:41:50.173498] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-17T02:41:50.173626] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-17T02:41:50.174554] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-17T02:41:50.174692] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-17T02:41:50.176299] [DEBUG] [LOCAL ] CAVA: Trimmed 77166 records to 53553 (keeping 200 days of data) [2025-09-17T02:41:50.517410] [DEBUG] [LOCAL ] CAVA: Primary data saved (53553 records). [2025-09-17T02:41:50.517610] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-17T02:41:50.517732] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CAVA took 32.5s. Estimated remaining: 4h 45m 1s. Rate: 6.9 symbols/min [2025-09-17T02:41:51.302706] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:41:51.313595] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-17T02:41:52.879872] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:41:52.886019] [INFO ] [REMOTE ] CB: Full fetch complete (72446 records). [2025-09-17T02:41:52.886165] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-17T02:41:53.304191] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-17T02:41:53.304368] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-17T02:41:53.305406] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-17T02:41:53.305481] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-17T02:41:53.307882] [DEBUG] [LOCAL ] CB: Trimmed 72446 records to 50110 (keeping 200 days of data) [2025-09-17T02:41:53.743864] [DEBUG] [LOCAL ] CB: Primary data saved (50110 records). [2025-09-17T02:41:53.744167] [INFO ] [MAIN ] CB: Full history saved. [2025-09-17T02:41:53.744307] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CB took 28.1s. Estimated remaining: 4h 44m 26s. Rate: 6.9 symbols/min [2025-09-17T02:41:54.431147] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.500915] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.501025] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-17T02:41:54.502252] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.506016] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.507711] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-17T02:41:54.509604] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-17T02:41:54.509835] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-17T02:41:54.509953] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-17T02:41:54.509996] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-17T02:41:54.584161] [DEBUG] [LOCAL ] CBNA: Loaded 2286 existing records from primary storage. [2025-09-17T02:41:54.611529] [INFO ] [MAIN ] CBNA: Loaded 2286 existing records. [2025-09-17T02:41:54.636322] [DEBUG] [LOCAL ] CBAN: Loaded 7457 existing records from primary storage. [2025-09-17T02:41:54.654263] [DEBUG] [LOCAL ] CBL: Loaded 11971 existing records from primary storage. [2025-09-17T02:41:54.716338] [INFO ] [MAIN ] CBL: Loaded 11971 existing records. [2025-09-17T02:41:54.716448] [INFO ] [MAIN ] CBAN: Loaded 7457 existing records. [2025-09-17T02:41:55.159423] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:55.240026] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-17T02:41:55.290696] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-17T02:41:55.418400] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:55.445139] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-17T02:41:55.475313] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-11. [2025-09-17T02:41:55.502440] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:55.491231] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-17T02:41:55.522491] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:55.522911] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-17T02:41:55.528340] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-17T02:41:55.544248] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-17T02:41:55.589535] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-17T02:41:55.595314] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-17T02:41:55.595375] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-17T02:41:55.643688] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-17T02:41:55.679628] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-17T02:41:55.835223] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T02:41:55.909661] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-17T02:41:56.345903] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:41:56.435241] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:56.435373] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-17T02:41:56.452739] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-17T02:41:56.463433] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-11. [2025-09-17T02:41:56.663028] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:56.665705] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:56.666628] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-11. [2025-09-17T02:41:56.666974] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-11. [2025-09-17T02:41:56.999371] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:41:56.999752] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-17T02:41:57.000265] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-17T02:41:57.090023] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T02:41:57.091702] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-17T02:41:57.206748] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:41:57.207118] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-17T02:41:57.207619] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-17T02:41:57.224156] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T02:41:57.226708] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-17T02:41:57.430825] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-17T02:41:57.490088] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-17T02:41:57.684729] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T02:41:57.712720] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-17T02:41:57.751892] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:41:57.982885] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T02:41:58.290129] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-17T02:41:59.090140] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-17T02:41:59.129063] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:41:59.683120] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T02:41:59.890114] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-17T02:42:00.690108] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-17T02:42:00.715797] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T02:42:01.490137] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-17T02:42:01.955085] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T02:42:02.290138] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-17T02:42:03.090127] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-17T02:42:03.279985] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T02:42:03.562275] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T02:42:03.890237] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-17T02:42:04.171604] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-17T02:42:04.690188] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-17T02:42:04.725257] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:42:05.193160] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T02:42:05.490167] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-17T02:42:06.290166] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-17T02:42:06.401618] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T02:42:06.774012] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T02:42:07.090159] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-17T02:42:07.890155] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-17T02:42:07.984622] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T02:42:08.690170] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-17T02:42:08.948098] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T02:42:09.177301] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T02:42:09.490138] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-17T02:42:09.714435] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:09.714895] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-17T02:42:10.290160] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-17T02:42:10.887688] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:42:11.090175] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-17T02:42:11.551046] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T02:42:11.890129] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-17T02:42:12.690182] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-17T02:42:12.976166] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T02:42:13.246209] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T02:42:13.490183] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-17T02:42:14.290176] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-17T02:42:14.507229] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:14.507560] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-17T02:42:14.507662] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-17T02:42:14.507741] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-17T02:42:14.508346] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T02:42:14.508418] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:42:14.508457] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:42:14.508504] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-17T02:42:14.508584] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-17T02:42:14.508629] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-17T02:42:14.508714] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-17T02:42:14.508796] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBO took 20.8s. Estimated remaining: 4h 45m 17s. Rate: 6.9 symbols/min [2025-09-17T02:42:14.684673] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:14.694392] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:42:14.735045] [DEBUG] [LOCAL ] CBRE: Loaded 37405 existing records from primary storage. [2025-09-17T02:42:14.735206] [INFO ] [MAIN ] CBRE: Loaded 37405 existing records. [2025-09-17T02:42:14.913888] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:14.914113] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-17T02:42:14.914169] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-17T02:42:14.915130] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-17T02:42:14.915199] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-17T02:42:15.090762] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-17T02:42:15.278169] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:15.890182] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-17T02:42:16.579470] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T02:42:16.580492] [INFO ] [REMOTE ] CBNA: Full fetch complete (4849 records). [2025-09-17T02:42:16.580581] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-17T02:42:16.700508] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-11. [2025-09-17T02:42:16.999026] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-17T02:42:16.999186] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-17T02:42:16.999383] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-17T02:42:16.999439] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-17T02:42:17.000008] [DEBUG] [LOCAL ] CBNA: Trimmed 4849 records to 2964 (keeping 200 days of data) [2025-09-17T02:42:17.018445] [DEBUG] [LOCAL ] CBNA: Primary data saved (2964 records). [2025-09-17T02:42:17.018587] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-17T02:42:17.018702] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBNA took 23.3s. Estimated remaining: 4h 44m 38s. Rate: 6.9 symbols/min [2025-09-17T02:42:17.199032] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:17.208392] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T02:42:17.233366] [DEBUG] [LOCAL ] CBT: Loaded 22881 existing records from primary storage. [2025-09-17T02:42:17.233527] [INFO ] [MAIN ] CBT: Loaded 22881 existing records. [2025-09-17T02:42:17.422142] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:17.422391] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-17T02:42:17.422454] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-17T02:42:17.423200] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-17T02:42:17.423268] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-17T02:42:17.495327] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-17T02:42:17.833676] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:18.290124] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-11. [2025-09-17T02:42:18.475997] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:42:18.581244] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T02:42:19.090151] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-17T02:42:19.496479] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:42:19.890187] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-17T02:42:20.690193] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-17T02:42:20.891984] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:42:21.121462] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T02:42:21.490149] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-17T02:42:21.578167] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T02:42:22.290171] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-17T02:42:22.669152] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T02:42:23.090123] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-17T02:42:23.890112] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-17T02:42:24.003843] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:42:24.109988] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:42:24.519256] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T02:42:24.690143] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-17T02:42:25.490151] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-17T02:42:26.062395] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:42:26.290183] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-17T02:42:26.785615] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T02:42:26.930038] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T02:42:27.090182] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-17T02:42:27.890126] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-17T02:42:28.580208] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:42:28.646478] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T02:42:28.690082] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-17T02:42:29.490190] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-17T02:42:29.611251] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:42:29.613405] [INFO ] [REMOTE ] CBL: Full fetch complete (25946 records). [2025-09-17T02:42:29.613507] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-17T02:42:29.979983] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-17T02:42:29.980085] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-17T02:42:29.980518] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-17T02:42:29.980581] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-17T02:42:29.981302] [DEBUG] [LOCAL ] CBL: Trimmed 25946 records to 16900 (keeping 200 days of data) [2025-09-17T02:42:30.083694] [DEBUG] [LOCAL ] CBL: Primary data saved (16900 records). [2025-09-17T02:42:30.083856] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-17T02:42:30.083991] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 36.3s. Estimated remaining: 4h 44m 50s. Rate: 6.9 symbols/min [2025-09-17T02:42:30.261048] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:30.277209] [DEBUG] [LOCAL ] CBU: Loaded 16385 existing records from primary storage. [2025-09-17T02:42:30.277371] [INFO ] [MAIN ] CBU: Loaded 16385 existing records. [2025-09-17T02:42:30.297628] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-17T02:42:30.428990] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T02:42:30.471440] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:30.471706] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-17T02:42:30.471769] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-17T02:42:30.472348] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-17T02:42:30.472410] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-17T02:42:30.838974] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:31.090178] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-17T02:42:31.887159] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T02:42:31.897086] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-11. [2025-09-17T02:42:31.919495] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T02:42:32.690162] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-17T02:42:33.042969] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:42:33.490128] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-17T02:42:34.093424] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:42:34.290181] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-17T02:42:35.089222] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T02:42:35.093523] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-17T02:42:35.332051] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T02:42:35.770289] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:42:35.771825] [INFO ] [REMOTE ] CBAN: Full fetch complete (15832 records). [2025-09-17T02:42:35.771915] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-17T02:42:35.895328] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-17T02:42:36.146090] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-17T02:42:36.146200] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-17T02:42:36.146535] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-17T02:42:36.146591] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-17T02:42:36.147124] [DEBUG] [LOCAL ] CBAN: Trimmed 15832 records to 11184 (keeping 200 days of data) [2025-09-17T02:42:36.214099] [DEBUG] [LOCAL ] CBAN: Primary data saved (11184 records). [2025-09-17T02:42:36.214262] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-17T02:42:36.214357] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBAN took 42.5s. Estimated remaining: 4h 44m 29s. Rate: 6.9 symbols/min [2025-09-17T02:42:36.387849] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:36.388046] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-17T02:42:36.388099] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-17T02:42:36.388208] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-17T02:42:36.388261] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-17T02:42:36.388310] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-17T02:42:36.388360] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-17T02:42:36.695321] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-17T02:42:36.768951] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:37.360508] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T02:42:37.490176] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-11. [2025-09-17T02:42:37.710556] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:37.710982] [WARN ] [REMOTE ] CBX: No data returned for month 2024-11 [2025-09-17T02:42:38.290154] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-17T02:42:38.514910] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:42:38.515503] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:38.526625] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-17T02:42:39.090148] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-17T02:42:39.890093] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-17T02:42:40.356435] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:42:40.690236] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-17T02:42:40.725699] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T02:42:40.909103] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:40.909487] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-17T02:42:41.490190] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-17T02:42:42.290172] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-17T02:42:42.535535] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:42:43.090122] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-17T02:42:43.365611] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:42:43.890123] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-17T02:42:44.111806] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:44.112135] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-17T02:42:44.682905] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:42:44.692380] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-17T02:42:45.490169] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-17T02:42:46.069260] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:42:46.290145] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-17T02:42:47.090107] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-17T02:42:47.188798] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T02:42:47.308159] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:47.308478] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-17T02:42:47.539363] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T02:42:47.890168] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-17T02:42:48.106404] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:48.107008] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-17T02:42:48.690176] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-17T02:42:49.490214] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-17T02:42:49.501757] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:42:50.290160] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-17T02:42:50.551053] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-17T02:42:50.661690] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:42:51.090131] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-17T02:42:51.327687] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-17T02:42:51.890144] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-17T02:42:52.103234] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:52.103578] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-17T02:42:52.690138] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-17T02:42:53.490130] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-17T02:42:53.815174] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:53.815744] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-17T02:42:53.815962] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-17T02:42:53.816112] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-17T02:42:53.816933] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T02:42:53.817067] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:42:53.817226] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:42:53.817550] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-17T02:42:53.826092] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-17T02:42:53.829419] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-17T02:42:53.832131] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-17T02:42:53.832600] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T02:42:53.832775] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBX took 17.6s. Estimated remaining: 4h 45m 4s. Rate: 6.9 symbols/min [2025-09-17T02:42:53.928746] [INFO ] [REMOTE ] CBT: Full fetch complete (45825 records). [2025-09-17T02:42:53.938965] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-17T02:42:54.109451] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:54.295293] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-17T02:42:54.371198] [DEBUG] [LOCAL ] CBZ: Loaded 24900 existing records from primary storage. [2025-09-17T02:42:54.404024] [INFO ] [MAIN ] CBZ: Loaded 24900 existing records. [2025-09-17T02:42:54.530756] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-17T02:42:54.541167] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-17T02:42:54.541879] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-17T02:42:54.547578] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-17T02:42:54.601747] [DEBUG] [LOCAL ] CBT: Trimmed 45825 records to 31500 (keeping 200 days of data) [2025-09-17T02:42:54.622032] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:54.622519] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-17T02:42:54.622590] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-17T02:42:54.623274] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-17T02:42:54.623353] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-17T02:42:55.116532] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:55.111802] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-17T02:42:55.215538] [DEBUG] [LOCAL ] CBT: Primary data saved (31500 records). [2025-09-17T02:42:55.215757] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-17T02:42:55.215867] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBT took 38.2s. Estimated remaining: 4h 44m 20s. Rate: 6.9 symbols/min [2025-09-17T02:42:55.385585] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:55.425704] [DEBUG] [LOCAL ] CC: Loaded 39560 existing records from primary storage. [2025-09-17T02:42:55.425873] [INFO ] [MAIN ] CC: Loaded 39560 existing records. [2025-09-17T02:42:55.603101] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:55.603459] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-17T02:42:55.603946] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-17T02:42:55.615770] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T02:42:55.615837] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-17T02:42:55.616063] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-17T02:42:55.895273] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-17T02:42:55.978192] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:56.690145] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-11. [2025-09-17T02:42:56.764504] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:42:57.005449] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:42:57.490215] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-11. [2025-09-17T02:42:58.290129] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-17T02:42:58.322037] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:42:58.769558] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T02:42:59.090135] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-17T02:42:59.835515] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T02:42:59.841438] [INFO ] [REMOTE ] CBRE: Full fetch complete (73883 records). [2025-09-17T02:42:59.841578] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-17T02:42:59.899593] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-17T02:43:00.245451] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-17T02:43:00.245609] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-17T02:43:00.246746] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-17T02:43:00.246846] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-17T02:43:00.262156] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:43:00.268224] [DEBUG] [LOCAL ] CBRE: Trimmed 73883 records to 50758 (keeping 200 days of data) [2025-09-17T02:43:00.575161] [DEBUG] [LOCAL ] CBRE: Primary data saved (50758 records). [2025-09-17T02:43:00.575332] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-17T02:43:00.575449] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBRE took 46.1s. Estimated remaining: 4h 43m 55s. Rate: 6.9 symbols/min [2025-09-17T02:43:00.695263] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-17T02:43:00.744624] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:00.783854] [DEBUG] [LOCAL ] CCI: Loaded 39559 existing records from primary storage. [2025-09-17T02:43:00.784016] [INFO ] [MAIN ] CCI: Loaded 39559 existing records. [2025-09-17T02:43:00.959858] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:00.960097] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-17T02:43:00.960156] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-17T02:43:00.961104] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-17T02:43:00.961166] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-17T02:43:01.333263] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:01.433550] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:43:01.490134] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-11. [2025-09-17T02:43:01.934060] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:43:02.290126] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-17T02:43:03.090135] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-17T02:43:03.277594] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:43:03.337221] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T02:43:03.890108] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-17T02:43:03.917125] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T02:43:04.690132] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-17T02:43:05.296683] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T02:43:05.490094] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-17T02:43:05.853599] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T02:43:06.290195] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-17T02:43:07.090138] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-17T02:43:07.471540] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T02:43:07.754237] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:43:07.890136] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-17T02:43:08.585387] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:43:08.690163] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-17T02:43:09.375367] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:43:09.490168] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-17T02:43:10.290178] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-17T02:43:10.550446] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T02:43:11.090177] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-17T02:43:11.217478] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:43:11.233904] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T02:43:11.238285] [INFO ] [REMOTE ] CBU: Full fetch complete (31611 records). [2025-09-17T02:43:11.238447] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-17T02:43:11.613054] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-17T02:43:11.613210] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-17T02:43:11.613734] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-17T02:43:11.613808] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-17T02:43:11.614763] [DEBUG] [LOCAL ] CBU: Trimmed 31611 records to 22732 (keeping 200 days of data) [2025-09-17T02:43:11.762749] [DEBUG] [LOCAL ] CBU: Primary data saved (22732 records). [2025-09-17T02:43:11.762916] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-17T02:43:11.763053] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBU took 41.7s. Estimated remaining: 4h 43m 58s. Rate: 6.9 symbols/min [2025-09-17T02:43:11.902238] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-17T02:43:11.931992] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:11.932902] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-17T02:43:11.932968] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-17T02:43:11.933136] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-17T02:43:11.933218] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-17T02:43:11.933309] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-17T02:43:11.933377] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-17T02:43:12.295918] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:12.526965] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:43:12.690170] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-17T02:43:13.490143] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-11. [2025-09-17T02:43:13.779129] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T02:43:13.836683] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T02:43:14.290169] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-17T02:43:14.639963] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-17T02:43:14.766683] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T02:43:15.090130] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-17T02:43:15.890130] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-17T02:43:16.338175] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:43:16.463194] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:43:16.690147] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-17T02:43:17.490141] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-17T02:43:17.758568] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T02:43:18.290162] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-17T02:43:19.090157] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-17T02:43:19.346469] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T02:43:19.755559] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:43:19.890146] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-17T02:43:20.690219] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-17T02:43:20.894044] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T02:43:21.168541] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T02:43:21.266183] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:43:21.490155] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-17T02:43:22.290185] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-17T02:43:22.661882] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T02:43:22.666912] [INFO ] [REMOTE ] CBZ: Full fetch complete (44092 records). [2025-09-17T02:43:22.667081] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-17T02:43:23.057429] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-17T02:43:23.057538] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-17T02:43:23.058126] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-17T02:43:23.058192] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-17T02:43:23.059747] [DEBUG] [LOCAL ] CBZ: Trimmed 44092 records to 33222 (keeping 200 days of data) [2025-09-17T02:43:23.117031] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-17T02:43:23.263728] [DEBUG] [LOCAL ] CBZ: Primary data saved (33222 records). [2025-09-17T02:43:23.263913] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-17T02:43:23.264009] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CBZ took 29.4s. Estimated remaining: 4h 44m 3s. Rate: 6.9 symbols/min [2025-09-17T02:43:23.489410] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:23.503720] [DEBUG] [LOCAL ] CCIF: Loaded 11293 existing records from primary storage. [2025-09-17T02:43:23.503933] [INFO ] [MAIN ] CCIF: Loaded 11293 existing records. [2025-09-17T02:43:23.689989] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:23.690301] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-17T02:43:23.690354] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-17T02:43:23.690777] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-17T02:43:23.690839] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-17T02:43:23.900097] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-17T02:43:24.049951] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:24.106540] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:43:24.352988] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:43:24.690245] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-17T02:43:25.097660] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T02:43:25.130976] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T02:43:25.490144] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-17T02:43:25.822100] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T02:43:26.290175] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-17T02:43:26.742072] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T02:43:27.090214] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-17T02:43:27.890186] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-17T02:43:28.690137] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-17T02:43:28.989928] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-17T02:43:28.991920] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T02:43:29.500102] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-17T02:43:29.521847] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T02:43:29.966725] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T02:43:30.290134] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-17T02:43:31.090137] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-17T02:43:31.890130] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-17T02:43:32.179709] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:43:32.305897] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T02:43:32.306686] [INFO ] [REMOTE ] CCIA: Full fetch complete (2019 records). [2025-09-17T02:43:32.306768] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-17T02:43:32.486202] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T02:43:32.486377] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:43:32.486427] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:43:32.486472] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-17T02:43:32.486568] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-17T02:43:32.486632] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-17T02:43:32.486713] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-17T02:43:32.486781] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCIA took 20.7s. Estimated remaining: 4h 43m 57s. Rate: 6.9 symbols/min [2025-09-17T02:43:32.654505] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:32.696685] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-11. [2025-09-17T02:43:32.699518] [DEBUG] [LOCAL ] CCJ: Loaded 40053 existing records from primary storage. [2025-09-17T02:43:32.699632] [INFO ] [MAIN ] CCJ: Loaded 40053 existing records. [2025-09-17T02:43:32.882442] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:32.882732] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-17T02:43:32.882886] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-17T02:43:32.883854] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-17T02:43:32.883921] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-17T02:43:33.259809] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:33.297722] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T02:43:33.490125] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-11. [2025-09-17T02:43:33.600285] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:43:34.290175] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-17T02:43:35.090159] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-17T02:43:35.654790] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-17T02:43:35.890124] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-17T02:43:36.075284] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:43:36.690135] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-17T02:43:36.748353] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T02:43:36.755066] [INFO ] [REMOTE ] CC: Full fetch complete (75165 records). [2025-09-17T02:43:36.755208] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-17T02:43:37.157704] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-17T02:43:37.157804] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-17T02:43:37.158577] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-17T02:43:37.158658] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-17T02:43:37.160121] [DEBUG] [LOCAL ] CC: Trimmed 75165 records to 53027 (keeping 200 days of data) [2025-09-17T02:43:37.489951] [DEBUG] [LOCAL ] CC: Primary data saved (53027 records). [2025-09-17T02:43:37.490146] [INFO ] [MAIN ] CC: Full history saved. [2025-09-17T02:43:37.490347] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CC took 42.3s. Estimated remaining: 4h 43m 31s. Rate: 6.9 symbols/min [2025-09-17T02:43:37.490210] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-17T02:43:37.663919] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:37.700672] [DEBUG] [LOCAL ] CCK: Loaded 34509 existing records from primary storage. [2025-09-17T02:43:37.700863] [INFO ] [MAIN ] CCK: Loaded 34509 existing records. [2025-09-17T02:43:37.912287] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:37.914052] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T02:43:37.924425] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-17T02:43:37.924961] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-17T02:43:37.926180] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-17T02:43:37.926259] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-17T02:43:38.288058] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:38.290082] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-11. [2025-09-17T02:43:38.343665] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:43:38.350028] [INFO ] [REMOTE ] CCI: Full fetch complete (76830 records). [2025-09-17T02:43:38.350171] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-17T02:43:38.639539] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T02:43:38.798103] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-17T02:43:38.798230] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-17T02:43:38.799225] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-17T02:43:38.799331] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-17T02:43:38.800922] [DEBUG] [LOCAL ] CCI: Trimmed 76830 records to 53166 (keeping 200 days of data) [2025-09-17T02:43:39.097731] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-17T02:43:39.151413] [DEBUG] [LOCAL ] CCI: Primary data saved (53166 records). [2025-09-17T02:43:39.151566] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-17T02:43:39.151681] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCI took 38.6s. Estimated remaining: 4h 42m 49s. Rate: 6.9 symbols/min [2025-09-17T02:43:39.338100] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:39.381544] [DEBUG] [LOCAL ] CCL: Loaded 40150 existing records from primary storage. [2025-09-17T02:43:39.381765] [INFO ] [MAIN ] CCL: Loaded 40150 existing records. [2025-09-17T02:43:39.574316] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:39.574555] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-17T02:43:39.574666] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-17T02:43:39.575706] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-17T02:43:39.575776] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-17T02:43:39.892768] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-17T02:43:39.956705] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:39.985722] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:43:40.131621] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T02:43:40.690130] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-17T02:43:41.490115] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-11. [2025-09-17T02:43:41.592246] [DEBUG] [REMOTE ] CCL: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T02:43:41.592541] [WARN ] [REMOTE ] CCL: No data returned for month 2024-11 [2025-09-17T02:43:41.895700] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T02:43:42.291985] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-17T02:43:42.293732] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:43:43.090128] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-17T02:43:43.195118] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T02:43:43.890122] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-17T02:43:44.690137] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-17T02:43:45.490204] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-17T02:43:45.559004] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-17T02:43:45.584895] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T02:43:45.616139] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T02:43:46.290127] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-17T02:43:47.096308] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-17T02:43:47.099340] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T02:43:47.350032] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:43:47.890104] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-17T02:43:48.441822] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T02:43:48.690133] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-17T02:43:49.490180] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-17T02:43:49.675231] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T02:43:49.880003] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T02:43:50.290162] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-17T02:43:51.090151] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-17T02:43:51.266740] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T02:43:51.820864] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-17T02:43:51.890172] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-17T02:43:52.690148] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-17T02:43:52.832876] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:43:53.482284] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T02:43:53.490079] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-17T02:43:54.051394] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T02:43:54.290139] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-17T02:43:55.009908] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T02:43:55.090140] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-17T02:43:55.553253] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:43:55.721870] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:43:55.724267] [INFO ] [REMOTE ] CCIF: Full fetch complete (21543 records). [2025-09-17T02:43:55.724377] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-17T02:43:55.895302] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-17T02:43:56.115136] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-17T02:43:56.115243] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-17T02:43:56.115608] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-17T02:43:56.115680] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-17T02:43:56.116288] [DEBUG] [LOCAL ] CCIF: Trimmed 21543 records to 15299 (keeping 200 days of data) [2025-09-17T02:43:56.204169] [DEBUG] [LOCAL ] CCIF: Primary data saved (15299 records). [2025-09-17T02:43:56.204334] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-17T02:43:56.204431] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCIF took 32.9s. Estimated remaining: 4h 43m 20s. Rate: 6.9 symbols/min [2025-09-17T02:43:56.373720] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:56.408675] [DEBUG] [LOCAL ] CCO: Loaded 36204 existing records from primary storage. [2025-09-17T02:43:56.408863] [INFO ] [MAIN ] CCO: Loaded 36204 existing records. [2025-09-17T02:43:56.592399] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:56.592804] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-17T02:43:56.592859] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-17T02:43:56.593736] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-17T02:43:56.593798] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-17T02:43:56.693631] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-17T02:43:56.951010] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:57.490128] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-11. [2025-09-17T02:43:58.057059] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T02:43:58.290147] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-17T02:43:58.968817] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T02:43:59.096659] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-17T02:43:59.117551] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-17T02:43:59.890118] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-17T02:44:00.297943] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T02:44:00.599811] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T02:44:00.690094] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-17T02:44:01.490169] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-17T02:44:02.250020] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T02:44:02.290137] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-17T02:44:02.413620] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-17T02:44:03.090144] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-17T02:44:03.795174] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T02:44:03.890112] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-17T02:44:04.029523] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:44:04.690135] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-17T02:44:05.481891] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-17T02:44:05.493073] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-17T02:44:05.968460] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T02:44:06.051342] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T02:44:06.290128] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-17T02:44:07.090105] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-17T02:44:07.188887] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:44:07.719725] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:44:07.890128] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-17T02:44:08.690244] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-17T02:44:09.123608] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T02:44:09.133903] [INFO ] [REMOTE ] CCJ: Full fetch complete (77575 records). [2025-09-17T02:44:09.134189] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-17T02:44:09.495484] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-17T02:44:09.596817] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-17T02:44:09.596993] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-17T02:44:09.597968] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-17T02:44:09.598042] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-17T02:44:09.599852] [DEBUG] [LOCAL ] CCJ: Trimmed 77575 records to 53675 (keeping 200 days of data) [2025-09-17T02:44:09.716750] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:44:09.953283] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-09-17T02:44:09.953446] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-17T02:44:09.954357] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCJ took 37.5s. Estimated remaining: 4h 43m 35s. Rate: 6.9 symbols/min [2025-09-17T02:44:10.125220] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:10.136014] [DEBUG] [LOCAL ] CCRD: Loaded 7777 existing records from primary storage. [2025-09-17T02:44:10.136170] [INFO ] [MAIN ] CCRD: Loaded 7777 existing records. [2025-09-17T02:44:10.296821] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-17T02:44:10.319782] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:10.320256] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-17T02:44:10.320453] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-17T02:44:10.320884] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-17T02:44:10.321024] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-17T02:44:10.666312] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T02:44:10.756514] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:11.090210] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-17T02:44:11.890369] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-11. [2025-09-17T02:44:11.896546] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-17T02:44:12.088930] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:44:12.388038] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T02:44:12.690173] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-17T02:44:12.887436] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T02:44:13.490185] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-17T02:44:13.555264] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:44:14.290367] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-17T02:44:15.077614] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:44:15.090084] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-17T02:44:15.890169] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-17T02:44:16.690155] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-17T02:44:16.741823] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T02:44:16.860806] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-17T02:44:17.234295] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T02:44:17.365728] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T02:44:17.490139] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-17T02:44:18.109828] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T02:44:18.290157] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-17T02:44:18.899562] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T02:44:19.090130] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-17T02:44:19.890151] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-17T02:44:20.320363] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T02:44:20.690132] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-17T02:44:21.331775] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T02:44:21.490142] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-17T02:44:22.260316] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T02:44:22.290105] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-17T02:44:22.340416] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T02:44:23.090182] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-17T02:44:23.820720] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T02:44:23.826821] [INFO ] [REMOTE ] CCK: Full fetch complete (67612 records). [2025-09-17T02:44:23.826952] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-17T02:44:23.895435] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-17T02:44:24.226853] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-17T02:44:24.226970] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-17T02:44:24.227716] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-17T02:44:24.227786] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-17T02:44:24.229221] [DEBUG] [LOCAL ] CCK: Trimmed 67612 records to 46625 (keeping 200 days of data) [2025-09-17T02:44:24.521665] [DEBUG] [LOCAL ] CCK: Primary data saved (46625 records). [2025-09-17T02:44:24.521828] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-17T02:44:24.521924] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCK took 47.0s. Estimated remaining: 4h 43m 54s. Rate: 6.9 symbols/min [2025-09-17T02:44:24.695322] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-17T02:44:24.697507] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:24.699310] [DEBUG] [LOCAL ] CCS: No existing data file found in primary storage. [2025-09-17T02:44:24.699405] [WARN ] [MAIN ] CCS: No existing data found, performing full refresh instead. [2025-09-17T02:44:24.699560] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-17T02:44:24.699633] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-17T02:44:24.699713] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-09-17T02:44:24.699761] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-17T02:44:25.062126] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:25.279700] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-17T02:44:25.286223] [INFO ] [REMOTE ] CCL: Full fetch complete (76750 records). [2025-09-17T02:44:25.286395] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-17T02:44:25.485079] [WARN ] [VALIDATOR ] CCL: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T02:44:25.491556] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-11. [2025-09-17T02:44:25.492459] [FATAL] [MAIN ] CCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:44:25.495845] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T02:44:25.495492] [WARN ] [MAIN ] CCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:44:25.501267] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-17T02:44:25.513014] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-09-17T02:44:25.513677] [INFO ] [LOCAL ] CCL: Starting deletion of derivative data. [2025-09-17T02:44:25.514628] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:44:25.520388] [DEBUG] [LOCAL ] CCL: Deleted derivative data file. [2025-09-17T02:44:25.520731] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCL took 46.4s. Estimated remaining: 4h 43m 9s. Rate: 6.9 symbols/min [2025-09-17T02:44:25.521072] [INFO ] [REMOTE ] CCO: Full fetch complete (65654 records). [2025-09-17T02:44:25.597454] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-17T02:44:25.821387] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:26.034898] [DEBUG] [LOCAL ] CCU: Loaded 16433 existing records from primary storage. [2025-09-17T02:44:26.035103] [INFO ] [MAIN ] CCU: Loaded 16433 existing records. [2025-09-17T02:44:26.232374] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-17T02:44:26.248062] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-17T02:44:26.259069] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-17T02:44:26.309780] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-17T02:44:26.313205] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-17T02:44:26.313599] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:26.314946] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-17T02:44:26.315027] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-17T02:44:26.315772] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-17T02:44:26.315983] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-17T02:44:26.337168] [DEBUG] [LOCAL ] CCO: Trimmed 65654 records to 47470 (keeping 200 days of data) [2025-09-17T02:44:26.793517] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:26.889758] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T02:44:27.005387] [DEBUG] [LOCAL ] CCO: Primary data saved (47470 records). [2025-09-17T02:44:27.005667] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-17T02:44:27.005805] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCO took 30.8s. Estimated remaining: 4h 42m 26s. Rate: 6.9 symbols/min [2025-09-17T02:44:27.095364] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-17T02:44:27.187137] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:27.187531] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-17T02:44:27.187591] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-17T02:44:27.187744] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-17T02:44:27.187801] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-17T02:44:27.187868] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-17T02:44:27.187926] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-17T02:44:27.515912] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:44:27.601457] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:27.890149] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-11. [2025-09-17T02:44:28.038116] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T02:44:28.690134] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-17T02:44:28.886588] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T02:44:29.245976] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T02:44:29.490138] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-17T02:44:30.226909] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:44:30.228601] [INFO ] [REMOTE ] CCRD: Full fetch complete (12010 records). [2025-09-17T02:44:30.228705] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-17T02:44:30.297970] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-17T02:44:30.590546] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-17T02:44:30.590663] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-17T02:44:30.590924] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-17T02:44:30.590984] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-17T02:44:30.591464] [DEBUG] [LOCAL ] CCRD: Trimmed 12010 records to 8902 (keeping 200 days of data) [2025-09-17T02:44:30.644440] [DEBUG] [LOCAL ] CCRD: Primary data saved (8902 records). [2025-09-17T02:44:30.644603] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-17T02:44:30.644718] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 20.7s. Estimated remaining: 4h 41m 54s. Rate: 6.9 symbols/min [2025-09-17T02:44:30.812833] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:30.855058] [DEBUG] [LOCAL ] CDE: Loaded 39994 existing records from primary storage. [2025-09-17T02:44:30.855228] [INFO ] [MAIN ] CDE: Loaded 39994 existing records. [2025-09-17T02:44:31.037709] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:31.038015] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-17T02:44:31.038077] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-17T02:44:31.038980] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-17T02:44:31.039042] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-17T02:44:31.097980] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-11. [2025-09-17T02:44:31.428451] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:31.540665] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:44:31.602726] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T02:44:31.890134] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-17T02:44:32.690145] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-17T02:44:33.384992] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:44:33.490133] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-17T02:44:33.700767] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:44:34.290183] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-17T02:44:34.452174] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T02:44:35.090124] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-17T02:44:35.263391] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T02:44:35.406323] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-17T02:44:35.890145] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-17T02:44:36.690134] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-17T02:44:37.241103] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:44:37.260834] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T02:44:37.490126] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-17T02:44:37.724991] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-17T02:44:38.290135] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-11. [2025-09-17T02:44:39.090174] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-17T02:44:39.890116] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-17T02:44:40.118415] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-17T02:44:40.223892] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T02:44:40.409101] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T02:44:40.690126] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-17T02:44:41.051935] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-17T02:44:41.490176] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-17T02:44:42.290142] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-17T02:44:43.090174] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-17T02:44:43.330516] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:44:43.672255] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T02:44:43.890142] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-17T02:44:44.492097] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:44:44.690163] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-17T02:44:45.143236] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:44:45.490143] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-17T02:44:45.557947] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T02:44:46.290175] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-17T02:44:46.544215] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-17T02:44:47.090137] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-17T02:44:47.342312] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:44:47.342695] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-17T02:44:47.403666] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T02:44:47.890132] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-17T02:44:48.215384] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T02:44:48.690126] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-17T02:44:49.490109] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-17T02:44:49.811090] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:44:50.290128] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-17T02:44:51.022189] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T02:44:51.090094] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-17T02:44:51.346511] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:44:51.890103] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-17T02:44:52.202426] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:44:52.690134] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-17T02:44:53.490218] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-17T02:44:53.805994] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:44:53.893169] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T02:44:54.290179] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-17T02:44:54.378264] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T02:44:54.381074] [INFO ] [REMOTE ] CCU: Full fetch complete (33323 records). [2025-09-17T02:44:54.381169] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-17T02:44:54.750734] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-17T02:44:54.750868] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-17T02:44:54.751320] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-17T02:44:54.751381] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-17T02:44:54.752302] [DEBUG] [LOCAL ] CCU: Trimmed 33323 records to 24179 (keeping 200 days of data) [2025-09-17T02:44:54.896494] [DEBUG] [LOCAL ] CCU: Primary data saved (24179 records). [2025-09-17T02:44:54.896664] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-17T02:44:54.896761] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCU took 29.4s. Estimated remaining: 4h 42m 58s. Rate: 6.9 symbols/min [2025-09-17T02:44:55.065342] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:55.073868] [DEBUG] [LOCAL ] CDLR: Loaded 7019 existing records from primary storage. [2025-09-17T02:44:55.074002] [INFO ] [MAIN ] CDLR: Loaded 7019 existing records. [2025-09-17T02:44:55.095292] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-17T02:44:55.259347] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:55.259792] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-17T02:44:55.259885] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-17T02:44:55.260200] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-17T02:44:55.260338] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-17T02:44:55.471965] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T02:44:55.563158] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T02:44:55.648926] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:55.890170] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-11. [2025-09-17T02:44:56.690129] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-17T02:44:56.703775] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T02:44:56.942048] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-17T02:44:56.942768] [INFO ] [REMOTE ] CCZ: Full fetch complete (149 records). [2025-09-17T02:44:56.942850] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-17T02:44:56.943205] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T02:44:56.943309] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:44:56.943357] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:44:56.943415] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-17T02:44:56.943503] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-17T02:44:56.943567] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-17T02:44:56.943661] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-17T02:44:56.943738] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCZ took 29.9s. Estimated remaining: 4h 42m 18s. Rate: 6.9 symbols/min [2025-09-17T02:44:57.118935] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:57.148526] [DEBUG] [LOCAL ] CDP: Loaded 31306 existing records from primary storage. [2025-09-17T02:44:57.148707] [INFO ] [MAIN ] CDP: Loaded 31306 existing records. [2025-09-17T02:44:57.327268] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:57.327537] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-17T02:44:57.327600] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-17T02:44:57.328363] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-17T02:44:57.328427] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-17T02:44:57.495826] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-17T02:44:57.686151] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:58.290125] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-17T02:44:58.411436] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T02:44:59.090160] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-17T02:44:59.658296] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:44:59.890145] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-17T02:45:00.317972] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T02:45:00.690128] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-17T02:45:01.134530] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T02:45:01.219236] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T02:45:01.490574] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-17T02:45:02.290152] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-11. [2025-09-17T02:45:03.090152] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-17T02:45:03.890206] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-17T02:45:04.098067] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-17T02:45:04.102085] [INFO ] [REMOTE ] CCS: Full fetch complete (44238 records). [2025-09-17T02:45:04.102260] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-17T02:45:04.492145] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-17T02:45:04.492285] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-17T02:45:04.492965] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-17T02:45:04.493049] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-17T02:45:04.495911] [DEBUG] [LOCAL ] CCS: Trimmed 44238 records to 30631 (keeping 200 days of data) [2025-09-17T02:45:04.698464] [DEBUG] [LOCAL ] CCS: Primary data saved (30631 records). [2025-09-17T02:45:04.698671] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-17T02:45:04.698811] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CCS took 40.2s. Estimated remaining: 4h 42m 5s. Rate: 6.9 symbols/min [2025-09-17T02:45:04.869009] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:04.887954] [DEBUG] [LOCAL ] CDRE: Loaded 18653 existing records from primary storage. [2025-09-17T02:45:04.888134] [INFO ] [MAIN ] CDRE: Loaded 18653 existing records. [2025-09-17T02:45:05.067459] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:05.067739] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-17T02:45:05.067801] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-17T02:45:05.068302] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-17T02:45:05.068361] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-17T02:45:05.444218] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-17T02:45:05.510081] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:05.510784] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-17T02:45:05.511330] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-11. [2025-09-17T02:45:05.566116] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-11 (3.28 seconds). [2025-09-17T02:45:06.011672] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T02:45:06.047088] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T02:45:06.290136] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-17T02:45:06.389856] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T02:45:07.090138] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-17T02:45:07.828101] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:45:07.890106] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-17T02:45:08.690192] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-17T02:45:09.010215] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T02:45:09.087773] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T02:45:09.490163] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-17T02:45:09.747308] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T02:45:10.290143] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-17T02:45:11.090135] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-17T02:45:11.407403] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:45:11.454452] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:45:11.890155] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-17T02:45:12.596006] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T02:45:12.690174] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-17T02:45:12.716042] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T02:45:13.490173] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-17T02:45:14.290177] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-17T02:45:14.721406] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T02:45:14.932784] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T02:45:15.090123] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-17T02:45:15.142689] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:45:15.890138] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-17T02:45:15.938262] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T02:45:16.690173] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-17T02:45:17.490190] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-17T02:45:17.543473] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T02:45:18.290193] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-17T02:45:18.678918] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:45:19.090183] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-17T02:45:19.675963] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T02:45:19.776368] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T02:45:19.778297] [INFO ] [REMOTE ] CDLR: Full fetch complete (13292 records). [2025-09-17T02:45:19.778400] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-17T02:45:19.899229] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-17T02:45:20.120578] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-17T02:45:20.190799] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-17T02:45:20.191178] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-17T02:45:20.191608] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-17T02:45:20.191690] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-17T02:45:20.192247] [DEBUG] [LOCAL ] CDLR: Trimmed 13292 records to 10291 (keeping 200 days of data) [2025-09-17T02:45:20.253910] [DEBUG] [LOCAL ] CDLR: Primary data saved (10291 records). [2025-09-17T02:45:20.254080] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-17T02:45:20.254198] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDLR took 25.4s. Estimated remaining: 4h 42m 28s. Rate: 6.9 symbols/min [2025-09-17T02:45:20.424713] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:20.469205] [DEBUG] [LOCAL ] CE: Loaded 38140 existing records from primary storage. [2025-09-17T02:45:20.469381] [INFO ] [MAIN ] CE: Loaded 38140 existing records. [2025-09-17T02:45:20.649931] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:20.650198] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-17T02:45:20.650257] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-17T02:45:20.651172] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-17T02:45:20.651251] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-17T02:45:20.698332] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-17T02:45:21.018622] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:21.490137] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-17T02:45:21.947516] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-17T02:45:21.956604] [INFO ] [REMOTE ] CDE: Full fetch complete (77420 records). [2025-09-17T02:45:21.956835] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-17T02:45:22.291334] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-11. [2025-09-17T02:45:22.367980] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-17T02:45:22.368173] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-17T02:45:22.369409] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-17T02:45:22.369542] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-17T02:45:22.397281] [DEBUG] [LOCAL ] CDE: Trimmed 77420 records to 53641 (keeping 200 days of data) [2025-09-17T02:45:22.399595] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:45:22.739738] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T02:45:22.769373] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-17T02:45:22.769567] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-17T02:45:22.769706] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDE took 52.1s. Estimated remaining: 4h 41m 51s. Rate: 6.9 symbols/min [2025-09-17T02:45:22.937116] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:22.943405] [DEBUG] [LOCAL ] CEE: Loaded 4013 existing records from primary storage. [2025-09-17T02:45:22.943518] [INFO ] [MAIN ] CEE: Loaded 4013 existing records. [2025-09-17T02:45:23.098625] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-17T02:45:23.123791] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:23.124115] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-17T02:45:23.124191] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-17T02:45:23.124513] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-17T02:45:23.124618] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-17T02:45:23.487849] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:23.890189] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-11. [2025-09-17T02:45:24.147135] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:45:24.479337] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T02:45:24.573248] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:45:24.690141] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-17T02:45:25.490188] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-17T02:45:26.144775] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T02:45:26.204847] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T02:45:26.290160] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-17T02:45:27.090142] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-17T02:45:27.870507] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T02:45:27.890114] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-17T02:45:28.078825] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:45:28.690166] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-17T02:45:29.182479] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:45:29.346019] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:45:29.490184] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-17T02:45:30.290111] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-17T02:45:30.527242] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:45:30.530352] [INFO ] [REMOTE ] CDRE: Full fetch complete (35561 records). [2025-09-17T02:45:30.530483] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-17T02:45:30.920810] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-17T02:45:30.921299] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-17T02:45:30.921873] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-17T02:45:30.921930] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-17T02:45:30.922846] [DEBUG] [LOCAL ] CDRE: Trimmed 35561 records to 25093 (keeping 200 days of data) [2025-09-17T02:45:31.083885] [DEBUG] [LOCAL ] CDRE: Primary data saved (25093 records). [2025-09-17T02:45:31.084048] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-17T02:45:31.084159] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDRE took 26.4s. Estimated remaining: 4h 41m 41s. Rate: 6.9 symbols/min [2025-09-17T02:45:31.095758] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-17T02:45:31.267227] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:31.276765] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T02:45:31.296500] [DEBUG] [LOCAL ] CEPU: Loaded 18809 existing records from primary storage. [2025-09-17T02:45:31.296702] [INFO ] [MAIN ] CEPU: Loaded 18809 existing records. [2025-09-17T02:45:31.503044] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:31.503327] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-17T02:45:31.503431] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-17T02:45:31.504029] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-17T02:45:31.504107] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-17T02:45:31.883927] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:31.890084] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-11. [2025-09-17T02:45:32.677022] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T02:45:32.690078] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-17T02:45:33.217308] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:45:33.490135] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-17T02:45:33.863887] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T02:45:34.290201] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-17T02:45:34.818072] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:45:35.090144] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-17T02:45:35.890163] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-17T02:45:36.060388] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T02:45:36.097810] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:45:36.690144] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-17T02:45:37.212424] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T02:45:37.287582] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T02:45:37.490154] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-17T02:45:38.290174] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-17T02:45:39.034181] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:45:39.090118] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-17T02:45:39.406230] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:45:39.890135] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-17T02:45:40.600162] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T02:45:40.690122] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-17T02:45:40.888567] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:45:41.303574] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:45:41.490166] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-17T02:45:42.118366] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T02:45:42.290128] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-17T02:45:43.090148] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-17T02:45:43.738730] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:45:43.745515] [INFO ] [REMOTE ] CDP: Full fetch complete (61709 records). [2025-09-17T02:45:43.745716] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-17T02:45:43.891681] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-17T02:45:43.929333] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T02:45:44.148969] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-17T02:45:44.149111] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-17T02:45:44.149929] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-17T02:45:44.149991] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-17T02:45:44.151418] [DEBUG] [LOCAL ] CDP: Trimmed 61709 records to 42807 (keeping 200 days of data) [2025-09-17T02:45:44.445722] [DEBUG] [LOCAL ] CDP: Primary data saved (42807 records). [2025-09-17T02:45:44.445930] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-17T02:45:44.446084] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CDP took 47.5s. Estimated remaining: 4h 41m 53s. Rate: 6.9 symbols/min [2025-09-17T02:45:44.619800] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:44.657524] [DEBUG] [LOCAL ] CF: Loaded 38963 existing records from primary storage. [2025-09-17T02:45:44.657752] [INFO ] [MAIN ] CF: Loaded 38963 existing records. [2025-09-17T02:45:44.695309] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-17T02:45:44.849427] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:44.849760] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-17T02:45:44.849834] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-17T02:45:44.850884] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-17T02:45:44.850971] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-17T02:45:45.223981] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:45.490141] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-11. [2025-09-17T02:45:45.720975] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:45:45.977918] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T02:45:46.290144] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-17T02:45:46.742406] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T02:45:47.090162] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-17T02:45:47.890149] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-17T02:45:48.113857] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:45:48.690221] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-17T02:45:48.737169] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T02:45:49.129690] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T02:45:49.490127] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-17T02:45:50.290146] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-17T02:45:50.541617] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:45:50.688322] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:45:50.793994] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:45:50.795158] [INFO ] [REMOTE ] CEE: Full fetch complete (10175 records). [2025-09-17T02:45:50.795246] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-17T02:45:51.091617] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-17T02:45:51.176071] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-17T02:45:51.176174] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-17T02:45:51.176449] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-17T02:45:51.176503] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-17T02:45:51.177001] [DEBUG] [LOCAL ] CEE: Trimmed 10175 records to 7167 (keeping 200 days of data) [2025-09-17T02:45:51.220405] [DEBUG] [LOCAL ] CEE: Primary data saved (7167 records). [2025-09-17T02:45:51.220561] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-17T02:45:51.220670] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CEE took 28.5s. Estimated remaining: 4h 41m 36s. Rate: 6.9 symbols/min [2025-09-17T02:45:51.398380] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:51.441382] [DEBUG] [LOCAL ] CFG: Loaded 39975 existing records from primary storage. [2025-09-17T02:45:51.441553] [INFO ] [MAIN ] CFG: Loaded 39975 existing records. [2025-09-17T02:45:51.630898] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:51.631175] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-17T02:45:51.631236] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-17T02:45:51.632325] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-17T02:45:51.632399] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-17T02:45:51.895257] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-17T02:45:52.003523] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:52.690154] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-17T02:45:52.768991] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:45:53.293495] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T02:45:53.490136] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-17T02:45:53.879398] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T02:45:54.290229] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-11. [2025-09-17T02:45:54.855132] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:45:55.090190] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-17T02:45:55.890159] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-17T02:45:56.054765] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T02:45:56.690216] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-17T02:45:56.811671] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:45:57.138571] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:45:57.490156] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-17T02:45:58.290132] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-17T02:45:58.563882] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:45:59.009883] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:45:59.047346] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T02:45:59.090113] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-17T02:45:59.890133] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-17T02:46:00.224363] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:46:00.228433] [INFO ] [REMOTE ] CEPU: Full fetch complete (39318 records). [2025-09-17T02:46:00.228539] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-17T02:46:00.619930] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-17T02:46:00.620053] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-17T02:46:00.620598] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-17T02:46:00.621033] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-17T02:46:00.622094] [DEBUG] [LOCAL ] CEPU: Trimmed 39318 records to 25572 (keeping 200 days of data) [2025-09-17T02:46:00.704070] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-17T02:46:00.768797] [DEBUG] [LOCAL ] CEPU: Primary data saved (25572 records). [2025-09-17T02:46:00.768950] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-17T02:46:00.769044] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CEPU took 29.7s. Estimated remaining: 4h 41m 31s. Rate: 6.9 symbols/min [2025-09-17T02:46:00.939954] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:00.940169] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-17T02:46:00.940226] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-17T02:46:00.940332] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-17T02:46:00.940377] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-17T02:46:00.940430] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-17T02:46:00.940476] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-17T02:46:01.355968] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:01.465524] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:46:01.490141] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-17T02:46:01.912071] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T02:46:01.918388] [INFO ] [REMOTE ] CE: Full fetch complete (74760 records). [2025-09-17T02:46:01.918571] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-17T02:46:02.290531] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-17T02:46:02.332147] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-17T02:46:02.332248] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-17T02:46:02.333143] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-17T02:46:02.333230] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-17T02:46:02.335020] [DEBUG] [LOCAL ] CE: Trimmed 74760 records to 51604 (keeping 200 days of data) [2025-09-17T02:46:02.676389] [DEBUG] [LOCAL ] CE: Primary data saved (51604 records). [2025-09-17T02:46:02.676563] [INFO ] [MAIN ] CE: Full history saved. [2025-09-17T02:46:02.676688] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CE took 42.4s. Estimated remaining: 4h 40m 52s. Rate: 6.9 symbols/min [2025-09-17T02:46:02.850604] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:02.875938] [DEBUG] [LOCAL ] CFR: Loaded 24180 existing records from primary storage. [2025-09-17T02:46:02.876107] [INFO ] [MAIN ] CFR: Loaded 24180 existing records. [2025-09-17T02:46:03.063849] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:03.064122] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-17T02:46:03.064185] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-17T02:46:03.064913] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-17T02:46:03.064977] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-17T02:46:03.098247] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-11. [2025-09-17T02:46:03.406517] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:03.444421] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:03.445724] [WARN ] [REMOTE ] CFND: No data returned for month 2024-11 [2025-09-17T02:46:03.477823] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T02:46:03.720657] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:46:03.890133] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-17T02:46:04.690176] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-17T02:46:04.921855] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:04.922169] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-17T02:46:05.490143] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-17T02:46:05.551088] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:46:06.290141] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-11. [2025-09-17T02:46:07.090139] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-17T02:46:07.286362] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T02:46:07.348554] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:46:07.890126] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-17T02:46:08.098972] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:08.099346] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-17T02:46:08.690148] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-17T02:46:08.832998] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:46:08.899498] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:08.899810] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-17T02:46:09.490167] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-17T02:46:10.290148] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-17T02:46:11.090188] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-17T02:46:11.330338] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:11.352886] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-17T02:46:11.355618] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T02:46:11.584104] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:46:11.890138] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-17T02:46:12.107128] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:12.107490] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-17T02:46:12.690171] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-17T02:46:13.490133] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-17T02:46:14.290201] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-17T02:46:14.534761] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T02:46:15.010324] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:46:15.090142] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-17T02:46:15.839183] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:46:15.890076] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-17T02:46:16.543048] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:46:16.690114] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-17T02:46:17.490111] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-17T02:46:17.640715] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:46:18.106021] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:46:18.290142] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-17T02:46:19.090192] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-17T02:46:19.265303] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:46:19.316847] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:19.317165] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-17T02:46:19.803336] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T02:46:19.890113] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-17T02:46:20.690128] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-17T02:46:20.924941] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:20.925274] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-17T02:46:21.490136] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-17T02:46:21.854956] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T02:46:22.290154] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-17T02:46:22.972843] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:46:23.090083] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-17T02:46:23.531913] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T02:46:23.538192] [INFO ] [REMOTE ] CF: Full fetch complete (74922 records). [2025-09-17T02:46:23.538381] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-17T02:46:23.894619] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-17T02:46:23.934498] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-17T02:46:23.934629] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-17T02:46:23.935438] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-17T02:46:23.935496] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-17T02:46:23.937050] [DEBUG] [LOCAL ] CF: Trimmed 74922 records to 52272 (keeping 200 days of data) [2025-09-17T02:46:24.192575] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:24.193448] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-17T02:46:24.280708] [DEBUG] [LOCAL ] CF: Primary data saved (52272 records). [2025-09-17T02:46:24.280879] [INFO ] [MAIN ] CF: Full history saved. [2025-09-17T02:46:24.280999] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CF took 39.8s. Estimated remaining: 4h 41m 41s. Rate: 6.9 symbols/min [2025-09-17T02:46:24.474050] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:24.504757] [DEBUG] [LOCAL ] CGAU: Loaded 31389 existing records from primary storage. [2025-09-17T02:46:24.504945] [INFO ] [MAIN ] CGAU: Loaded 31389 existing records. [2025-09-17T02:46:24.690308] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-17T02:46:24.717351] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:24.719775] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:46:24.718949] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-17T02:46:24.720065] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-17T02:46:24.728205] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-17T02:46:24.728309] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-17T02:46:25.081504] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:25.490219] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-17T02:46:26.290173] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-11. [2025-09-17T02:46:26.582434] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:46:26.772235] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T02:46:27.090151] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-17T02:46:27.793314] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:46:27.890093] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-17T02:46:28.387312] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:46:28.393729] [INFO ] [REMOTE ] CFG: Full fetch complete (77397 records). [2025-09-17T02:46:28.393871] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-17T02:46:28.695524] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-17T02:46:28.794678] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-17T02:46:28.794789] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-17T02:46:28.795576] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-17T02:46:28.795632] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-17T02:46:28.797277] [DEBUG] [LOCAL ] CFG: Trimmed 77397 records to 53621 (keeping 200 days of data) [2025-09-17T02:46:29.126709] [DEBUG] [LOCAL ] CFG: Primary data saved (53621 records). [2025-09-17T02:46:29.126874] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-17T02:46:29.126987] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 37.9s. Estimated remaining: 4h 41m 15s. Rate: 6.9 symbols/min [2025-09-17T02:46:29.305576] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:29.313865] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T02:46:29.319132] [DEBUG] [LOCAL ] CGV: Loaded 954 existing records from primary storage. [2025-09-17T02:46:29.319282] [INFO ] [MAIN ] CGV: Loaded 954 existing records. [2025-09-17T02:46:29.490397] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-17T02:46:29.520229] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:29.522293] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T02:46:29.522709] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-17T02:46:29.522799] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-17T02:46:29.529987] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-17T02:46:29.530069] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-17T02:46:29.888390] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:30.290226] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-11. [2025-09-17T02:46:30.683164] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T02:46:30.826475] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T02:46:31.090164] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-17T02:46:31.890128] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-17T02:46:32.539469] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T02:46:32.540986] [INFO ] [REMOTE ] CFND: Full fetch complete (2261 records). [2025-09-17T02:46:32.541208] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-17T02:46:32.693099] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-17T02:46:32.748497] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 28 unique days, need 200 days [2025-09-17T02:46:32.749561] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:46:32.750234] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:46:32.751495] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:46:32.751634] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-17T02:46:32.759125] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-17T02:46:32.759442] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-17T02:46:32.760271] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-17T02:46:32.760397] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CFND took 32.0s. Estimated remaining: 4h 40m 44s. Rate: 6.9 symbols/min [2025-09-17T02:46:32.929697] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:32.952822] [DEBUG] [LOCAL ] CHCT: Loaded 17905 existing records from primary storage. [2025-09-17T02:46:32.953011] [INFO ] [MAIN ] CHCT: Loaded 17905 existing records. [2025-09-17T02:46:33.136835] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:33.137107] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-17T02:46:33.137167] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-17T02:46:33.137834] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-17T02:46:33.137895] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-17T02:46:33.487751] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:33.490082] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-11. [2025-09-17T02:46:34.290146] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-17T02:46:34.342962] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:46:34.644066] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:46:35.090126] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-17T02:46:35.522184] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T02:46:35.895208] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-17T02:46:35.907047] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:46:36.366305] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T02:46:36.690190] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-17T02:46:37.490180] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-17T02:46:37.998988] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T02:46:38.003683] [INFO ] [REMOTE ] CFR: Full fetch complete (48226 records). [2025-09-17T02:46:38.003841] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-17T02:46:38.299381] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-17T02:46:38.397355] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-17T02:46:38.397492] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-17T02:46:38.398178] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-17T02:46:38.398282] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-17T02:46:38.399668] [DEBUG] [LOCAL ] CFR: Trimmed 48226 records to 33633 (keeping 200 days of data) [2025-09-17T02:46:38.625851] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T02:46:38.657039] [DEBUG] [LOCAL ] CFR: Primary data saved (33633 records). [2025-09-17T02:46:38.657229] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-17T02:46:38.657333] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CFR took 36.0s. Estimated remaining: 4h 40m 22s. Rate: 6.9 symbols/min [2025-09-17T02:46:38.829322] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:38.829547] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-09-17T02:46:38.829598] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-09-17T02:46:38.829736] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-17T02:46:38.829784] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-17T02:46:38.829832] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-09-17T02:46:38.829876] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-17T02:46:39.095341] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-17T02:46:39.196567] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:39.570778] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T02:46:39.587262] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:46:39.890150] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-11. [2025-09-17T02:46:40.690189] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-17T02:46:41.158570] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T02:46:41.490143] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-17T02:46:41.690931] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:46:42.290206] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-17T02:46:43.075759] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T02:46:43.090079] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-17T02:46:43.890171] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-17T02:46:44.078956] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:46:44.189984] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-17T02:46:44.585544] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:46:44.690119] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-17T02:46:45.490187] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-17T02:46:46.044560] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:46:46.290176] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-17T02:46:47.090210] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-17T02:46:47.257445] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T02:46:47.373582] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-17T02:46:47.794186] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:46:47.890165] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-17T02:46:48.370146] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T02:46:48.690199] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-17T02:46:49.490158] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-17T02:46:49.884115] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:46:50.290193] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-17T02:46:50.358604] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T02:46:51.090146] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-17T02:46:51.611272] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:46:51.890177] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-17T02:46:52.389445] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T02:46:52.502020] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T02:46:52.508158] [INFO ] [REMOTE ] CGAU: Full fetch complete (59922 records). [2025-09-17T02:46:52.508374] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-17T02:46:52.695070] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-17T02:46:52.910602] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-17T02:46:52.910730] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-17T02:46:52.911393] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-17T02:46:52.911450] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-17T02:46:52.912739] [DEBUG] [LOCAL ] CGAU: Trimmed 59922 records to 42404 (keeping 200 days of data) [2025-09-17T02:46:53.186172] [DEBUG] [LOCAL ] CGAU: Primary data saved (42404 records). [2025-09-17T02:46:53.186369] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-17T02:46:53.186470] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGAU took 28.9s. Estimated remaining: 4h 40m 40s. Rate: 6.9 symbols/min [2025-09-17T02:46:53.360772] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:53.373008] [DEBUG] [LOCAL ] CHE: Loaded 11229 existing records from primary storage. [2025-09-17T02:46:53.373164] [INFO ] [MAIN ] CHE: Loaded 11229 existing records. [2025-09-17T02:46:53.495292] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-17T02:46:53.554822] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:53.555120] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-17T02:46:53.555182] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-17T02:46:53.555552] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-17T02:46:53.555610] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-17T02:46:53.943904] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:54.031737] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T02:46:54.290131] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-17T02:46:54.611728] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:46:54.668206] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T02:46:54.669006] [INFO ] [REMOTE ] CGV: Full fetch complete (2278 records). [2025-09-17T02:46:54.669101] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-17T02:46:55.021791] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-17T02:46:55.021915] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-17T02:46:55.022051] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-17T02:46:55.022113] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-17T02:46:55.022484] [DEBUG] [LOCAL ] CGV: Trimmed 2278 records to 1441 (keeping 200 days of data) [2025-09-17T02:46:55.031872] [DEBUG] [LOCAL ] CGV: Primary data saved (1441 records). [2025-09-17T02:46:55.031968] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-17T02:46:55.032059] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CGV took 25.9s. Estimated remaining: 4h 40m 1s. Rate: 6.9 symbols/min [2025-09-17T02:46:55.095320] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-17T02:46:55.202677] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:55.237393] [DEBUG] [LOCAL ] CHGG: Loaded 35600 existing records from primary storage. [2025-09-17T02:46:55.237559] [INFO ] [MAIN ] CHGG: Loaded 35600 existing records. [2025-09-17T02:46:55.418126] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:55.418409] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-17T02:46:55.418476] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-17T02:46:55.419274] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-17T02:46:55.419349] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-17T02:46:55.778019] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:55.890120] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-11. [2025-09-17T02:46:56.243824] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T02:46:56.690126] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-17T02:46:57.266770] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T02:46:57.490102] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-17T02:46:57.844614] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T02:46:58.290127] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-17T02:46:59.090142] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-17T02:46:59.407610] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T02:46:59.449524] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T02:46:59.890154] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-17T02:47:00.690186] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-17T02:47:01.004771] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T02:47:01.194582] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T02:47:01.490146] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-17T02:47:02.241274] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:47:02.290124] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-17T02:47:03.090144] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-17T02:47:03.342609] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:47:03.401557] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:47:03.890144] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-11. [2025-09-17T02:47:04.695296] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-17T02:47:04.722944] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T02:47:04.746812] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T02:47:05.490148] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-17T02:47:06.290134] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-17T02:47:06.437702] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T02:47:06.497734] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:47:07.090147] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-17T02:47:07.698068] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:47:07.890121] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-17T02:47:08.440732] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T02:47:08.690149] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-17T02:47:09.489291] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T02:47:09.494703] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-17T02:47:09.528975] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:47:10.130677] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:47:10.290144] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-17T02:47:11.090136] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-17T02:47:11.325280] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:47:11.328329] [INFO ] [REMOTE ] CHCT: Full fetch complete (35078 records). [2025-09-17T02:47:11.328427] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-17T02:47:11.769327] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-17T02:47:11.769444] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-17T02:47:11.769943] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-17T02:47:11.770006] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-17T02:47:11.771072] [DEBUG] [LOCAL ] CHCT: Trimmed 35078 records to 24153 (keeping 200 days of data) [2025-09-17T02:47:11.892160] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-17T02:47:11.928061] [DEBUG] [LOCAL ] CHCT: Primary data saved (24153 records). [2025-09-17T02:47:11.928215] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-17T02:47:11.928322] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 39.2s. Estimated remaining: 4h 40m 29s. Rate: 6.9 symbols/min [2025-09-17T02:47:12.101131] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:12.123679] [DEBUG] [LOCAL ] CHH: Loaded 23518 existing records from primary storage. [2025-09-17T02:47:12.123850] [INFO ] [MAIN ] CHH: Loaded 23518 existing records. [2025-09-17T02:47:12.308901] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:12.309164] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-17T02:47:12.309225] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-17T02:47:12.310046] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-17T02:47:12.310114] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-17T02:47:12.690502] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-17T02:47:12.695228] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:12.729281] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T02:47:12.784488] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T02:47:13.490166] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-17T02:47:14.290154] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-17T02:47:14.447486] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:47:14.627574] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T02:47:15.090138] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-17T02:47:15.890117] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-11. [2025-09-17T02:47:16.118617] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:47:16.690135] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-17T02:47:16.885899] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T02:47:17.216400] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:47:17.490163] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-17T02:47:18.290160] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-17T02:47:18.640069] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:47:19.058809] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:47:19.065136] [INFO ] [REMOTE ] CHD: Full fetch complete (74136 records). [2025-09-17T02:47:19.065340] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-17T02:47:19.096745] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-17T02:47:19.490065] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-17T02:47:19.490513] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-17T02:47:19.491083] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:47:19.491996] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-17T02:47:19.497968] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-17T02:47:19.502266] [DEBUG] [LOCAL ] CHD: Trimmed 74136 records to 51984 (keeping 200 days of data) [2025-09-17T02:47:19.830858] [DEBUG] [LOCAL ] CHD: Primary data saved (51984 records). [2025-09-17T02:47:19.831032] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-17T02:47:19.831131] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHD took 41.2s. Estimated remaining: 4h 40m 16s. Rate: 6.9 symbols/min [2025-09-17T02:47:19.895445] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-17T02:47:20.009811] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:20.020356] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T02:47:20.038442] [DEBUG] [LOCAL ] CHMI: Loaded 15316 existing records from primary storage. [2025-09-17T02:47:20.038584] [INFO ] [MAIN ] CHMI: Loaded 15316 existing records. [2025-09-17T02:47:20.214787] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:20.215029] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-17T02:47:20.215087] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-17T02:47:20.215535] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-17T02:47:20.215593] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-17T02:47:20.569710] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:20.690193] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-17T02:47:21.490202] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-17T02:47:21.640448] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:47:21.674587] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T02:47:22.290184] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-11. [2025-09-17T02:47:22.860789] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:47:23.090132] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-17T02:47:23.369715] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T02:47:23.890195] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-17T02:47:24.236373] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T02:47:24.690171] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-17T02:47:24.850594] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T02:47:25.490137] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-17T02:47:25.993523] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T02:47:26.279214] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T02:47:26.290069] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-17T02:47:27.090138] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-17T02:47:27.288716] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T02:47:27.890146] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-17T02:47:28.181878] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:47:28.690170] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-17T02:47:29.147966] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T02:47:29.418987] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T02:47:29.490078] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-17T02:47:30.290185] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-17T02:47:30.545236] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:47:31.090138] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-17T02:47:31.890117] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-17T02:47:31.907840] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:47:31.913800] [INFO ] [REMOTE ] CHGG: Full fetch complete (70700 records). [2025-09-17T02:47:31.913982] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-17T02:47:32.278923] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T02:47:32.335055] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-17T02:47:32.335163] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-17T02:47:32.336071] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-17T02:47:32.336176] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-17T02:47:32.339285] [DEBUG] [LOCAL ] CHGG: Trimmed 70700 records to 47838 (keeping 200 days of data) [2025-09-17T02:47:32.613733] [DEBUG] [LOCAL ] CHGG: Primary data saved (47838 records). [2025-09-17T02:47:32.613885] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-17T02:47:32.614031] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHGG took 37.6s. Estimated remaining: 4h 40m 26s. Rate: 6.9 symbols/min [2025-09-17T02:47:32.690147] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-17T02:47:32.896262] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T02:47:32.898778] [INFO ] [REMOTE ] CHE: Full fetch complete (19162 records). [2025-09-17T02:47:32.898863] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-17T02:47:33.258218] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-17T02:47:33.258318] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-17T02:47:33.258637] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-17T02:47:33.258699] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-17T02:47:33.259303] [DEBUG] [LOCAL ] CHE: Trimmed 19162 records to 14516 (keeping 200 days of data) [2025-09-17T02:47:33.357320] [DEBUG] [LOCAL ] CHE: Primary data saved (14516 records). [2025-09-17T02:47:33.357588] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-17T02:47:33.357788] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHE took 40.2s. Estimated remaining: 4h 39m 42s. Rate: 6.9 symbols/min [2025-09-17T02:47:33.490176] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-17T02:47:33.742111] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:47:34.290183] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-17T02:47:34.717985] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T02:47:35.090128] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-17T02:47:35.632458] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T02:47:35.890153] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-17T02:47:36.194833] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T02:47:36.690180] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-17T02:47:37.012382] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T02:47:37.490150] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-17T02:47:37.768336] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T02:47:38.290188] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-17T02:47:38.472316] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:47:39.090108] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-17T02:47:39.464867] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T02:47:39.877547] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:47:39.881486] [INFO ] [REMOTE ] CHH: Full fetch complete (45960 records). [2025-09-17T02:47:39.881635] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-17T02:47:39.914711] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-17T02:47:40.263976] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-17T02:47:40.264089] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-17T02:47:40.264717] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-17T02:47:40.264823] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-17T02:47:40.265931] [DEBUG] [LOCAL ] CHH: Trimmed 45960 records to 32484 (keeping 200 days of data) [2025-09-17T02:47:40.474994] [DEBUG] [LOCAL ] CHH: Primary data saved (32484 records). [2025-09-17T02:47:40.475159] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-17T02:47:40.475278] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHH took 28.5s. Estimated remaining: 4h 39m 26s. Rate: 6.9 symbols/min [2025-09-17T02:47:41.035260] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T02:47:41.039772] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-17T02:47:42.065197] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:47:42.068293] [INFO ] [REMOTE ] CHMI: Full fetch complete (31516 records). [2025-09-17T02:47:42.068410] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-17T02:47:42.435952] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-17T02:47:42.436061] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-17T02:47:42.436534] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-17T02:47:42.436615] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-17T02:47:42.438152] [DEBUG] [LOCAL ] CHMI: Trimmed 31516 records to 22006 (keeping 200 days of data) [2025-09-17T02:47:42.571860] [DEBUG] [LOCAL ] CHMI: Primary data saved (22006 records). [2025-09-17T02:47:42.572034] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-17T02:47:42.572162] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHMI took 22.7s. Estimated remaining: 4h 38m 49s. Rate: 6.9 symbols/min [2025-09-17T02:47:43.120054] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.183815] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.271399] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.250020] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.279289] [DEBUG] [LOCAL ] CHN: Loaded 3643 existing records from primary storage. [2025-09-17T02:47:43.279438] [INFO ] [MAIN ] CHN: Loaded 3643 existing records. [2025-09-17T02:47:43.410354] [DEBUG] [LOCAL ] CHT: Loaded 14367 existing records from primary storage. [2025-09-17T02:47:43.410719] [INFO ] [MAIN ] CHT: Loaded 14367 existing records. [2025-09-17T02:47:43.617988] [DEBUG] [LOCAL ] CHPT: Loaded 36364 existing records from primary storage. [2025-09-17T02:47:43.617030] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:43.644106] [INFO ] [MAIN ] CHPT: Loaded 36364 existing records. [2025-09-17T02:47:43.689549] [DEBUG] [LOCAL ] CHWY: Loaded 40012 existing records from primary storage. [2025-09-17T02:47:43.689623] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-17T02:47:43.749998] [INFO ] [MAIN ] CHWY: Loaded 40012 existing records. [2025-09-17T02:47:43.744756] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:43.764313] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-17T02:47:43.788890] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-17T02:47:43.783709] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-17T02:47:43.818545] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-17T02:47:43.828873] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-17T02:47:43.854697] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-17T02:47:43.897423] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-17T02:47:44.261001] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:44.299506] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:44.329520] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-17T02:47:44.342669] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-17T02:47:44.407825] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-17T02:47:44.407875] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-17T02:47:44.546493] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-17T02:47:44.579458] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-17T02:47:44.579375] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-17T02:47:44.634957] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-17T02:47:44.999634] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:44.996815] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:45.060424] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-11. [2025-09-17T02:47:45.070784] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-11. [2025-09-17T02:47:45.526155] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:45.546077] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-11. [2025-09-17T02:47:45.566808] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:45.567158] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-11. [2025-09-17T02:47:45.655562] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:47:45.657472] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-17T02:47:46.253304] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:47:46.257597] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-17T02:47:46.289397] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:47:46.291244] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-17T02:47:46.950702] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:47:47.090094] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-17T02:47:47.304143] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:47:47.497250] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T02:47:47.794201] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T02:47:47.793497] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-11 (2.25 seconds). [2025-09-17T02:47:47.890085] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-17T02:47:48.690175] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-17T02:47:49.150057] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T02:47:49.490175] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-17T02:47:50.041044] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T02:47:50.290150] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-17T02:47:50.739075] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T02:47:51.090114] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-17T02:47:51.705590] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T02:47:51.890159] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-17T02:47:52.095395] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:47:52.690127] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-17T02:47:53.490154] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-17T02:47:53.865780] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T02:47:54.108211] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T02:47:54.290167] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-17T02:47:54.762397] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T02:47:54.892377] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:47:55.090140] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-17T02:47:55.890135] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-17T02:47:56.504013] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T02:47:56.690139] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-17T02:47:57.174298] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T02:47:57.211564] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T02:47:57.490162] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-17T02:47:58.171251] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:47:58.172898] [INFO ] [REMOTE ] CHN: Full fetch complete (7604 records). [2025-09-17T02:47:58.173031] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-17T02:47:58.295352] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-17T02:47:58.620419] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-17T02:47:58.620561] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-17T02:47:58.620853] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-17T02:47:58.620913] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-17T02:47:58.621525] [DEBUG] [LOCAL ] CHN: Trimmed 7604 records to 4839 (keeping 200 days of data) [2025-09-17T02:47:58.653632] [DEBUG] [LOCAL ] CHN: Primary data saved (4839 records). [2025-09-17T02:47:58.653829] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-17T02:47:58.653947] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHN took 16.1s. Estimated remaining: 4h 39m 12s. Rate: 6.9 symbols/min [2025-09-17T02:47:58.830823] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:58.874051] [DEBUG] [LOCAL ] CI: Loaded 37304 existing records from primary storage. [2025-09-17T02:47:58.874234] [INFO ] [MAIN ] CI: Loaded 37304 existing records. [2025-09-17T02:47:59.057943] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:59.058260] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-17T02:47:59.058331] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-17T02:47:59.059269] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-17T02:47:59.059334] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-17T02:47:59.095449] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-17T02:47:59.428623] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:59.890130] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-11. [2025-09-17T02:47:59.959126] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T02:48:00.213759] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T02:48:00.690125] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-17T02:48:01.451374] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:48:01.490097] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-17T02:48:02.080734] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T02:48:02.290132] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-17T02:48:03.090164] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-17T02:48:03.890133] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-17T02:48:04.274454] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-17T02:48:04.690119] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-17T02:48:05.218698] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T02:48:05.243801] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:48:05.399502] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-17T02:48:05.490102] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-17T02:48:06.290137] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-17T02:48:06.548977] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T02:48:07.090106] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-17T02:48:07.408159] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:48:07.592556] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T02:48:07.890133] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-17T02:48:08.690087] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-17T02:48:08.789386] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T02:48:08.926040] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T02:48:09.490134] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-17T02:48:10.290280] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-17T02:48:10.658200] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T02:48:11.090167] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-17T02:48:11.235031] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:48:11.804869] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:48:11.890104] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-17T02:48:12.690164] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-17T02:48:12.834299] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T02:48:13.490178] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-17T02:48:13.721581] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T02:48:13.950005] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:48:14.290133] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-17T02:48:15.090177] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-17T02:48:15.590049] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T02:48:15.890119] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-17T02:48:16.164719] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:48:16.228980] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T02:48:16.690140] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-17T02:48:17.490145] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-17T02:48:18.290097] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-17T02:48:18.477464] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-17T02:48:18.706367] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T02:48:19.090105] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-17T02:48:19.180414] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T02:48:19.183185] [INFO ] [REMOTE ] CHT: Full fetch complete (27498 records). [2025-09-17T02:48:19.183279] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-17T02:48:19.577151] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-17T02:48:19.577266] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-17T02:48:19.577771] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-17T02:48:19.577838] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-17T02:48:19.578676] [DEBUG] [LOCAL ] CHT: Trimmed 27498 records to 19821 (keeping 200 days of data) [2025-09-17T02:48:19.708274] [DEBUG] [LOCAL ] CHT: Primary data saved (19821 records). [2025-09-17T02:48:19.708489] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-17T02:48:19.708614] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHT took 37.1s. Estimated remaining: 4h 39m 58s. Rate: 6.9 symbols/min [2025-09-17T02:48:19.923696] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-17T02:48:19.926207] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:19.940676] [DEBUG] [LOCAL ] CIA: Loaded 12780 existing records from primary storage. [2025-09-17T02:48:19.940823] [INFO ] [MAIN ] CIA: Loaded 12780 existing records. [2025-09-17T02:48:20.125706] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:20.125955] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-17T02:48:20.126018] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-17T02:48:20.126406] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-17T02:48:20.126463] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-17T02:48:20.490147] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:20.521601] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-17T02:48:20.619981] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:48:20.690093] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-17T02:48:21.490108] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-17T02:48:21.794452] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:48:22.290102] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-17T02:48:22.736280] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-17T02:48:22.743183] [INFO ] [REMOTE ] CHWY: Full fetch complete (77505 records). [2025-09-17T02:48:22.743348] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-17T02:48:23.092484] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-11. [2025-09-17T02:48:23.146370] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-17T02:48:23.146499] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-17T02:48:23.147475] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-17T02:48:23.147549] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-17T02:48:23.149231] [DEBUG] [LOCAL ] CHWY: Trimmed 77505 records to 53626 (keeping 200 days of data) [2025-09-17T02:48:23.477590] [DEBUG] [LOCAL ] CHWY: Primary data saved (53626 records). [2025-09-17T02:48:23.477818] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-17T02:48:23.477937] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CHWY took 40.9s. Estimated remaining: 4h 39m 27s. Rate: 6.9 symbols/min [2025-09-17T02:48:23.650367] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:23.672910] [DEBUG] [LOCAL ] CIB: Loaded 21993 existing records from primary storage. [2025-09-17T02:48:23.673103] [INFO ] [MAIN ] CIB: Loaded 21993 existing records. [2025-09-17T02:48:23.854405] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:23.854844] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-17T02:48:23.855006] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-17T02:48:23.866467] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-17T02:48:23.884127] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-17T02:48:23.965752] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-17T02:48:24.028945] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-17T02:48:24.064716] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T02:48:24.308220] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:24.338346] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T02:48:24.690121] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-17T02:48:25.490182] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-17T02:48:25.686396] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:48:26.290139] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-11. [2025-09-17T02:48:26.359283] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T02:48:26.366053] [INFO ] [REMOTE ] CI: Full fetch complete (72403 records). [2025-09-17T02:48:26.373757] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-17T02:48:26.375087] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T02:48:26.776333] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-17T02:48:26.776445] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-17T02:48:26.777226] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-17T02:48:26.777286] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-17T02:48:26.778743] [DEBUG] [LOCAL ] CI: Trimmed 72403 records to 49995 (keeping 200 days of data) [2025-09-17T02:48:27.090136] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-17T02:48:27.108402] [DEBUG] [LOCAL ] CI: Primary data saved (49995 records). [2025-09-17T02:48:27.108547] [INFO ] [MAIN ] CI: Full history saved. [2025-09-17T02:48:27.108659] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CI took 28.5s. Estimated remaining: 4h 38m 57s. Rate: 6.9 symbols/min [2025-09-17T02:48:27.277958] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:27.278163] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-17T02:48:27.278211] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-17T02:48:27.278316] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-17T02:48:27.278378] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-17T02:48:27.278445] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-17T02:48:27.278488] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-17T02:48:27.636807] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:27.654223] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T02:48:27.890155] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-17T02:48:28.567778] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T02:48:28.572602] [INFO ] [REMOTE ] CHPT: Full fetch complete (73998 records). [2025-09-17T02:48:28.572753] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-17T02:48:28.695300] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-17T02:48:28.977600] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-17T02:48:28.977762] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-17T02:48:28.991381] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-17T02:48:28.997028] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-17T02:48:28.996934] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:48:29.003500] [DEBUG] [LOCAL ] CHPT: Trimmed 73998 records to 49915 (keeping 200 days of data) [2025-09-17T02:48:29.297062] [DEBUG] [LOCAL ] CHPT: Primary data saved (49915 records). [2025-09-17T02:48:29.297223] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-17T02:48:29.297319] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CHPT took 46.7s. Estimated remaining: 4h 38m 20s. Rate: 6.9 symbols/min [2025-09-17T02:48:29.467288] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:29.492750] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-17T02:48:29.510449] [DEBUG] [LOCAL ] CIEN: Loaded 38661 existing records from primary storage. [2025-09-17T02:48:29.510654] [INFO ] [MAIN ] CIEN: Loaded 38661 existing records. [2025-09-17T02:48:29.698113] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:29.698711] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-17T02:48:29.698776] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-17T02:48:29.699754] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-17T02:48:29.699815] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-17T02:48:29.859935] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:48:30.072164] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:30.290161] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-11. [2025-09-17T02:48:30.763495] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T02:48:30.795906] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T02:48:31.090144] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-11. [2025-09-17T02:48:31.890419] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-17T02:48:32.695190] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-17T02:48:32.721729] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:48:32.723605] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:48:33.490129] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-17T02:48:33.939988] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:48:34.124925] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:48:34.290141] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-17T02:48:34.580226] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T02:48:35.090149] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-17T02:48:35.890168] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-17T02:48:36.340952] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:48:36.690147] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-17T02:48:36.870258] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:48:37.490190] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-17T02:48:37.684530] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:48:37.793078] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-17T02:48:38.290164] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-17T02:48:39.044070] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T02:48:39.090130] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-17T02:48:39.350692] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-17T02:48:39.890162] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-17T02:48:40.690153] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-17T02:48:40.907109] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T02:48:41.490139] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-17T02:48:41.979878] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:48:42.290146] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-17T02:48:42.468889] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:48:43.090135] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-17T02:48:43.208380] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T02:48:43.660175] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T02:48:43.890132] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-17T02:48:44.690111] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-17T02:48:45.029440] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T02:48:45.490190] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-17T02:48:46.043310] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:48:46.290229] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-17T02:48:47.090099] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-17T02:48:47.205357] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:48:47.414509] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T02:48:47.428048] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T02:48:47.890137] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-17T02:48:48.690130] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-17T02:48:48.940587] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:48:49.490156] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-17T02:48:49.928493] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:48:49.990430] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:48:49.992984] [INFO ] [REMOTE ] CIA: Full fetch complete (22924 records). [2025-09-17T02:48:49.993107] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-17T02:48:50.295253] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-17T02:48:50.463297] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-17T02:48:50.463452] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-17T02:48:50.464185] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-17T02:48:50.464262] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-17T02:48:50.465636] [DEBUG] [LOCAL ] CIA: Trimmed 22924 records to 16768 (keeping 200 days of data) [2025-09-17T02:48:50.617232] [DEBUG] [LOCAL ] CIA: Primary data saved (16768 records). [2025-09-17T02:48:50.617762] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-17T02:48:50.617909] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CIA took 30.9s. Estimated remaining: 4h 39m 6s. Rate: 6.9 symbols/min [2025-09-17T02:48:50.868274] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:50.875550] [DEBUG] [LOCAL ] CIF: Loaded 2981 existing records from primary storage. [2025-09-17T02:48:50.875761] [INFO ] [MAIN ] CIF: Loaded 2981 existing records. [2025-09-17T02:48:51.095441] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-17T02:48:51.134687] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:51.134981] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-17T02:48:51.135054] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-17T02:48:51.135438] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-17T02:48:51.135509] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-17T02:48:51.529397] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:51.796982] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:48:51.890082] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-17T02:48:52.450061] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T02:48:52.690143] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-17T02:48:53.490106] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-17T02:48:53.495096] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T02:48:53.500319] [INFO ] [REMOTE ] CIB: Full fetch complete (44011 records). [2025-09-17T02:48:53.500459] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-17T02:48:53.884525] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-17T02:48:53.884730] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-17T02:48:53.885318] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-17T02:48:53.885393] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-17T02:48:53.886757] [DEBUG] [LOCAL ] CIB: Trimmed 44011 records to 31191 (keeping 200 days of data) [2025-09-17T02:48:54.012278] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:48:54.018146] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T02:48:54.126510] [DEBUG] [LOCAL ] CIB: Primary data saved (31191 records). [2025-09-17T02:48:54.126707] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-17T02:48:54.126804] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CIB took 30.6s. Estimated remaining: 4h 38m 35s. Rate: 6.9 symbols/min [2025-09-17T02:48:54.291226] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-17T02:48:54.316110] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:54.353522] [DEBUG] [LOCAL ] CIG: Loaded 32909 existing records from primary storage. [2025-09-17T02:48:54.353726] [INFO ] [MAIN ] CIG: Loaded 32909 existing records. [2025-09-17T02:48:54.546713] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:54.546957] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-17T02:48:54.547016] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-17T02:48:54.547877] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-17T02:48:54.547942] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-17T02:48:54.705631] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T02:48:54.930207] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:55.090154] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-11. [2025-09-17T02:48:55.767071] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:48:55.890104] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-11. [2025-09-17T02:48:56.690142] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-17T02:48:57.360488] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T02:48:57.490137] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-17T02:48:57.831585] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T02:48:57.832361] [INFO ] [REMOTE ] CICB: Full fetch complete (2169 records). [2025-09-17T02:48:57.832442] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-17T02:48:58.014745] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T02:48:58.014961] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:48:58.015031] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:48:58.015095] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-17T02:48:58.015185] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-17T02:48:58.015255] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-17T02:48:58.015343] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-17T02:48:58.015436] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CICB took 30.9s. Estimated remaining: 4h 38m 5s. Rate: 6.9 symbols/min [2025-09-17T02:48:58.190110] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:58.202039] [DEBUG] [LOCAL ] CII: Loaded 10219 existing records from primary storage. [2025-09-17T02:48:58.202256] [INFO ] [MAIN ] CII: Loaded 10219 existing records. [2025-09-17T02:48:58.295193] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-17T02:48:58.394717] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:58.395331] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-17T02:48:58.395508] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-17T02:48:58.396004] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-17T02:48:58.396143] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-17T02:48:58.737801] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T02:48:58.831320] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:59.090131] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-17T02:48:59.761892] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T02:48:59.876790] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:48:59.890087] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-17T02:49:00.690129] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-17T02:49:01.308744] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T02:49:01.371176] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:49:01.490134] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-11. [2025-09-17T02:49:02.290137] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-17T02:49:02.462502] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T02:49:02.790127] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T02:49:03.090140] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-17T02:49:03.890135] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-17T02:49:04.690150] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-17T02:49:04.907271] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:49:04.937002] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:49:05.490135] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-17T02:49:05.534856] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T02:49:06.290139] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-17T02:49:07.090136] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-17T02:49:07.402999] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T02:49:07.749196] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:49:07.798620] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T02:49:07.890137] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-17T02:49:08.541715] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T02:49:08.690122] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-17T02:49:09.494465] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-17T02:49:09.495630] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T02:49:10.176480] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T02:49:10.290118] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-17T02:49:11.090118] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-17T02:49:11.700123] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:49:11.890141] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-17T02:49:12.191243] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T02:49:12.690184] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-17T02:49:13.490139] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-17T02:49:13.738514] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T02:49:13.761171] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T02:49:14.290172] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-17T02:49:15.002617] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:49:15.090140] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-17T02:49:15.132994] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T02:49:15.890133] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-17T02:49:16.206420] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:49:16.690145] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-17T02:49:16.892534] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:49:17.490177] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-17T02:49:18.129253] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:49:18.290128] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-17T02:49:18.443534] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:49:18.450026] [INFO ] [REMOTE ] CIEN: Full fetch complete (75322 records). [2025-09-17T02:49:18.450176] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-17T02:49:18.853896] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-17T02:49:18.854053] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-17T02:49:18.855012] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-17T02:49:18.855090] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-17T02:49:18.856882] [DEBUG] [LOCAL ] CIEN: Trimmed 75322 records to 52112 (keeping 200 days of data) [2025-09-17T02:49:19.090688] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-17T02:49:19.179491] [DEBUG] [LOCAL ] CIEN: Primary data saved (52112 records). [2025-09-17T02:49:19.179705] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-17T02:49:19.179836] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIEN took 49.9s. Estimated remaining: 4h 38m 50s. Rate: 6.9 symbols/min [2025-09-17T02:49:19.381371] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:19.389787] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T02:49:19.417947] [DEBUG] [LOCAL ] CIM: Loaded 26648 existing records from primary storage. [2025-09-17T02:49:19.418141] [INFO ] [MAIN ] CIM: Loaded 26648 existing records. [2025-09-17T02:49:19.595604] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:19.595938] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-17T02:49:19.596016] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-17T02:49:19.596782] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-17T02:49:19.596858] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-17T02:49:19.895249] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-17T02:49:19.950914] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:20.516979] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:49:20.518177] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T02:49:20.690104] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-11. [2025-09-17T02:49:21.490145] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-17T02:49:21.840085] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:49:22.194926] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T02:49:22.290090] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-17T02:49:23.090153] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-17T02:49:23.678702] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T02:49:23.823459] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:49:23.890111] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-17T02:49:24.690131] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-17T02:49:24.713525] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T02:49:24.715978] [INFO ] [REMOTE ] CII: Full fetch complete (23079 records). [2025-09-17T02:49:24.716080] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-17T02:49:25.086002] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T02:49:25.086081] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-17T02:49:25.087147] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-17T02:49:25.087213] [INFO ] [REMOTE ] CIF: Full fetch complete (6673 records). [2025-09-17T02:49:25.087859] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-17T02:49:25.087411] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-17T02:49:25.087976] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-17T02:49:25.188816] [DEBUG] [LOCAL ] CII: Trimmed 23079 records to 15733 (keeping 200 days of data) [2025-09-17T02:49:25.497807] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-17T02:49:25.532564] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-17T02:49:25.534697] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-17T02:49:25.537419] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-17T02:49:25.541390] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-17T02:49:25.544972] [DEBUG] [LOCAL ] CIF: Trimmed 6673 records to 4548 (keeping 200 days of data) [2025-09-17T02:49:25.575601] [DEBUG] [LOCAL ] CII: Primary data saved (15733 records). [2025-09-17T02:49:25.576730] [INFO ] [MAIN ] CII: Full history saved. [2025-09-17T02:49:25.577804] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CII took 27.6s. Estimated remaining: 4h 38m 31s. Rate: 6.9 symbols/min [2025-09-17T02:49:25.670382] [DEBUG] [LOCAL ] CIF: Primary data saved (4548 records). [2025-09-17T02:49:25.680601] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-17T02:49:25.686344] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIF took 35.1s. Estimated remaining: 4h 37m 46s. Rate: 6.9 symbols/min [2025-09-17T02:49:25.836815] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:25.930610] [DEBUG] [LOCAL ] CIMN: Loaded 1937 existing records from primary storage. [2025-09-17T02:49:25.932214] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:25.932725] [INFO ] [MAIN ] CIMN: Loaded 1937 existing records. [2025-09-17T02:49:26.036104] [DEBUG] [LOCAL ] CIMO: Loaded 2059 existing records from primary storage. [2025-09-17T02:49:26.057087] [INFO ] [MAIN ] CIMO: Loaded 2059 existing records. [2025-09-17T02:49:26.194029] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:26.232058] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-17T02:49:26.237672] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-17T02:49:26.253181] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-17T02:49:26.282774] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-17T02:49:26.305893] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-17T02:49:26.311364] [WARN ] [MAIN ] CIMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:26.333793] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-17T02:49:26.369069] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-17T02:49:26.394697] [DEBUG] [LOCAL ] CIMO: Deleted primary data file. [2025-09-17T02:49:26.415471] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-17T02:49:26.983527] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:27.045726] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:27.067107] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:49:27.090080] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-17T02:49:27.890133] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-11. [2025-09-17T02:49:27.935044] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T02:49:28.356656] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T02:49:28.642605] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T02:49:28.690089] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-17T02:49:29.165994] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T02:49:29.490170] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-11. [2025-09-17T02:49:30.033582] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T02:49:30.290164] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-17T02:49:30.842820] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:49:31.090169] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-17T02:49:31.609273] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T02:49:31.890143] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-17T02:49:32.360009] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T02:49:32.690196] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-17T02:49:33.490182] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-17T02:49:34.295311] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-17T02:49:34.313416] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T02:49:34.986179] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T02:49:35.010969] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:49:35.090089] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-17T02:49:35.890149] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-17T02:49:36.517348] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:49:36.690123] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-17T02:49:37.023162] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T02:49:37.490143] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-17T02:49:37.576341] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T02:49:38.015538] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T02:49:38.290147] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-17T02:49:38.885455] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T02:49:39.090141] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-17T02:49:39.890152] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-17T02:49:40.482162] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:49:40.487523] [INFO ] [REMOTE ] CIG: Full fetch complete (60579 records). [2025-09-17T02:49:40.487717] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-17T02:49:40.695370] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-17T02:49:40.875351] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-17T02:49:40.875462] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-17T02:49:40.876210] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-17T02:49:40.876269] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-17T02:49:40.877552] [DEBUG] [LOCAL ] CIG: Trimmed 60579 records to 43581 (keeping 200 days of data) [2025-09-17T02:49:41.126569] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T02:49:41.163390] [DEBUG] [LOCAL ] CIG: Primary data saved (43581 records). [2025-09-17T02:49:41.163581] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-17T02:49:41.163707] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CIG took 47.0s. Estimated remaining: 4h 38m 6s. Rate: 6.9 symbols/min [2025-09-17T02:49:41.274737] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:49:41.348692] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:41.363471] [DEBUG] [LOCAL ] CINT: Loaded 13656 existing records from primary storage. [2025-09-17T02:49:41.363665] [INFO ] [MAIN ] CINT: Loaded 13656 existing records. [2025-09-17T02:49:41.495327] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-17T02:49:41.552086] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:41.552429] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-17T02:49:41.552495] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-17T02:49:41.552913] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-17T02:49:41.552984] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-17T02:49:41.913109] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:41.917280] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T02:49:42.290157] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-11. [2025-09-17T02:49:42.823491] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T02:49:43.090166] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-17T02:49:43.564020] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T02:49:43.890402] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-17T02:49:44.690164] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-17T02:49:45.264091] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T02:49:45.490129] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-17T02:49:45.555863] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:49:45.593758] [DEBUG] [REMOTE ] CIMN: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T02:49:45.594067] [WARN ] [REMOTE ] CIMN: No data returned for month 2025-07 [2025-09-17T02:49:46.290144] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-17T02:49:46.726424] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T02:49:47.090148] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-17T02:49:47.442307] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T02:49:47.443157] [INFO ] [REMOTE ] CIMN: Full fetch complete (3603 records). [2025-09-17T02:49:47.443240] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-17T02:49:47.628590] [WARN ] [VALIDATOR ] CIMN: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T02:49:47.628840] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:49:47.628898] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:49:47.628940] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-17T02:49:47.629000] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-09-17T02:49:47.629048] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-09-17T02:49:47.629392] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-09-17T02:49:47.629489] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMN took 22.1s. Estimated remaining: 4h 37m 48s. Rate: 6.9 symbols/min [2025-09-17T02:49:47.808489] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:47.824288] [DEBUG] [LOCAL ] CIO: Loaded 14659 existing records from primary storage. [2025-09-17T02:49:47.824480] [INFO ] [MAIN ] CIO: Loaded 14659 existing records. [2025-09-17T02:49:47.895251] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-17T02:49:48.017748] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:48.018020] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-17T02:49:48.018079] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-17T02:49:48.018680] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-17T02:49:48.018745] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-17T02:49:48.396796] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:48.690187] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-11. [2025-09-17T02:49:49.127699] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:49:49.490219] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-17T02:49:49.578679] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T02:49:50.290152] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-17T02:49:50.455989] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T02:49:51.090130] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-17T02:49:51.696795] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T02:49:51.890134] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-17T02:49:52.140513] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:49:52.690131] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-17T02:49:53.099070] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:49:53.490150] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-17T02:49:53.755853] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:49:54.290371] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-17T02:49:54.843149] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:49:54.847766] [INFO ] [REMOTE ] CIM: Full fetch complete (54260 records). [2025-09-17T02:49:54.847937] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-17T02:49:55.096237] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-17T02:49:55.233902] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-17T02:49:55.234010] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-17T02:49:55.234716] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-17T02:49:55.234778] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-17T02:49:55.235990] [DEBUG] [LOCAL ] CIM: Trimmed 54260 records to 37164 (keeping 200 days of data) [2025-09-17T02:49:55.451892] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:49:55.479970] [DEBUG] [LOCAL ] CIM: Primary data saved (37164 records). [2025-09-17T02:49:55.480138] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-17T02:49:55.480271] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIM took 36.3s. Estimated remaining: 4h 37m 36s. Rate: 6.9 symbols/min [2025-09-17T02:49:55.657408] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:55.677429] [DEBUG] [LOCAL ] CION: Loaded 20480 existing records from primary storage. [2025-09-17T02:49:55.677633] [INFO ] [MAIN ] CION: Loaded 20480 existing records. [2025-09-17T02:49:55.859973] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:55.860238] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-17T02:49:55.860321] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-17T02:49:55.860947] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-17T02:49:55.861022] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-17T02:49:55.895260] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-17T02:49:56.218317] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:56.235408] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:49:56.646109] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T02:49:56.690099] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-11. [2025-09-17T02:49:57.490184] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-17T02:49:57.925109] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:49:57.940016] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T02:49:58.290125] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-17T02:49:59.090127] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-17T02:49:59.356721] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T02:49:59.659169] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T02:49:59.890136] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-17T02:50:00.410934] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:50:00.690130] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-17T02:50:01.490150] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-17T02:50:01.833174] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T02:50:02.290116] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-17T02:50:02.607852] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:50:03.090211] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-17T02:50:03.473283] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:50:03.730363] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T02:50:03.890167] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-17T02:50:04.490148] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T02:50:04.491540] [INFO ] [REMOTE ] CIMO: Full fetch complete (5418 records). [2025-09-17T02:50:04.491691] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-17T02:50:04.689317] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T02:50:04.689571] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:50:04.689630] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:50:04.689700] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-17T02:50:04.689774] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-17T02:50:04.689826] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-17T02:50:04.690116] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-17T02:50:04.690210] [DEBUG] [LOCAL ] CIMO: Deleted derivative data file. [2025-09-17T02:50:04.691440] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMO took 39.0s. Estimated remaining: 4h 37m 29s. Rate: 6.9 symbols/min [2025-09-17T02:50:04.869871] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:04.870107] [DEBUG] [LOCAL ] CIVI: No existing data file found in primary storage. [2025-09-17T02:50:04.870165] [WARN ] [MAIN ] CIVI: No existing data found, performing full refresh instead. [2025-09-17T02:50:04.870283] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-17T02:50:04.870339] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-17T02:50:04.870396] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-17T02:50:04.870451] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-17T02:50:05.225221] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:05.490147] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-17T02:50:06.137416] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:50:06.290134] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-17T02:50:06.536090] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:50:07.090119] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-11. [2025-09-17T02:50:07.288325] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T02:50:07.890172] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-17T02:50:08.690165] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-17T02:50:08.750057] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:50:09.304266] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:50:09.323041] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T02:50:09.490127] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-17T02:50:10.290093] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-17T02:50:10.521489] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T02:50:11.090147] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-17T02:50:11.357764] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:50:11.890124] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-17T02:50:12.495899] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:50:12.690113] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-17T02:50:13.029908] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:50:13.490127] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-17T02:50:14.290174] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-17T02:50:14.519527] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:50:14.827095] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:50:15.090142] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-17T02:50:15.218754] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T02:50:15.221762] [INFO ] [REMOTE ] CINT: Full fetch complete (25410 records). [2025-09-17T02:50:15.221883] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-17T02:50:15.591018] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-17T02:50:15.591128] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-17T02:50:15.591556] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-17T02:50:15.591610] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-17T02:50:15.592375] [DEBUG] [LOCAL ] CINT: Trimmed 25410 records to 17895 (keeping 200 days of data) [2025-09-17T02:50:15.694856] [DEBUG] [LOCAL ] CINT: Primary data saved (17895 records). [2025-09-17T02:50:15.695027] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-17T02:50:15.695144] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CINT took 34.5s. Estimated remaining: 4h 37m 30s. Rate: 6.9 symbols/min [2025-09-17T02:50:15.866609] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:15.894467] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-17T02:50:15.911705] [DEBUG] [LOCAL ] CL: Loaded 39999 existing records from primary storage. [2025-09-17T02:50:15.911857] [INFO ] [MAIN ] CL: Loaded 39999 existing records. [2025-09-17T02:50:16.088811] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:16.089056] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-17T02:50:16.089114] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-17T02:50:16.090071] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-17T02:50:16.090142] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-17T02:50:16.453670] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:16.473370] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T02:50:16.690168] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-11. [2025-09-17T02:50:17.490169] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-17T02:50:17.616879] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:50:18.191583] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T02:50:18.243706] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T02:50:18.290116] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-17T02:50:19.090146] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-17T02:50:19.655806] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T02:50:19.890155] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-17T02:50:20.044076] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T02:50:20.690166] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-17T02:50:21.490173] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-17T02:50:21.799084] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T02:50:22.290157] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-17T02:50:22.569359] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T02:50:22.642047] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:50:23.090143] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-17T02:50:23.890169] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-17T02:50:24.078505] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:50:24.274723] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T02:50:24.690193] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-17T02:50:25.490100] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-17T02:50:25.729166] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T02:50:25.860844] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:50:26.290142] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-17T02:50:27.090116] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-17T02:50:27.121239] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:50:27.124443] [INFO ] [REMOTE ] CIO: Full fetch complete (29132 records). [2025-09-17T02:50:27.124536] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-17T02:50:27.523785] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-17T02:50:27.524477] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-17T02:50:27.526060] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T02:50:27.526597] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-17T02:50:27.537346] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-17T02:50:27.538906] [DEBUG] [LOCAL ] CIO: Trimmed 29132 records to 19855 (keeping 200 days of data) [2025-09-17T02:50:27.659077] [DEBUG] [LOCAL ] CIO: Primary data saved (19855 records). [2025-09-17T02:50:27.659243] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-17T02:50:27.659345] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CIO took 40.0s. Estimated remaining: 4h 37m 35s. Rate: 6.9 symbols/min [2025-09-17T02:50:27.831446] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:27.856670] [DEBUG] [LOCAL ] CLB: Loaded 24336 existing records from primary storage. [2025-09-17T02:50:27.856898] [INFO ] [MAIN ] CLB: Loaded 24336 existing records. [2025-09-17T02:50:27.900218] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-17T02:50:28.039832] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:28.040159] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-17T02:50:28.040220] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-17T02:50:28.040901] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-17T02:50:28.040960] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-17T02:50:28.394955] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:28.462073] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:50:28.690137] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-17T02:50:29.490170] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-11. [2025-09-17T02:50:29.599130] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T02:50:29.779636] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T02:50:29.783611] [INFO ] [REMOTE ] CION: Full fetch complete (41205 records). [2025-09-17T02:50:29.783743] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-17T02:50:30.181468] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-17T02:50:30.181576] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-17T02:50:30.182102] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-17T02:50:30.182155] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-17T02:50:30.183024] [DEBUG] [LOCAL ] CION: Trimmed 41205 records to 29384 (keeping 200 days of data) [2025-09-17T02:50:30.300179] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-17T02:50:30.368905] [DEBUG] [LOCAL ] CION: Primary data saved (29384 records). [2025-09-17T02:50:30.369063] [INFO ] [MAIN ] CION: Full history saved. [2025-09-17T02:50:30.369157] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CION took 34.9s. Estimated remaining: 4h 37m 1s. Rate: 6.9 symbols/min [2025-09-17T02:50:30.539601] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:30.549117] [DEBUG] [LOCAL ] CLCO: Loaded 7998 existing records from primary storage. [2025-09-17T02:50:30.549299] [INFO ] [MAIN ] CLCO: Loaded 7998 existing records. [2025-09-17T02:50:30.738062] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:30.738471] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-17T02:50:30.738616] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-17T02:50:30.738966] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-17T02:50:30.739043] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-17T02:50:30.863193] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:50:31.100422] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-17T02:50:31.128132] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:31.890135] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-17T02:50:32.187006] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T02:50:32.429945] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:50:32.690164] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-17T02:50:33.490136] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-11. [2025-09-17T02:50:33.875664] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T02:50:33.990070] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T02:50:34.290194] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-17T02:50:34.470102] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T02:50:35.090182] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-17T02:50:35.291242] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T02:50:35.890158] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-17T02:50:36.690211] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-17T02:50:36.857275] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T02:50:37.134889] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:50:37.490166] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-17T02:50:37.708381] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T02:50:38.290160] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-17T02:50:39.090172] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-17T02:50:39.275110] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T02:50:39.345909] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T02:50:39.890139] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-17T02:50:40.628251] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T02:50:40.690158] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-17T02:50:41.490155] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-17T02:50:41.543911] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T02:50:41.896709] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T02:50:42.290153] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-17T02:50:43.090118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-17T02:50:43.314854] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:50:43.388549] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T02:50:43.890121] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-17T02:50:44.511378] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T02:50:44.518426] [INFO ] [REMOTE ] CL: Full fetch complete (77454 records). [2025-09-17T02:50:44.518599] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-17T02:50:44.698738] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-17T02:50:44.930432] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-17T02:50:44.930542] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-17T02:50:44.931352] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-17T02:50:44.931411] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-17T02:50:44.932927] [DEBUG] [LOCAL ] CL: Trimmed 77454 records to 53644 (keeping 200 days of data) [2025-09-17T02:50:45.284059] [DEBUG] [LOCAL ] CL: Primary data saved (53644 records). [2025-09-17T02:50:45.284224] [INFO ] [MAIN ] CL: Full history saved. [2025-09-17T02:50:45.284325] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CL took 29.6s. Estimated remaining: 4h 37m 19s. Rate: 6.9 symbols/min [2025-09-17T02:50:45.470603] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:45.488591] [DEBUG] [LOCAL ] CLDT: Loaded 17684 existing records from primary storage. [2025-09-17T02:50:45.488802] [INFO ] [MAIN ] CLDT: Loaded 17684 existing records. [2025-09-17T02:50:45.521710] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-17T02:50:45.682276] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:45.682723] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-17T02:50:45.682861] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-17T02:50:45.683579] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-17T02:50:45.683678] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-17T02:50:46.094822] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:46.097772] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T02:50:46.123106] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:50:46.290113] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-11. [2025-09-17T02:50:46.535220] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T02:50:47.090114] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-17T02:50:47.533304] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:50:47.890124] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-17T02:50:48.690111] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-17T02:50:49.027779] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:50:49.342870] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:50:49.468839] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:50:49.490099] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-17T02:50:50.290160] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-17T02:50:50.568376] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T02:50:51.090168] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-17T02:50:51.880065] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:50:51.886962] [INFO ] [REMOTE ] CIVI: Full fetch complete (75131 records). [2025-09-17T02:50:51.887142] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-17T02:50:51.899083] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-17T02:50:52.291374] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-17T02:50:52.291484] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-17T02:50:52.292316] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-17T02:50:52.292377] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-17T02:50:52.293898] [DEBUG] [LOCAL ] CIVI: Trimmed 75131 records to 52586 (keeping 200 days of data) [2025-09-17T02:50:52.550401] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:50:52.660547] [DEBUG] [LOCAL ] CIVI: Primary data saved (52586 records). [2025-09-17T02:50:52.660732] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-17T02:50:52.660815] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CIVI took 48.0s. Estimated remaining: 4h 37m 4s. Rate: 6.9 symbols/min [2025-09-17T02:50:52.695224] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-17T02:50:52.841023] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:52.882146] [DEBUG] [LOCAL ] CLF: Loaded 40092 existing records from primary storage. [2025-09-17T02:50:52.882418] [INFO ] [MAIN ] CLF: Loaded 40092 existing records. [2025-09-17T02:50:53.078684] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:53.079794] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:50:53.085522] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-17T02:50:53.086211] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-17T02:50:53.087143] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-17T02:50:53.087208] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-17T02:50:53.450116] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:53.490156] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-17T02:50:53.775973] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:50:54.290128] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-17T02:50:54.839243] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:50:55.090150] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-11. [2025-09-17T02:50:55.508620] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:50:55.513430] [INFO ] [REMOTE ] CLB: Full fetch complete (45920 records). [2025-09-17T02:50:55.513562] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-17T02:50:55.895741] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-17T02:50:55.912740] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-17T02:50:55.912855] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-17T02:50:55.913481] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-17T02:50:55.913670] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-17T02:50:55.914765] [DEBUG] [LOCAL ] CLB: Trimmed 45920 records to 33316 (keeping 200 days of data) [2025-09-17T02:50:56.121023] [DEBUG] [LOCAL ] CLB: Primary data saved (33316 records). [2025-09-17T02:50:56.121193] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-17T02:50:56.121298] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CLB took 28.5s. Estimated remaining: 4h 36m 34s. Rate: 6.9 symbols/min [2025-09-17T02:50:56.294493] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:56.314677] [DEBUG] [LOCAL ] CLH: Loaded 19781 existing records from primary storage. [2025-09-17T02:50:56.314864] [INFO ] [MAIN ] CLH: Loaded 19781 existing records. [2025-09-17T02:50:56.491129] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:56.491391] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-17T02:50:56.491443] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-17T02:50:56.492050] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-17T02:50:56.492114] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-17T02:50:56.704789] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-17T02:50:56.855034] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:56.865978] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:50:57.097870] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T02:50:57.490147] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-17T02:50:58.140367] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:50:58.290156] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-11. [2025-09-17T02:50:58.421388] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:50:59.090132] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-17T02:50:59.619365] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:50:59.890144] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-17T02:51:00.690137] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-17T02:51:01.143871] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:51:01.433445] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-17T02:51:01.490149] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-17T02:51:01.557900] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:51:02.290192] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-17T02:51:03.090131] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-17T02:51:03.356328] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T02:51:03.890143] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-17T02:51:04.690129] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-17T02:51:04.711151] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T02:51:04.848554] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-17T02:51:05.490128] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-17T02:51:05.640150] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T02:51:05.734167] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-17T02:51:06.290144] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-17T02:51:06.638427] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:51:07.090121] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-17T02:51:07.118724] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:51:07.120276] [INFO ] [REMOTE ] CLCO: Full fetch complete (24043 records). [2025-09-17T02:51:07.120371] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-17T02:51:07.506606] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-17T02:51:07.506723] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-17T02:51:07.507135] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-17T02:51:07.507212] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-17T02:51:07.507875] [DEBUG] [LOCAL ] CLCO: Trimmed 24043 records to 13763 (keeping 200 days of data) [2025-09-17T02:51:07.583130] [DEBUG] [LOCAL ] CLCO: Primary data saved (13763 records). [2025-09-17T02:51:07.583304] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-17T02:51:07.583426] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 37.2s. Estimated remaining: 4h 36m 37s. Rate: 6.9 symbols/min [2025-09-17T02:51:07.758289] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:07.758737] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-09-17T02:51:07.758790] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-09-17T02:51:07.758907] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-17T02:51:07.758994] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-17T02:51:07.759100] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-09-17T02:51:07.759165] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-17T02:51:07.900194] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-17T02:51:08.117935] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:08.159485] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:51:08.690138] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-17T02:51:08.981461] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T02:51:09.490126] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-17T02:51:10.290127] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-11. [2025-09-17T02:51:10.812377] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T02:51:10.929017] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:51:11.090124] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-17T02:51:11.101934] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T02:51:11.890136] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-17T02:51:12.598581] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T02:51:12.617961] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T02:51:12.690127] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-17T02:51:13.490123] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-17T02:51:13.865680] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:51:14.290162] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-17T02:51:14.348270] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:51:15.090170] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-17T02:51:15.757847] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:51:15.890139] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-17T02:51:16.690249] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-17T02:51:17.490231] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-17T02:51:17.751373] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-17T02:51:17.763971] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T02:51:17.768191] [INFO ] [REMOTE ] CLDT: Full fetch complete (36976 records). [2025-09-17T02:51:17.768332] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-17T02:51:18.118816] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T02:51:18.185516] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-17T02:51:18.185772] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-17T02:51:18.186306] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-17T02:51:18.186375] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-17T02:51:18.205315] [DEBUG] [LOCAL ] CLDT: Trimmed 36976 records to 26196 (keeping 200 days of data) [2025-09-17T02:51:18.206922] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:51:18.299057] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-17T02:51:18.367196] [DEBUG] [LOCAL ] CLDT: Primary data saved (26196 records). [2025-09-17T02:51:18.367351] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-17T02:51:18.367446] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLDT took 33.1s. Estimated remaining: 4h 36m 36s. Rate: 6.9 symbols/min [2025-09-17T02:51:18.535454] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:18.575185] [DEBUG] [LOCAL ] CLS: Loaded 40005 existing records from primary storage. [2025-09-17T02:51:18.575354] [INFO ] [MAIN ] CLS: Loaded 40005 existing records. [2025-09-17T02:51:18.754520] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:18.754906] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-17T02:51:18.754967] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-17T02:51:18.755893] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-17T02:51:18.755954] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-17T02:51:19.096344] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-17T02:51:19.114580] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:19.561987] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T02:51:19.890126] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-17T02:51:20.070458] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T02:51:20.690144] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-11. [2025-09-17T02:51:20.700819] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:51:20.704572] [INFO ] [REMOTE ] CLH: Full fetch complete (41647 records). [2025-09-17T02:51:20.704731] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-17T02:51:21.096330] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-17T02:51:21.096434] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-17T02:51:21.096993] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-17T02:51:21.097052] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-17T02:51:21.098038] [DEBUG] [LOCAL ] CLH: Trimmed 41647 records to 28607 (keeping 200 days of data) [2025-09-17T02:51:21.273586] [DEBUG] [LOCAL ] CLH: Primary data saved (28607 records). [2025-09-17T02:51:21.274000] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-17T02:51:21.274127] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLH took 25.2s. Estimated remaining: 4h 36m 4s. Rate: 6.9 symbols/min [2025-09-17T02:51:21.449604] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:21.488738] [DEBUG] [LOCAL ] CLVT: Loaded 38762 existing records from primary storage. [2025-09-17T02:51:21.488921] [INFO ] [MAIN ] CLVT: Loaded 38762 existing records. [2025-09-17T02:51:21.501026] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-17T02:51:21.679414] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:21.679713] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-17T02:51:21.679778] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-17T02:51:21.680857] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-17T02:51:21.680934] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-17T02:51:22.045289] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:22.290116] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-17T02:51:22.527165] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T02:51:22.675484] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T02:51:23.090139] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-17T02:51:23.890148] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-11. [2025-09-17T02:51:24.530870] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-17T02:51:24.690147] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-17T02:51:25.098058] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T02:51:25.490142] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-17T02:51:25.585083] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T02:51:26.289795] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T02:51:26.292236] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-17T02:51:26.863560] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T02:51:27.090173] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-17T02:51:27.890156] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-17T02:51:27.962324] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:51:28.690197] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-17T02:51:28.722697] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:51:28.894497] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:51:29.490169] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-17T02:51:30.290140] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-17T02:51:30.433440] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T02:51:31.090196] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-17T02:51:31.368488] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:51:31.890150] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-17T02:51:32.644974] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-17T02:51:32.695299] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-17T02:51:32.710525] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:51:33.490161] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-17T02:51:34.197791] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T02:51:34.290169] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-17T02:51:34.917287] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:51:35.090123] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-17T02:51:35.147287] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-17T02:51:35.165452] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T02:51:35.890125] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-17T02:51:36.690152] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-17T02:51:36.750404] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:51:37.490159] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-17T02:51:38.296183] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-17T02:51:38.310629] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-17T02:51:38.433974] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:51:39.090149] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-17T02:51:39.184695] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T02:51:39.432619] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T02:51:39.439412] [INFO ] [REMOTE ] CLF: Full fetch complete (77691 records). [2025-09-17T02:51:39.439606] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-17T02:51:39.834853] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-17T02:51:39.834974] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-17T02:51:39.835827] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-17T02:51:39.835904] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-17T02:51:39.837514] [DEBUG] [LOCAL ] CLF: Trimmed 77691 records to 53742 (keeping 200 days of data) [2025-09-17T02:51:39.890224] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-17T02:51:40.161657] [DEBUG] [LOCAL ] CLF: Primary data saved (53742 records). [2025-09-17T02:51:40.161844] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-17T02:51:40.161936] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLF took 47.5s. Estimated remaining: 4h 36m 37s. Rate: 6.9 symbols/min [2025-09-17T02:51:40.333662] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:40.350256] [DEBUG] [LOCAL ] CLW: Loaded 15781 existing records from primary storage. [2025-09-17T02:51:40.350433] [INFO ] [MAIN ] CLW: Loaded 15781 existing records. [2025-09-17T02:51:40.469315] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T02:51:40.511984] [INFO ] [REMOTE ] CLPR: Full fetch complete (17931 records). [2025-09-17T02:51:40.523711] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-17T02:51:40.541674] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:40.573659] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-17T02:51:40.585024] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-17T02:51:40.622110] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-17T02:51:40.642868] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-17T02:51:40.699483] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-17T02:51:41.231388] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-17T02:51:41.231635] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-17T02:51:41.232119] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-17T02:51:41.232236] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-17T02:51:41.284575] [DEBUG] [LOCAL ] CLPR: Trimmed 17931 records to 11659 (keeping 200 days of data) [2025-09-17T02:51:41.313150] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:41.391446] [DEBUG] [LOCAL ] CLPR: Primary data saved (11659 records). [2025-09-17T02:51:41.391784] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-17T02:51:41.391951] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLPR took 33.8s. Estimated remaining: 4h 35m 58s. Rate: 6.9 symbols/min [2025-09-17T02:51:41.498767] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-11. [2025-09-17T02:51:41.549335] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-17T02:51:41.628996] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:41.667119] [DEBUG] [LOCAL ] CLX: Loaded 38771 existing records from primary storage. [2025-09-17T02:51:41.667288] [INFO ] [MAIN ] CLX: Loaded 38771 existing records. [2025-09-17T02:51:41.846884] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:41.847180] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-17T02:51:41.847243] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-17T02:51:41.848153] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-17T02:51:41.848227] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-17T02:51:42.215833] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:42.290110] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-17T02:51:42.530148] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:51:42.898565] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T02:51:43.090159] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-17T02:51:43.890130] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-17T02:51:44.038096] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:51:44.695272] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-11. [2025-09-17T02:51:44.711730] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T02:51:45.208550] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T02:51:45.490132] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-17T02:51:46.068189] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:51:46.290138] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-17T02:51:46.393058] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:51:47.090132] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-17T02:51:47.891873] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-17T02:51:47.897353] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:51:48.140951] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T02:51:48.690233] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-17T02:51:49.490139] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-17T02:51:49.675070] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:51:50.290163] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-17T02:51:50.486127] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T02:51:51.090097] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-17T02:51:51.486482] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T02:51:51.847656] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T02:51:51.890098] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-17T02:51:52.690156] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-17T02:51:52.724949] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T02:51:52.731521] [INFO ] [REMOTE ] CLVT: Full fetch complete (75130 records). [2025-09-17T02:51:52.731917] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-17T02:51:53.131229] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-17T02:51:53.131336] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-17T02:51:53.132134] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-17T02:51:53.132193] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-17T02:51:53.133772] [DEBUG] [LOCAL ] CLVT: Trimmed 75130 records to 52056 (keeping 200 days of data) [2025-09-17T02:51:53.434964] [DEBUG] [LOCAL ] CLVT: Primary data saved (52056 records). [2025-09-17T02:51:53.435129] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-17T02:51:53.435233] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLVT took 32.2s. Estimated remaining: 4h 36m 3s. Rate: 6.9 symbols/min [2025-09-17T02:51:53.499807] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-17T02:51:53.612330] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:53.646942] [DEBUG] [LOCAL ] CM: Loaded 36130 existing records from primary storage. [2025-09-17T02:51:53.647174] [INFO ] [MAIN ] CM: Loaded 36130 existing records. [2025-09-17T02:51:53.824720] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:53.824975] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-17T02:51:53.825036] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-17T02:51:53.825981] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-17T02:51:53.826050] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-17T02:51:54.195102] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:54.211810] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T02:51:54.255330] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T02:51:54.290167] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-11. [2025-09-17T02:51:55.090192] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-17T02:51:55.207844] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:51:55.898372] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-17T02:51:55.909043] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:51:55.965463] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T02:51:56.690153] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-17T02:51:56.984075] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-17T02:51:56.991577] [INFO ] [REMOTE ] CLS: Full fetch complete (77317 records). [2025-09-17T02:51:56.991778] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-17T02:51:57.397823] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-17T02:51:57.398201] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-17T02:51:57.399680] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-17T02:51:57.399855] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-17T02:51:57.402043] [DEBUG] [LOCAL ] CLS: Trimmed 77317 records to 53648 (keeping 200 days of data) [2025-09-17T02:51:57.495757] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-17T02:51:57.498466] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T02:51:57.801740] [DEBUG] [LOCAL ] CLS: Primary data saved (53648 records). [2025-09-17T02:51:57.801998] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-17T02:51:57.802122] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLS took 39.4s. Estimated remaining: 4h 35m 36s. Rate: 6.9 symbols/min [2025-09-17T02:51:57.975856] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:58.018493] [DEBUG] [LOCAL ] CMA: Loaded 37171 existing records from primary storage. [2025-09-17T02:51:58.018786] [INFO ] [MAIN ] CMA: Loaded 37171 existing records. [2025-09-17T02:51:58.202257] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:58.202591] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-17T02:51:58.202677] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-17T02:51:58.203581] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-17T02:51:58.203673] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-17T02:51:58.295272] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-17T02:51:58.564520] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:59.090111] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-11. [2025-09-17T02:51:59.129281] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T02:51:59.401382] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:51:59.890139] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-17T02:52:00.690115] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-17T02:52:00.770190] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T02:52:01.490172] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-17T02:52:01.537530] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:52:01.596433] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:52:02.290133] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-17T02:52:03.090175] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-17T02:52:03.148244] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:52:03.890116] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-17T02:52:03.954515] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:52:04.690137] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-17T02:52:04.877574] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:52:05.317629] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:52:05.490173] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-17T02:52:06.290144] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-17T02:52:06.389740] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T02:52:07.090120] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-17T02:52:07.162046] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:52:07.424067] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:52:07.890121] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-17T02:52:08.690150] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-17T02:52:08.877122] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:52:09.490136] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-17T02:52:09.767050] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:52:10.111547] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:52:10.290137] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-17T02:52:10.444099] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T02:52:10.447284] [INFO ] [REMOTE ] CLW: Full fetch complete (35159 records). [2025-09-17T02:52:10.447412] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-17T02:52:10.828793] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-17T02:52:10.828898] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-17T02:52:10.829359] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-17T02:52:10.829413] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-17T02:52:10.830253] [DEBUG] [LOCAL ] CLW: Trimmed 35159 records to 22083 (keeping 200 days of data) [2025-09-17T02:52:10.975823] [DEBUG] [LOCAL ] CLW: Primary data saved (22083 records). [2025-09-17T02:52:10.975991] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-17T02:52:10.976107] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLW took 30.8s. Estimated remaining: 4h 35m 46s. Rate: 6.9 symbols/min [2025-09-17T02:52:11.095203] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-17T02:52:11.155450] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:11.173111] [DEBUG] [LOCAL ] CMBT: Loaded 17313 existing records from primary storage. [2025-09-17T02:52:11.173271] [INFO ] [MAIN ] CMBT: Loaded 17313 existing records. [2025-09-17T02:52:11.347413] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:11.347694] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-17T02:52:11.347755] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-17T02:52:11.348206] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-17T02:52:11.348272] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-17T02:52:11.698442] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:11.890133] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-17T02:52:11.966420] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T02:52:12.385746] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:52:12.690144] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-17T02:52:13.490135] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-11. [2025-09-17T02:52:13.731163] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:52:14.158740] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T02:52:14.290120] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-17T02:52:14.591780] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T02:52:15.090128] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-17T02:52:15.118904] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:52:15.890128] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-17T02:52:16.690126] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-17T02:52:16.912794] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T02:52:16.958402] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T02:52:17.490144] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-17T02:52:18.290136] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-17T02:52:18.622962] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:52:18.834471] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:52:19.090182] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-17T02:52:19.534816] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T02:52:19.890184] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-17T02:52:20.324508] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:52:20.330821] [INFO ] [REMOTE ] CLX: Full fetch complete (72493 records). [2025-09-17T02:52:20.330952] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-17T02:52:20.690680] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-17T02:52:20.734419] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-17T02:52:20.734498] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-17T02:52:20.735353] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-17T02:52:20.735493] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-17T02:52:20.737043] [DEBUG] [LOCAL ] CLX: Trimmed 72493 records to 51381 (keeping 200 days of data) [2025-09-17T02:52:21.060182] [DEBUG] [LOCAL ] CLX: Primary data saved (51381 records). [2025-09-17T02:52:21.060372] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-17T02:52:21.060490] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLX took 39.7s. Estimated remaining: 4h 35m 42s. Rate: 6.9 symbols/min [2025-09-17T02:52:21.237273] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:21.267807] [DEBUG] [LOCAL ] CMC: Loaded 33219 existing records from primary storage. [2025-09-17T02:52:21.267977] [INFO ] [MAIN ] CMC: Loaded 33219 existing records. [2025-09-17T02:52:21.446368] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:21.446616] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-17T02:52:21.446694] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-17T02:52:21.447334] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-17T02:52:21.447394] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-17T02:52:21.493894] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-17T02:52:21.823392] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:21.833448] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T02:52:21.867313] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T02:52:22.290150] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-17T02:52:23.090174] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-17T02:52:23.243818] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:52:23.384369] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T02:52:23.890199] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-17T02:52:24.519276] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:52:24.690178] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-17T02:52:25.490135] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-11. [2025-09-17T02:52:25.782852] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:52:25.805513] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:52:26.290148] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-17T02:52:26.796622] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T02:52:27.090172] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-17T02:52:27.890099] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-17T02:52:27.944447] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:52:28.294546] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:52:28.690111] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-17T02:52:28.985021] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T02:52:29.490181] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-17T02:52:29.911037] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:52:29.917067] [INFO ] [REMOTE ] CMA: Full fetch complete (73247 records). [2025-09-17T02:52:29.917210] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-17T02:52:30.297309] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-17T02:52:30.321860] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-17T02:52:30.323018] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-17T02:52:30.324229] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-17T02:52:30.324432] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-17T02:52:30.326156] [DEBUG] [LOCAL ] CMA: Trimmed 73247 records to 50291 (keeping 200 days of data) [2025-09-17T02:52:30.644304] [DEBUG] [LOCAL ] CMA: Primary data saved (50291 records). [2025-09-17T02:52:30.644480] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-17T02:52:30.644603] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CMA took 32.8s. Estimated remaining: 4h 35m 37s. Rate: 6.9 symbols/min [2025-09-17T02:52:30.816510] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:30.822029] [DEBUG] [LOCAL ] CMCM: Loaded 3467 existing records from primary storage. [2025-09-17T02:52:30.822152] [INFO ] [MAIN ] CMCM: Loaded 3467 existing records. [2025-09-17T02:52:31.000322] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:31.000907] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-17T02:52:31.001141] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-17T02:52:31.001572] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-17T02:52:31.001845] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-17T02:52:31.105767] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-17T02:52:31.139093] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:52:31.244314] [INFO ] [REMOTE ] CM: Full fetch complete (69249 records). [2025-09-17T02:52:31.281535] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-17T02:52:31.508512] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:31.791431] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-17T02:52:31.791546] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-17T02:52:31.792335] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-17T02:52:31.792413] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-17T02:52:31.794685] [DEBUG] [LOCAL ] CM: Trimmed 69249 records to 48670 (keeping 200 days of data) [2025-09-17T02:52:31.891504] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-11. [2025-09-17T02:52:32.059555] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T02:52:32.091216] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T02:52:32.152719] [DEBUG] [LOCAL ] CM: Primary data saved (48670 records). [2025-09-17T02:52:32.152897] [INFO ] [MAIN ] CM: Full history saved. [2025-09-17T02:52:32.153003] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CM took 38.7s. Estimated remaining: 4h 34m 60s. Rate: 6.9 symbols/min [2025-09-17T02:52:32.322464] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:32.322689] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-17T02:52:32.325865] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:52:32.327220] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-17T02:52:32.327396] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-17T02:52:32.327468] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-17T02:52:32.327539] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-17T02:52:32.327593] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-17T02:52:32.686429] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:32.690082] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-11. [2025-09-17T02:52:32.899380] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:32.899762] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-11 [2025-09-17T02:52:33.490130] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-17T02:52:33.697413] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:33.697768] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-17T02:52:34.290174] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-17T02:52:35.090154] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-17T02:52:35.306177] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:35.306516] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-17T02:52:35.838453] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T02:52:35.890118] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-17T02:52:36.690140] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-17T02:52:37.490171] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-17T02:52:37.565097] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:52:37.691800] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T02:52:37.702789] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:37.703579] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-17T02:52:38.290134] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-17T02:52:39.090131] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-17T02:52:39.820713] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:52:39.832439] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T02:52:39.890120] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-17T02:52:40.449665] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T02:52:40.690188] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-17T02:52:41.128502] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T02:52:41.490196] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-17T02:52:42.109845] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T02:52:42.290192] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-17T02:52:42.517296] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:42.517627] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-17T02:52:43.090193] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-17T02:52:43.890196] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-17T02:52:44.690208] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-17T02:52:44.807144] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T02:52:44.813005] [INFO ] [REMOTE ] CMBT: Full fetch complete (27961 records). [2025-09-17T02:52:44.813121] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-17T02:52:45.243850] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T02:52:45.258061] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-17T02:52:45.258512] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-17T02:52:45.259223] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-17T02:52:45.259317] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-17T02:52:45.260509] [DEBUG] [LOCAL ] CMBT: Trimmed 27961 records to 20842 (keeping 200 days of data) [2025-09-17T02:52:45.392474] [DEBUG] [LOCAL ] CMBT: Primary data saved (20842 records). [2025-09-17T02:52:45.392629] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-17T02:52:45.392748] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMBT took 34.4s. Estimated remaining: 4h 35m 9s. Rate: 6.9 symbols/min [2025-09-17T02:52:45.491557] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-17T02:52:45.572881] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:45.608748] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T02:52:45.650720] [DEBUG] [LOCAL ] CMG: Loaded 40077 existing records from primary storage. [2025-09-17T02:52:45.650924] [INFO ] [MAIN ] CMG: Loaded 40077 existing records. [2025-09-17T02:52:45.752800] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:45.753174] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-17T02:52:45.831321] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:45.831573] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-17T02:52:45.831692] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-17T02:52:45.832594] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-17T02:52:45.832699] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-17T02:52:46.209064] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:46.290126] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-11. [2025-09-17T02:52:47.090142] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-17T02:52:47.193282] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-17T02:52:47.193635] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-05 [2025-09-17T02:52:47.890110] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-17T02:52:48.389089] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T02:52:48.690130] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-17T02:52:49.417080] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T02:52:49.490136] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-17T02:52:49.595898] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T02:52:50.277852] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T02:52:50.290091] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-17T02:52:51.090151] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-17T02:52:51.115583] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T02:52:51.890165] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-17T02:52:52.561864] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:52:52.690198] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-17T02:52:53.490135] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-17T02:52:53.808803] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T02:52:54.048835] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:52:54.172284] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-17T02:52:54.290182] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-17T02:52:55.090135] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-17T02:52:55.899553] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-17T02:52:55.905305] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T02:52:55.922139] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:52:55.924737] [INFO ] [REMOTE ] CMDB: Full fetch complete (7785 records). [2025-09-17T02:52:55.924823] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-17T02:52:56.103528] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-17T02:52:56.103817] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:52:56.103872] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:52:56.103918] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-17T02:52:56.103983] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-17T02:52:56.104027] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-17T02:52:56.104132] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-17T02:52:56.104205] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CMDB took 24.0s. Estimated remaining: 4h 35m 8s. Rate: 6.9 symbols/min [2025-09-17T02:52:56.272788] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:56.306364] [DEBUG] [LOCAL ] CMI: Loaded 30499 existing records from primary storage. [2025-09-17T02:52:56.306532] [INFO ] [MAIN ] CMI: Loaded 30499 existing records. [2025-09-17T02:52:56.490898] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:56.491200] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-17T02:52:56.491261] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-17T02:52:56.492024] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-17T02:52:56.492086] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-17T02:52:56.695299] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-17T02:52:56.870854] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:57.411567] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T02:52:57.490184] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-17T02:52:58.168021] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T02:52:58.290147] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-17T02:52:58.532479] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:52:58.538919] [INFO ] [REMOTE ] CMC: Full fetch complete (66547 records). [2025-09-17T02:52:58.539092] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-17T02:52:58.939230] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-17T02:52:58.939349] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-17T02:52:58.940103] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-17T02:52:58.940180] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-17T02:52:58.941581] [DEBUG] [LOCAL ] CMC: Trimmed 66547 records to 45782 (keeping 200 days of data) [2025-09-17T02:52:59.122712] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-17T02:52:59.226996] [DEBUG] [LOCAL ] CMC: Primary data saved (45782 records). [2025-09-17T02:52:59.227175] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-17T02:52:59.227280] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMC took 38.2s. Estimated remaining: 4h 34m 37s. Rate: 6.9 symbols/min [2025-09-17T02:52:59.398296] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:59.428344] [DEBUG] [LOCAL ] CMP: Loaded 27600 existing records from primary storage. [2025-09-17T02:52:59.428537] [INFO ] [MAIN ] CMP: Loaded 27600 existing records. [2025-09-17T02:52:59.614030] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:59.614322] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-17T02:52:59.614384] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-17T02:52:59.615097] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-17T02:52:59.615167] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-17T02:52:59.762969] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T02:52:59.898322] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-17T02:52:59.991506] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:00.440044] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-17T02:53:00.575975] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T02:53:00.690124] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-11. [2025-09-17T02:53:01.490151] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-17T02:53:02.295974] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-17T02:53:02.313157] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:53:02.329592] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:53:02.331625] [INFO ] [REMOTE ] CMCM: Full fetch complete (7065 records). [2025-09-17T02:53:02.331741] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-17T02:53:02.687125] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-17T02:53:02.687226] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-17T02:53:02.687421] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-17T02:53:02.687487] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-17T02:53:02.688081] [DEBUG] [LOCAL ] CMCM: Trimmed 7065 records to 4621 (keeping 200 days of data) [2025-09-17T02:53:02.713493] [DEBUG] [LOCAL ] CMCM: Primary data saved (4621 records). [2025-09-17T02:53:02.713581] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-17T02:53:02.713718] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMCM took 32.1s. Estimated remaining: 4h 34m 8s. Rate: 6.9 symbols/min [2025-09-17T02:53:02.884713] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:02.912297] [DEBUG] [LOCAL ] CMRE: Loaded 26276 existing records from primary storage. [2025-09-17T02:53:02.912471] [INFO ] [MAIN ] CMRE: Loaded 26276 existing records. [2025-09-17T02:53:03.088947] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:03.089168] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-17T02:53:03.089224] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-17T02:53:03.089874] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-17T02:53:03.089947] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-17T02:53:03.095270] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-11. [2025-09-17T02:53:03.460854] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:03.890132] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-11. [2025-09-17T02:53:04.165813] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T02:53:04.611976] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T02:53:04.684666] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T02:53:04.692143] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-17T02:53:05.490137] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-17T02:53:06.290143] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-17T02:53:07.026829] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:53:07.066149] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T02:53:07.090090] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-17T02:53:07.847809] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T02:53:07.890136] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-17T02:53:08.660464] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:53:08.690091] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-17T02:53:08.950550] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T02:53:09.490124] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-17T02:53:10.094820] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T02:53:10.290108] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-17T02:53:10.333377] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:53:11.090126] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-17T02:53:11.890108] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-17T02:53:12.465300] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T02:53:12.509459] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:53:12.690166] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-17T02:53:13.490164] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-17T02:53:13.653821] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:53:13.808917] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:53:14.290164] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-17T02:53:15.090118] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-17T02:53:15.302215] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T02:53:15.722125] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:53:15.890115] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-17T02:53:16.690121] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-17T02:53:16.923182] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:53:17.490161] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-17T02:53:18.056327] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:53:18.297305] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-17T02:53:18.303420] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-17T02:53:18.790812] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T02:53:19.090135] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-17T02:53:19.835598] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T02:53:19.890083] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-17T02:53:20.591989] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T02:53:20.690107] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-17T02:53:21.490188] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-17T02:53:22.298859] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-17T02:53:22.307485] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T02:53:22.397139] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T02:53:23.009605] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T02:53:23.090124] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-17T02:53:23.655759] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T02:53:23.890172] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-17T02:53:24.611859] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T02:53:24.690147] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-17T02:53:25.490167] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-17T02:53:25.646548] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T02:53:26.070726] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:53:26.290169] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-17T02:53:26.588748] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T02:53:27.090164] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-17T02:53:27.703949] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T02:53:27.709534] [INFO ] [REMOTE ] CMI: Full fetch complete (59486 records). [2025-09-17T02:53:27.709753] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-17T02:53:27.895451] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-17T02:53:28.114353] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-17T02:53:28.114520] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-17T02:53:28.115231] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-17T02:53:28.115417] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-17T02:53:28.138420] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:53:28.146703] [DEBUG] [LOCAL ] CMI: Trimmed 59486 records to 41940 (keeping 200 days of data) [2025-09-17T02:53:28.415820] [DEBUG] [LOCAL ] CMI: Primary data saved (41940 records). [2025-09-17T02:53:28.415975] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-17T02:53:28.416074] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMI took 32.3s. Estimated remaining: 4h 35m 7s. Rate: 6.9 symbols/min [2025-09-17T02:53:28.690190] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-17T02:53:29.401394] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:53:29.490148] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-17T02:53:29.854248] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T02:53:29.857998] [INFO ] [REMOTE ] CMP: Full fetch complete (53281 records). [2025-09-17T02:53:29.858116] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-17T02:53:30.236055] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-17T02:53:30.236166] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-17T02:53:30.236798] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-17T02:53:30.236855] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-17T02:53:30.237964] [DEBUG] [LOCAL ] CMP: Trimmed 53281 records to 36718 (keeping 200 days of data) [2025-09-17T02:53:30.296300] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-17T02:53:30.452945] [DEBUG] [LOCAL ] CMP: Primary data saved (36718 records). [2025-09-17T02:53:30.453120] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-17T02:53:30.453214] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMP took 31.2s. Estimated remaining: 4h 34m 32s. Rate: 6.9 symbols/min [2025-09-17T02:53:30.953557] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:53:31.090129] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-17T02:53:32.502816] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:53:32.510738] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-17T02:53:32.539564] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-17T02:53:32.546297] [INFO ] [REMOTE ] CMG: Full fetch complete (77722 records). [2025-09-17T02:53:32.546493] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-17T02:53:32.968817] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-17T02:53:32.968992] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-17T02:53:32.970492] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-17T02:53:32.970616] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-17T02:53:32.973564] [DEBUG] [LOCAL ] CMG: Trimmed 77722 records to 53720 (keeping 200 days of data) [2025-09-17T02:53:33.453438] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-09-17T02:53:33.453846] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-17T02:53:33.453988] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMG took 48.1s. Estimated remaining: 4h 34m 0s. Rate: 6.9 symbols/min [2025-09-17T02:53:33.938474] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:53:33.947579] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-17T02:53:35.197765] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T02:53:35.202012] [INFO ] [REMOTE ] CMRE: Full fetch complete (49261 records). [2025-09-17T02:53:35.202135] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-17T02:53:35.607166] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-17T02:53:35.607276] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-17T02:53:35.607887] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-17T02:53:35.607960] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-17T02:53:35.609142] [DEBUG] [LOCAL ] CMRE: Trimmed 49261 records to 35823 (keeping 200 days of data) [2025-09-17T02:53:35.824285] [DEBUG] [LOCAL ] CMRE: Primary data saved (35823 records). [2025-09-17T02:53:35.824473] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-17T02:53:35.824572] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMRE took 33.1s. Estimated remaining: 4h 33m 27s. Rate: 6.9 symbols/min [2025-09-17T02:53:36.434771] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.472323] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.491500] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.525009] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.532783] [DEBUG] [LOCAL ] CMSA: Loaded 2523 existing records from primary storage. [2025-09-17T02:53:36.532972] [INFO ] [MAIN ] CMSA: Loaded 2523 existing records. [2025-09-17T02:53:36.558422] [DEBUG] [LOCAL ] CMSC: Loaded 3464 existing records from primary storage. [2025-09-17T02:53:36.583671] [INFO ] [MAIN ] CMSC: Loaded 3464 existing records. [2025-09-17T02:53:36.558655] [DEBUG] [LOCAL ] CMSD: Loaded 5674 existing records from primary storage. [2025-09-17T02:53:36.612296] [INFO ] [MAIN ] CMSD: Loaded 5674 existing records. [2025-09-17T02:53:36.970842] [DEBUG] [LOCAL ] CMS: Loaded 39283 existing records from primary storage. [2025-09-17T02:53:37.111181] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.113900] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.119390] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.119506] [INFO ] [MAIN ] CMS: Loaded 39283 existing records. [2025-09-17T02:53:37.120156] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.125486] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.125539] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-17T02:53:37.140554] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-17T02:53:37.125590] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.160369] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-17T02:53:37.165560] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-17T02:53:37.165784] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-17T02:53:37.165813] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-17T02:53:37.177052] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-17T02:53:37.196020] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-17T02:53:37.206337] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-17T02:53:37.615187] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.686435] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.731958] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-17T02:53:37.831659] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-17T02:53:37.931259] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-17T02:53:38.363889] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.410368] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-11. [2025-09-17T02:53:38.540892] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.596591] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-11. [2025-09-17T02:53:38.679741] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.713964] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-11. [2025-09-17T02:53:38.821395] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.821766] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-11. [2025-09-17T02:53:39.239659] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T02:53:39.240976] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-17T02:53:39.289113] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T02:53:39.290350] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-17T02:53:39.309134] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:53:39.311511] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-17T02:53:39.852041] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T02:53:39.853792] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-17T02:53:39.968778] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T02:53:39.970633] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-17T02:53:40.126769] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:53:40.439811] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T02:53:40.478305] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:53:40.511931] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T02:53:40.690129] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-17T02:53:41.144405] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T02:53:41.490142] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-17T02:53:41.820262] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T02:53:42.290140] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-17T02:53:42.883164] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T02:53:43.090122] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-17T02:53:43.890134] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-17T02:53:44.466689] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:53:44.690135] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-17T02:53:44.937020] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T02:53:45.197487] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T02:53:45.490143] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-17T02:53:45.840471] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T02:53:46.290134] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-17T02:53:46.919078] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T02:53:47.090121] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-17T02:53:47.890161] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-17T02:53:48.690168] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-17T02:53:48.752574] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:53:48.889570] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:53:49.126174] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T02:53:49.490189] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-17T02:53:50.099433] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T02:53:50.290147] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-17T02:53:51.090119] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-17T02:53:51.890146] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-17T02:53:51.934284] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:53:51.959333] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T02:53:52.489939] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T02:53:52.690195] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-17T02:53:53.281632] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T02:53:53.490135] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-17T02:53:54.186171] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T02:53:54.290100] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-17T02:53:54.868609] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T02:53:55.090131] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-17T02:53:55.442748] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T02:53:55.444107] [INFO ] [REMOTE ] CMSC: Full fetch complete (7121 records). [2025-09-17T02:53:55.444211] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-17T02:53:55.819771] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-17T02:53:55.819886] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-17T02:53:55.820127] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-17T02:53:55.820184] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-17T02:53:55.820715] [DEBUG] [LOCAL ] CMSC: Trimmed 7121 records to 5117 (keeping 200 days of data) [2025-09-17T02:53:55.852710] [DEBUG] [LOCAL ] CMSC: Primary data saved (5117 records). [2025-09-17T02:53:55.852855] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-17T02:53:55.852952] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSC took 20.0s. Estimated remaining: 4h 34m 3s. Rate: 6.9 symbols/min [2025-09-17T02:53:55.895367] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-17T02:53:56.029971] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:56.055943] [DEBUG] [LOCAL ] CMTG: Loaded 26595 existing records from primary storage. [2025-09-17T02:53:56.056137] [INFO ] [MAIN ] CMTG: Loaded 26595 existing records. [2025-09-17T02:53:56.235209] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:56.235493] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-17T02:53:56.235557] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-17T02:53:56.236379] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-17T02:53:56.236453] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-17T02:53:56.598494] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:56.690139] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-17T02:53:57.490164] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-11. [2025-09-17T02:53:57.520694] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T02:53:57.677202] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:53:58.290176] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-17T02:53:58.424068] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T02:53:59.090201] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-17T02:53:59.648394] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T02:53:59.890175] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-17T02:54:00.073601] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T02:54:00.358637] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T02:54:00.359890] [INFO ] [REMOTE ] CMSA: Full fetch complete (4982 records). [2025-09-17T02:54:00.359993] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-17T02:54:00.692174] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-17T02:54:00.727896] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-17T02:54:00.728019] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-17T02:54:00.728187] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-17T02:54:00.728239] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-17T02:54:00.728605] [DEBUG] [LOCAL ] CMSA: Trimmed 4982 records to 3350 (keeping 200 days of data) [2025-09-17T02:54:00.750296] [DEBUG] [LOCAL ] CMSA: Primary data saved (3350 records). [2025-09-17T02:54:00.750374] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-17T02:54:00.750476] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSA took 24.9s. Estimated remaining: 4h 33m 39s. Rate: 6.9 symbols/min [2025-09-17T02:54:00.922185] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:00.928869] [DEBUG] [LOCAL ] CMU: Loaded 4419 existing records from primary storage. [2025-09-17T02:54:00.929014] [INFO ] [MAIN ] CMU: Loaded 4419 existing records. [2025-09-17T02:54:01.102697] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:01.102897] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-17T02:54:01.102951] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-17T02:54:01.103260] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-17T02:54:01.103322] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-17T02:54:01.452705] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:01.490089] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-11. [2025-09-17T02:54:01.587315] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T02:54:02.290192] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-17T02:54:02.566363] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T02:54:03.090152] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-17T02:54:03.890127] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-17T02:54:04.045944] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T02:54:04.690142] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-17T02:54:05.380266] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T02:54:05.490137] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-17T02:54:05.530330] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-17T02:54:05.560380] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T02:54:06.290133] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-17T02:54:06.859687] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:54:07.090140] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-17T02:54:07.786898] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T02:54:07.890138] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-17T02:54:08.038502] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:54:08.564055] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T02:54:08.690158] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-17T02:54:09.490147] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-17T02:54:09.981833] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:54:10.290148] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-17T02:54:10.880445] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T02:54:11.090121] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-17T02:54:11.215977] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:54:11.890134] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-17T02:54:12.690139] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-17T02:54:12.731765] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:54:13.281603] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T02:54:13.474073] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T02:54:13.490125] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-17T02:54:14.290157] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-17T02:54:14.316011] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T02:54:15.090172] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-17T02:54:15.197972] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:54:15.890137] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-17T02:54:16.690089] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-17T02:54:17.173274] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T02:54:17.179981] [INFO ] [REMOTE ] CMS: Full fetch complete (75863 records). [2025-09-17T02:54:17.180142] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-17T02:54:17.346949] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:54:17.495302] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-17T02:54:17.604846] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-17T02:54:17.604969] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-17T02:54:17.605947] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-17T02:54:17.606048] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-17T02:54:17.607766] [DEBUG] [LOCAL ] CMS: Trimmed 75863 records to 52662 (keeping 200 days of data) [2025-09-17T02:54:17.943305] [DEBUG] [LOCAL ] CMS: Primary data saved (52662 records). [2025-09-17T02:54:17.943480] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-17T02:54:17.943614] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMS took 42.1s. Estimated remaining: 4h 34m 3s. Rate: 6.9 symbols/min [2025-09-17T02:54:18.119693] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:18.143159] [DEBUG] [LOCAL ] CNA: Loaded 24774 existing records from primary storage. [2025-09-17T02:54:18.143323] [INFO ] [MAIN ] CNA: Loaded 24774 existing records. [2025-09-17T02:54:18.248035] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T02:54:18.253676] [INFO ] [REMOTE ] CMSD: Full fetch complete (12642 records). [2025-09-17T02:54:18.274382] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-17T02:54:18.329218] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-17T02:54:18.385333] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:18.454320] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-17T02:54:18.519035] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-17T02:54:18.607587] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:54:18.616414] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-17T02:54:18.664079] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-17T02:54:18.872390] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-17T02:54:18.888176] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-17T02:54:18.927025] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-17T02:54:18.948029] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-17T02:54:18.948367] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T02:54:18.990997] [DEBUG] [LOCAL ] CMSD: Trimmed 12642 records to 8150 (keeping 200 days of data) [2025-09-17T02:54:19.098784] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-17T02:54:19.184921] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:19.198578] [DEBUG] [LOCAL ] CMSD: Primary data saved (8150 records). [2025-09-17T02:54:19.198757] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-17T02:54:19.198907] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMSD took 43.4s. Estimated remaining: 4h 33m 26s. Rate: 6.9 symbols/min [2025-09-17T02:54:19.366739] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:19.409830] [DEBUG] [LOCAL ] CNC: Loaded 40138 existing records from primary storage. [2025-09-17T02:54:19.410029] [INFO ] [MAIN ] CNC: Loaded 40138 existing records. [2025-09-17T02:54:19.586782] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:19.587043] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-17T02:54:19.587111] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-17T02:54:19.588174] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-17T02:54:19.588239] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-17T02:54:19.895251] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-17T02:54:19.947217] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:20.690199] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-11. [2025-09-17T02:54:20.750081] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T02:54:20.775180] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T02:54:21.490157] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-11. [2025-09-17T02:54:22.290097] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-17T02:54:22.456711] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T02:54:22.694797] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T02:54:23.091879] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-17T02:54:23.093693] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T02:54:23.890180] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-17T02:54:24.190880] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:54:24.690135] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-17T02:54:25.110105] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:54:25.490158] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-17T02:54:26.131794] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T02:54:26.290178] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-17T02:54:26.597227] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:54:26.836410] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T02:54:26.839947] [INFO ] [REMOTE ] CMU: Full fetch complete (9589 records). [2025-09-17T02:54:26.840070] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-17T02:54:27.094277] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-17T02:54:27.402510] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-17T02:54:27.402628] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-17T02:54:27.402934] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-17T02:54:27.403018] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-17T02:54:27.403622] [DEBUG] [LOCAL ] CMU: Trimmed 9589 records to 7307 (keeping 200 days of data) [2025-09-17T02:54:27.451226] [DEBUG] [LOCAL ] CMU: Primary data saved (7307 records). [2025-09-17T02:54:27.451439] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-17T02:54:27.451580] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMU took 26.7s. Estimated remaining: 4h 33m 15s. Rate: 6.9 symbols/min [2025-09-17T02:54:27.624958] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:27.634678] [DEBUG] [LOCAL ] CNF: Loaded 8738 existing records from primary storage. [2025-09-17T02:54:27.634831] [INFO ] [MAIN ] CNF: Loaded 8738 existing records. [2025-09-17T02:54:27.814399] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:27.814718] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-17T02:54:27.814798] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-17T02:54:27.815186] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-17T02:54:27.815265] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-17T02:54:27.895223] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-17T02:54:28.169464] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:28.690141] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-11. [2025-09-17T02:54:28.912557] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:54:29.126119] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T02:54:29.420005] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:54:29.490136] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-17T02:54:30.290142] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-17T02:54:30.550788] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T02:54:31.090183] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-17T02:54:31.635976] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T02:54:31.890094] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-17T02:54:32.312187] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T02:54:32.690151] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-17T02:54:33.329938] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T02:54:33.490143] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-17T02:54:33.797301] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T02:54:33.913613] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T02:54:34.290151] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-17T02:54:35.090190] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-17T02:54:35.890119] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-17T02:54:36.176032] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:54:36.198634] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:54:36.203189] [INFO ] [REMOTE ] CMTG: Full fetch complete (52837 records). [2025-09-17T02:54:36.203324] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-17T02:54:36.584909] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-17T02:54:36.585020] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-17T02:54:36.585713] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-17T02:54:36.585772] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-17T02:54:36.586995] [DEBUG] [LOCAL ] CMTG: Trimmed 52837 records to 37899 (keeping 200 days of data) [2025-09-17T02:54:36.690267] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-17T02:54:36.805784] [DEBUG] [LOCAL ] CMTG: Primary data saved (37899 records). [2025-09-17T02:54:36.805964] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-17T02:54:36.806067] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMTG took 41.0s. Estimated remaining: 4h 33m 9s. Rate: 6.9 symbols/min [2025-09-17T02:54:36.973756] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:37.012442] [DEBUG] [LOCAL ] CNH: Loaded 39916 existing records from primary storage. [2025-09-17T02:54:37.012612] [INFO ] [MAIN ] CNH: Loaded 39916 existing records. [2025-09-17T02:54:37.191114] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:37.191476] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-17T02:54:37.191547] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-17T02:54:37.198478] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-17T02:54:37.209309] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-17T02:54:37.280568] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T02:54:37.496126] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-17T02:54:37.573170] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:38.290157] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-17T02:54:38.506711] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:54:38.561864] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:54:38.748532] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:54:39.090182] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-11. [2025-09-17T02:54:39.890148] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-17T02:54:40.516692] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:54:40.690109] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-17T02:54:41.463778] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:54:41.490082] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-17T02:54:42.085592] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:54:42.290131] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-17T02:54:43.090119] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-17T02:54:43.115180] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T02:54:43.769915] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T02:54:43.890119] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-17T02:54:44.260613] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T02:54:44.690149] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-17T02:54:44.953921] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T02:54:45.490150] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-17T02:54:46.290137] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-17T02:54:46.322069] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T02:54:46.978733] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T02:54:47.090135] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-17T02:54:47.890116] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-17T02:54:48.188469] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T02:54:48.690188] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-17T02:54:48.865109] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T02:54:49.263213] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T02:54:49.275405] [INFO ] [REMOTE ] CNC: Full fetch complete (77508 records). [2025-09-17T02:54:49.275597] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-17T02:54:49.496426] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-17T02:54:49.686058] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-17T02:54:49.686207] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-17T02:54:49.687572] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-17T02:54:49.687727] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-17T02:54:49.689547] [DEBUG] [LOCAL ] CNC: Trimmed 77508 records to 53728 (keeping 200 days of data) [2025-09-17T02:54:50.033392] [DEBUG] [LOCAL ] CNC: Primary data saved (53728 records). [2025-09-17T02:54:50.033633] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-17T02:54:50.033809] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CNC took 30.8s. Estimated remaining: 4h 33m 18s. Rate: 6.9 symbols/min [2025-09-17T02:54:50.244366] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:50.288798] [DEBUG] [LOCAL ] CNI: Loaded 38509 existing records from primary storage. [2025-09-17T02:54:50.289284] [INFO ] [MAIN ] CNI: Loaded 38509 existing records. [2025-09-17T02:54:50.310767] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-17T02:54:50.494359] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:54:50.523676] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:50.524382] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-17T02:54:50.524572] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-17T02:54:50.525607] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-17T02:54:50.525704] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-17T02:54:50.889334] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:50.908341] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T02:54:51.090119] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-11. [2025-09-17T02:54:51.149706] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T02:54:51.890171] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-17T02:54:52.690122] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-17T02:54:52.778476] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T02:54:52.952481] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T02:54:53.490125] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-17T02:54:54.290130] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-17T02:54:54.488473] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T02:54:54.748261] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:54:55.090119] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-17T02:54:55.890140] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-17T02:54:55.986178] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:54:56.690147] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-17T02:54:56.944244] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T02:54:57.490205] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-17T02:54:58.290197] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-17T02:55:01.278869] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (4.59 seconds). [2025-09-17T02:55:01.281706] [INFO ] [REMOTE ] CNF: Full fetch complete (12551 records). [2025-09-17T02:55:01.281807] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-17T02:55:01.659247] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-17T02:55:01.659374] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-17T02:55:01.659809] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-17T02:55:01.659891] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-17T02:55:01.660629] [DEBUG] [LOCAL ] CNF: Trimmed 12551 records to 10664 (keeping 200 days of data) [2025-09-17T02:55:01.724346] [DEBUG] [LOCAL ] CNF: Primary data saved (10664 records). [2025-09-17T02:55:01.724525] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-17T02:55:01.724680] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNF took 34.3s. Estimated remaining: 4h 33m 21s. Rate: 6.9 symbols/min [2025-09-17T02:55:01.896583] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:01.936844] [DEBUG] [LOCAL ] CNK: Loaded 39385 existing records from primary storage. [2025-09-17T02:55:01.937012] [INFO ] [MAIN ] CNK: Loaded 39385 existing records. [2025-09-17T02:55:02.124504] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (4.63 seconds). [2025-09-17T02:55:02.162669] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:02.163436] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-17T02:55:02.163830] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-17T02:55:02.163885] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-17T02:55:02.165895] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-17T02:55:02.166016] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-17T02:55:02.291860] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (6.40 seconds). [2025-09-17T02:55:02.399505] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-17T02:55:02.564808] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:02.565229] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-11. [2025-09-17T02:55:02.593846] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (4.30 seconds). [2025-09-17T02:55:02.604674] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-17T02:55:03.935330] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:55:03.943090] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-17T02:55:03.971876] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T02:55:03.983370] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-17T02:55:04.015919] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:55:04.025822] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-17T02:55:04.283923] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T02:55:04.690126] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-17T02:55:04.997567] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T02:55:05.002522] [INFO ] [REMOTE ] CNA: Full fetch complete (45184 records). [2025-09-17T02:55:05.002668] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-17T02:55:05.380746] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-17T02:55:05.380847] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-17T02:55:05.381397] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-17T02:55:05.381449] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-17T02:55:05.383461] [DEBUG] [LOCAL ] CNA: Trimmed 45184 records to 32891 (keeping 200 days of data) [2025-09-17T02:55:05.615571] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T02:55:05.630448] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-17T02:55:05.667684] [DEBUG] [LOCAL ] CNA: Primary data saved (32891 records). [2025-09-17T02:55:05.671103] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-17T02:55:05.671449] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNA took 47.7s. Estimated remaining: 4h 32m 54s. Rate: 6.9 symbols/min [2025-09-17T02:55:05.707407] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T02:55:05.867952] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:05.907911] [DEBUG] [LOCAL ] CNM: Loaded 37677 existing records from primary storage. [2025-09-17T02:55:05.908089] [INFO ] [MAIN ] CNM: Loaded 37677 existing records. [2025-09-17T02:55:06.095281] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:06.095568] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-17T02:55:06.095773] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-17T02:55:06.096718] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-17T02:55:06.096788] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-17T02:55:06.232533] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:55:06.312554] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-17T02:55:06.499413] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:07.090119] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-11. [2025-09-17T02:55:07.374299] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T02:55:07.898316] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-17T02:55:07.920563] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:55:08.499623] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T02:55:08.690190] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-17T02:55:09.127209] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:55:09.134220] [INFO ] [REMOTE ] CNH: Full fetch complete (77373 records). [2025-09-17T02:55:09.134361] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-17T02:55:09.490139] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-17T02:55:09.534756] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-17T02:55:09.534876] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-17T02:55:09.535757] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-17T02:55:09.535830] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-17T02:55:09.539371] [DEBUG] [LOCAL ] CNH: Trimmed 77373 records to 53563 (keeping 200 days of data) [2025-09-17T02:55:09.896280] [DEBUG] [LOCAL ] CNH: Primary data saved (53563 records). [2025-09-17T02:55:09.896438] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-17T02:55:09.896544] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNH took 33.1s. Estimated remaining: 4h 32m 28s. Rate: 6.9 symbols/min [2025-09-17T02:55:10.075731] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:10.098553] [DEBUG] [LOCAL ] CNMD: Loaded 23618 existing records from primary storage. [2025-09-17T02:55:10.098749] [INFO ] [MAIN ] CNMD: Loaded 23618 existing records. [2025-09-17T02:55:10.288601] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:10.289123] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-17T02:55:10.289191] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-17T02:55:10.289934] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-17T02:55:10.289996] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-17T02:55:10.301078] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-17T02:55:10.512062] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:55:10.712007] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:11.090147] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-17T02:55:11.271227] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:55:11.890137] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-17T02:55:12.144054] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:55:12.463069] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:55:12.690149] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-17T02:55:13.490127] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-11. [2025-09-17T02:55:13.667281] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:55:14.290171] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-17T02:55:14.395263] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T02:55:14.595977] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:55:15.090124] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-17T02:55:15.857863] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:55:15.890077] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-17T02:55:16.690123] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-17T02:55:17.013599] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:55:17.453386] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:55:17.490118] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-17T02:55:18.290123] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-17T02:55:18.338307] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:55:18.734704] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:55:19.090202] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-17T02:55:19.731512] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:55:19.890123] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-17T02:55:20.649242] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:55:20.690093] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-17T02:55:21.490193] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-17T02:55:21.761772] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:55:22.290135] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-17T02:55:22.406229] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:55:23.090171] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-17T02:55:23.294413] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T02:55:23.424721] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:55:23.890193] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-17T02:55:24.690122] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-17T02:55:24.835567] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:55:25.490123] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-17T02:55:25.691840] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T02:55:26.290250] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-17T02:55:26.370978] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T02:55:26.377360] [INFO ] [REMOTE ] CNI: Full fetch complete (74545 records). [2025-09-17T02:55:26.377507] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-17T02:55:26.762066] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-17T02:55:26.762171] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-17T02:55:26.763007] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-17T02:55:26.763086] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-17T02:55:26.764526] [DEBUG] [LOCAL ] CNI: Trimmed 74545 records to 51669 (keeping 200 days of data) [2025-09-17T02:55:27.103928] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-17T02:55:27.130159] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T02:55:27.138454] [INFO ] [REMOTE ] CNK: Full fetch complete (75436 records). [2025-09-17T02:55:27.139348] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-17T02:55:27.330075] [DEBUG] [LOCAL ] CNI: Primary data saved (51669 records). [2025-09-17T02:55:27.416329] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-17T02:55:27.448274] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNI took 37.4s. Estimated remaining: 4h 32m 53s. Rate: 6.9 symbols/min [2025-09-17T02:55:27.684594] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-17T02:55:27.711086] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-17T02:55:27.713411] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:27.714343] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-17T02:55:27.714738] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-17T02:55:27.716541] [DEBUG] [LOCAL ] CNK: Trimmed 75436 records to 52898 (keeping 200 days of data) [2025-09-17T02:55:27.831774] [DEBUG] [LOCAL ] CNNE: Loaded 26562 existing records from primary storage. [2025-09-17T02:55:27.832869] [INFO ] [MAIN ] CNNE: Loaded 26562 existing records. [2025-09-17T02:55:28.026376] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:28.027839] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-17T02:55:28.028238] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-17T02:55:28.029506] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-17T02:55:28.029582] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-17T02:55:28.298200] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T02:55:28.360244] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-17T02:55:28.441889] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:28.466264] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T02:55:28.676330] [DEBUG] [LOCAL ] CNK: Primary data saved (52898 records). [2025-09-17T02:55:28.676500] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-17T02:55:28.676599] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNK took 27.0s. Estimated remaining: 4h 32m 15s. Rate: 6.9 symbols/min [2025-09-17T02:55:28.697198] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-11. [2025-09-17T02:55:28.849732] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:28.878265] [DEBUG] [LOCAL ] CNO: Loaded 29999 existing records from primary storage. [2025-09-17T02:55:28.878440] [INFO ] [MAIN ] CNO: Loaded 29999 existing records. [2025-09-17T02:55:29.055090] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:29.055350] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-17T02:55:29.055411] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-17T02:55:29.056242] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-17T02:55:29.056306] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-17T02:55:29.408188] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:29.490086] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-11. [2025-09-17T02:55:29.897857] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T02:55:30.095156] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:55:30.290151] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-17T02:55:30.644509] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:55:31.090236] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-17T02:55:31.255154] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:55:31.890214] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-17T02:55:32.690190] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-17T02:55:32.816709] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:55:33.344297] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:55:33.490151] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-17T02:55:34.290139] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-17T02:55:34.323181] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T02:55:34.609549] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T02:55:35.090137] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-17T02:55:35.900907] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-17T02:55:35.904205] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T02:55:36.504003] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:55:36.650082] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T02:55:36.690121] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-17T02:55:37.490186] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-17T02:55:37.853898] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:55:38.290171] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-17T02:55:39.034170] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T02:55:39.040536] [INFO ] [REMOTE ] CNM: Full fetch complete (73451 records). [2025-09-17T02:55:39.040715] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-17T02:55:39.099398] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-17T02:55:39.435066] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-17T02:55:39.435170] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-17T02:55:39.435991] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-17T02:55:39.436050] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-17T02:55:39.437485] [DEBUG] [LOCAL ] CNM: Trimmed 73451 records to 50935 (keeping 200 days of data) [2025-09-17T02:55:39.664364] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:55:39.776655] [DEBUG] [LOCAL ] CNM: Primary data saved (50935 records). [2025-09-17T02:55:39.776821] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-17T02:55:39.776919] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNM took 34.1s. Estimated remaining: 4h 32m 16s. Rate: 6.9 symbols/min [2025-09-17T02:55:39.895316] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-17T02:55:39.949523] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:39.985712] [DEBUG] [LOCAL ] CNP: Loaded 39844 existing records from primary storage. [2025-09-17T02:55:39.985887] [INFO ] [MAIN ] CNP: Loaded 39844 existing records. [2025-09-17T02:55:40.166945] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:40.167266] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-17T02:55:40.167343] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-17T02:55:40.168400] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-17T02:55:40.168481] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-17T02:55:40.530349] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:40.690087] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-11. [2025-09-17T02:55:40.773473] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T02:55:41.206755] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T02:55:41.490164] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-17T02:55:42.290185] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-17T02:55:42.442526] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:55:43.054988] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:55:43.090111] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-17T02:55:43.764349] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:55:43.890134] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-17T02:55:44.690187] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-17T02:55:44.911309] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T02:55:44.938220] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:55:45.490120] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-17T02:55:46.094569] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T02:55:46.290130] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-17T02:55:47.081060] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T02:55:47.090018] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-17T02:55:47.420632] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T02:55:47.890153] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-17T02:55:48.499372] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:55:48.690160] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-17T02:55:48.882233] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T02:55:48.886118] [INFO ] [REMOTE ] CNMD: Full fetch complete (46780 records). [2025-09-17T02:55:48.886240] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-17T02:55:49.257814] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-17T02:55:49.257914] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-17T02:55:49.258423] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-17T02:55:49.258476] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-17T02:55:49.259514] [DEBUG] [LOCAL ] CNMD: Trimmed 46780 records to 32711 (keeping 200 days of data) [2025-09-17T02:55:49.457705] [DEBUG] [LOCAL ] CNMD: Primary data saved (32711 records). [2025-09-17T02:55:49.457859] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-17T02:55:49.457952] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNMD took 39.6s. Estimated remaining: 4h 32m 11s. Rate: 6.9 symbols/min [2025-09-17T02:55:49.495296] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-17T02:55:49.632191] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:49.669092] [DEBUG] [LOCAL ] CNQ: Loaded 39941 existing records from primary storage. [2025-09-17T02:55:49.669405] [INFO ] [MAIN ] CNQ: Loaded 39941 existing records. [2025-09-17T02:55:49.849935] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:49.850248] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-17T02:55:49.850308] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-17T02:55:49.851723] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-17T02:55:49.851798] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-17T02:55:49.988728] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T02:55:50.267304] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:50.290110] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-17T02:55:50.842228] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T02:55:51.090177] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-11. [2025-09-17T02:55:51.890163] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-17T02:55:52.070086] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T02:55:52.690149] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-17T02:55:52.884063] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:55:53.209520] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T02:55:53.490175] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-17T02:55:53.794820] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:55:54.290145] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-17T02:55:54.976740] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T02:55:55.090133] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-17T02:55:55.839506] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T02:55:55.890100] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-17T02:55:56.690135] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-17T02:55:56.930726] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:55:57.490149] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-17T02:55:57.643866] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T02:55:58.067070] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T02:55:58.072313] [INFO ] [REMOTE ] CNO: Full fetch complete (60233 records). [2025-09-17T02:55:58.072453] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-17T02:55:58.295245] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-17T02:55:58.475121] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-17T02:55:58.475221] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-17T02:55:58.475933] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-17T02:55:58.475993] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-17T02:55:58.477151] [DEBUG] [LOCAL ] CNO: Trimmed 60233 records to 41625 (keeping 200 days of data) [2025-09-17T02:55:58.752633] [DEBUG] [LOCAL ] CNO: Primary data saved (41625 records). [2025-09-17T02:55:58.752810] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-17T02:55:58.752906] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNO took 30.1s. Estimated remaining: 4h 32m 4s. Rate: 6.9 symbols/min [2025-09-17T02:55:58.936394] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:58.962173] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T02:55:58.996503] [DEBUG] [LOCAL ] CNR: Loaded 32395 existing records from primary storage. [2025-09-17T02:55:58.996690] [INFO ] [MAIN ] CNR: Loaded 32395 existing records. [2025-09-17T02:55:59.099622] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-17T02:55:59.181468] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:59.181729] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-17T02:55:59.181795] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-17T02:55:59.182704] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-09-17T02:55:59.182773] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-17T02:55:59.531307] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:59.890111] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-17T02:55:59.987630] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T02:56:00.690136] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-17T02:56:01.100582] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:56:01.221552] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:56:01.226879] [INFO ] [REMOTE ] CNNE: Full fetch complete (48683 records). [2025-09-17T02:56:01.226999] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-17T02:56:01.495276] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-17T02:56:01.616044] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-17T02:56:01.616151] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-17T02:56:01.616767] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-17T02:56:01.616821] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-17T02:56:01.617875] [DEBUG] [LOCAL ] CNNE: Trimmed 48683 records to 36921 (keeping 200 days of data) [2025-09-17T02:56:01.843834] [DEBUG] [LOCAL ] CNNE: Primary data saved (36921 records). [2025-09-17T02:56:01.844006] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-17T02:56:01.844102] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNNE took 34.4s. Estimated remaining: 4h 31m 34s. Rate: 6.9 symbols/min [2025-09-17T02:56:02.012591] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:02.027953] [DEBUG] [LOCAL ] CNS: Loaded 14689 existing records from primary storage. [2025-09-17T02:56:02.028103] [INFO ] [MAIN ] CNS: Loaded 14689 existing records. [2025-09-17T02:56:02.204687] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:02.205051] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-17T02:56:02.205128] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-17T02:56:02.205624] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-17T02:56:02.205745] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-17T02:56:02.292340] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-11. [2025-09-17T02:56:02.593483] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:56:02.623127] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:02.623483] [WARN ] [REMOTE ] CNR: No data returned for month 2024-11 [2025-09-17T02:56:02.625991] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T02:56:03.090116] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-11. [2025-09-17T02:56:03.147566] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T02:56:03.885207] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:56:03.890075] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-17T02:56:04.690145] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-17T02:56:05.498956] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-17T02:56:05.525220] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T02:56:05.698587] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T02:56:06.290129] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-17T02:56:07.090139] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-17T02:56:07.297691] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:56:07.298040] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-17T02:56:07.327446] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:56:07.530928] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T02:56:07.890133] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-17T02:56:08.690154] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-17T02:56:09.490146] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-17T02:56:09.779468] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:56:09.917472] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T02:56:10.290123] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-17T02:56:10.554549] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:56:11.090132] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-17T02:56:11.831612] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T02:56:11.890124] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-17T02:56:12.218535] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T02:56:12.690197] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-17T02:56:13.490169] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-17T02:56:13.582251] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:56:14.290119] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-17T02:56:14.606768] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T02:56:14.751432] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T02:56:15.090139] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-17T02:56:15.898828] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-17T02:56:15.900896] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:56:15.931105] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:56:16.690122] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-17T02:56:17.490126] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-17T02:56:17.746120] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T02:56:17.768070] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T02:56:18.290134] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-17T02:56:19.090118] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-17T02:56:19.198318] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:56:19.344824] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T02:56:19.890139] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-17T02:56:20.690186] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-17T02:56:20.844908] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:56:21.490143] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-17T02:56:21.798781] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T02:56:21.829353] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T02:56:22.290150] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-17T02:56:23.090141] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-17T02:56:23.321853] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:56:23.890105] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-17T02:56:23.942168] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T02:56:24.690129] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-17T02:56:24.880086] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:56:25.490155] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-17T02:56:25.538960] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:56:26.202113] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T02:56:26.205059] [INFO ] [REMOTE ] CNS: Full fetch complete (29526 records). [2025-09-17T02:56:26.205150] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-17T02:56:26.295330] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-17T02:56:26.615221] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-17T02:56:26.616706] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T02:56:26.616878] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-17T02:56:26.627032] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-17T02:56:26.627544] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-17T02:56:26.628808] [DEBUG] [LOCAL ] CNS: Trimmed 29526 records to 21168 (keeping 200 days of data) [2025-09-17T02:56:26.758498] [DEBUG] [LOCAL ] CNS: Primary data saved (21168 records). [2025-09-17T02:56:26.758674] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-17T02:56:26.758773] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNS took 24.9s. Estimated remaining: 4h 32m 27s. Rate: 6.9 symbols/min [2025-09-17T02:56:26.927560] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:26.968426] [DEBUG] [LOCAL ] CNX: Loaded 38164 existing records from primary storage. [2025-09-17T02:56:26.968614] [INFO ] [MAIN ] CNX: Loaded 38164 existing records. [2025-09-17T02:56:27.095278] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-17T02:56:27.149149] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:27.149364] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-17T02:56:27.149429] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-17T02:56:27.150302] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-17T02:56:27.150368] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-17T02:56:27.502498] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:27.898248] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-17T02:56:27.908003] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:56:27.914802] [INFO ] [REMOTE ] CNP: Full fetch complete (77189 records). [2025-09-17T02:56:27.914946] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-17T02:56:28.310836] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-17T02:56:28.310979] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-17T02:56:28.311838] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-17T02:56:28.311922] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-17T02:56:28.313701] [DEBUG] [LOCAL ] CNP: Trimmed 77189 records to 53469 (keeping 200 days of data) [2025-09-17T02:56:28.429392] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T02:56:28.681662] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-17T02:56:28.681902] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-17T02:56:28.682042] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNP took 48.9s. Estimated remaining: 4h 31m 53s. Rate: 6.9 symbols/min [2025-09-17T02:56:28.695581] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-17T02:56:28.856061] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:28.884822] [DEBUG] [LOCAL ] CODI: Loaded 31403 existing records from primary storage. [2025-09-17T02:56:28.885004] [INFO ] [MAIN ] CODI: Loaded 31403 existing records. [2025-09-17T02:56:29.061854] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:29.062118] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-17T02:56:29.062168] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-17T02:56:29.062841] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-17T02:56:29.062900] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-17T02:56:29.419425] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:29.435967] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T02:56:29.442497] [INFO ] [REMOTE ] CNQ: Full fetch complete (77380 records). [2025-09-17T02:56:29.442695] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-17T02:56:29.497000] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-11. [2025-09-17T02:56:29.919735] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-17T02:56:29.919916] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-17T02:56:29.921537] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-17T02:56:29.921678] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-17T02:56:29.923924] [DEBUG] [LOCAL ] CNQ: Trimmed 77380 records to 53584 (keeping 200 days of data) [2025-09-17T02:56:30.311033] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-11. [2025-09-17T02:56:30.339368] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T02:56:30.349573] [INFO ] [REMOTE ] CNR: Full fetch complete (54383 records). [2025-09-17T02:56:30.351790] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-17T02:56:30.663725] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-17T02:56:30.665034] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:56:30.669929] [DEBUG] [LOCAL ] CNQ: Primary data saved (53584 records). [2025-09-17T02:56:30.670245] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-17T02:56:30.670434] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNQ took 41.2s. Estimated remaining: 4h 31m 19s. Rate: 6.9 symbols/min [2025-09-17T02:56:30.670132] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:56:30.676529] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-17T02:56:30.710588] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-17T02:56:30.764593] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-17T02:56:30.812169] [DEBUG] [LOCAL ] CNR: Deleted derivative data file. [2025-09-17T02:56:30.823024] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNR took 32.1s. Estimated remaining: 4h 30m 38s. Rate: 6.9 symbols/min [2025-09-17T02:56:31.016545] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:31.102310] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:31.152568] [DEBUG] [LOCAL ] COF: Loaded 39987 existing records from primary storage. [2025-09-17T02:56:31.163438] [INFO ] [MAIN ] COF: Loaded 39987 existing records. [2025-09-17T02:56:31.187794] [DEBUG] [LOCAL ] COHR: Loaded 39783 existing records from primary storage. [2025-09-17T02:56:31.213069] [INFO ] [MAIN ] COHR: Loaded 39783 existing records. [2025-09-17T02:56:31.510422] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:31.530856] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-17T02:56:31.534686] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:31.534561] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-17T02:56:31.535041] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-17T02:56:31.549163] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:56:31.549269] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-17T02:56:31.554599] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-17T02:56:31.554908] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-17T02:56:31.555162] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-17T02:56:31.579972] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-17T02:56:31.626226] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-17T02:56:31.671817] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T02:56:31.899976] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-17T02:56:32.255826] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:32.340151] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:32.690150] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-11. [2025-09-17T02:56:32.759499] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:56:33.385779] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T02:56:33.490142] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-17T02:56:34.290145] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-11. [2025-09-17T02:56:34.552820] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:56:35.095245] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-17T02:56:35.121678] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T02:56:35.189701] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T02:56:35.890137] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-17T02:56:36.640044] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:56:36.690093] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-17T02:56:36.999865] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T02:56:37.490145] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-17T02:56:38.290152] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-17T02:56:38.380751] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:56:39.095230] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-17T02:56:39.121172] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:56:39.389532] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T02:56:39.895224] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-17T02:56:39.902944] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:56:40.348092] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:56:40.690147] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-17T02:56:41.490140] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-17T02:56:42.005456] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T02:56:42.290137] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-17T02:56:43.087991] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:56:43.097381] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-17T02:56:43.290909] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:56:43.890152] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-17T02:56:44.450105] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:56:44.690130] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-17T02:56:45.490171] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-17T02:56:45.661440] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T02:56:46.226872] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T02:56:46.290125] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-17T02:56:47.090132] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-17T02:56:47.155423] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:56:47.890135] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-17T02:56:47.993154] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T02:56:48.690164] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-17T02:56:48.757214] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:56:49.192856] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T02:56:49.490166] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-17T02:56:49.530845] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T02:56:50.290183] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-17T02:56:51.090127] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-17T02:56:51.129022] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T02:56:51.467002] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T02:56:51.890129] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-17T02:56:52.420039] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T02:56:52.690182] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-17T02:56:52.751995] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T02:56:53.490117] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-17T02:56:54.244323] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T02:56:54.290096] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-17T02:56:54.967632] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T02:56:55.090135] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-17T02:56:55.894560] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-17T02:56:55.902350] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T02:56:56.693984] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T02:56:56.690169] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-17T02:56:57.063090] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T02:56:57.490131] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-17T02:56:57.866566] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T02:56:58.000393] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T02:56:58.004902] [INFO ] [REMOTE ] CODI: Full fetch complete (49695 records). [2025-09-17T02:56:58.005042] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-17T02:56:58.295254] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-17T02:56:58.412676] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-17T02:56:58.412782] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-17T02:56:58.413403] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-17T02:56:58.413458] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-17T02:56:58.414557] [DEBUG] [LOCAL ] CODI: Trimmed 49695 records to 39540 (keeping 200 days of data) [2025-09-17T02:56:58.638876] [DEBUG] [LOCAL ] CODI: Primary data saved (39540 records). [2025-09-17T02:56:58.639048] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-17T02:56:58.639144] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CODI took 30.0s. Estimated remaining: 4h 31m 41s. Rate: 6.9 symbols/min [2025-09-17T02:56:58.805098] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:58.841847] [DEBUG] [LOCAL ] COLD: Loaded 39001 existing records from primary storage. [2025-09-17T02:56:58.842019] [INFO ] [MAIN ] COLD: Loaded 39001 existing records. [2025-09-17T02:56:59.019990] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:59.020286] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-17T02:56:59.020348] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-17T02:56:59.021108] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-17T02:56:59.021166] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-17T02:56:59.095199] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-17T02:56:59.383717] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:59.890132] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-17T02:57:00.095366] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T02:57:00.690180] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-17T02:57:01.418843] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T02:57:01.490096] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-17T02:57:02.143205] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-17T02:57:02.290128] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-17T02:57:02.882264] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T02:57:03.090129] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-11. [2025-09-17T02:57:03.573096] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T02:57:03.579536] [INFO ] [REMOTE ] COHR: Full fetch complete (76932 records). [2025-09-17T02:57:03.579698] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-17T02:57:03.895208] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-17T02:57:03.976155] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-17T02:57:03.976257] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-17T02:57:03.977079] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-17T02:57:03.977163] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-17T02:57:03.978612] [DEBUG] [LOCAL ] COHR: Trimmed 76932 records to 53372 (keeping 200 days of data) [2025-09-17T02:57:04.316603] [DEBUG] [LOCAL ] COHR: Primary data saved (53372 records). [2025-09-17T02:57:04.316799] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-17T02:57:04.316929] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. COHR took 33.5s. Estimated remaining: 4h 31m 20s. Rate: 6.9 symbols/min [2025-09-17T02:57:04.490602] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:04.530787] [DEBUG] [LOCAL ] COMP: Loaded 39767 existing records from primary storage. [2025-09-17T02:57:04.530963] [INFO ] [MAIN ] COMP: Loaded 39767 existing records. [2025-09-17T02:57:04.709919] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:04.710194] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-17T02:57:04.710255] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-17T02:57:04.711055] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-17T02:57:04.711116] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-17T02:57:05.069173] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:05.069511] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-11. [2025-09-17T02:57:05.434334] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (3.14 seconds). [2025-09-17T02:57:05.490133] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-17T02:57:05.541242] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-11 (2.45 seconds). [2025-09-17T02:57:05.602791] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T02:57:05.612125] [INFO ] [REMOTE ] CNX: Full fetch complete (74550 records). [2025-09-17T02:57:05.612287] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-17T02:57:06.003230] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-17T02:57:06.003397] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-17T02:57:06.004302] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-17T02:57:06.004386] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-17T02:57:06.007055] [DEBUG] [LOCAL ] CNX: Trimmed 74550 records to 51387 (keeping 200 days of data) [2025-09-17T02:57:06.301450] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-17T02:57:06.325283] [DEBUG] [LOCAL ] CNX: Primary data saved (51387 records). [2025-09-17T02:57:06.325472] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-17T02:57:06.325609] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CNX took 39.6s. Estimated remaining: 4h 30m 47s. Rate: 6.9 symbols/min [2025-09-17T02:57:06.497723] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:06.497934] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-09-17T02:57:06.497984] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-09-17T02:57:06.498102] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-17T02:57:06.498153] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-17T02:57:06.498204] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-09-17T02:57:06.498247] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-17T02:57:06.861615] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:06.894961] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T02:57:07.079354] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:57:07.087340] [INFO ] [REMOTE ] COF: Full fetch complete (77213 records). [2025-09-17T02:57:07.087509] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-17T02:57:07.100621] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-11. [2025-09-17T02:57:07.487146] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-17T02:57:07.487262] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-17T02:57:07.488287] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-17T02:57:07.488370] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-17T02:57:07.490886] [DEBUG] [LOCAL ] COF: Trimmed 77213 records to 53612 (keeping 200 days of data) [2025-09-17T02:57:07.837828] [DEBUG] [LOCAL ] COF: Primary data saved (53612 records). [2025-09-17T02:57:07.837997] [INFO ] [MAIN ] COF: Full history saved. [2025-09-17T02:57:07.839733] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COF took 37.2s. Estimated remaining: 4h 30m 12s. Rate: 6.9 symbols/min [2025-09-17T02:57:07.895419] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-17T02:57:08.016748] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:08.051994] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T02:57:08.078444] [DEBUG] [LOCAL ] COOK: Loaded 18606 existing records from primary storage. [2025-09-17T02:57:08.078601] [INFO ] [MAIN ] COOK: Loaded 18606 existing records. [2025-09-17T02:57:08.258958] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:08.259216] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-17T02:57:08.259295] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-17T02:57:08.259812] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-17T02:57:08.259919] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-17T02:57:08.634985] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:08.658809] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:57:08.690095] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-17T02:57:09.490133] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-11. [2025-09-17T02:57:09.611266] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T02:57:10.220767] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:57:10.285142] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:57:10.290070] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-17T02:57:11.090146] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-17T02:57:11.410919] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:57:11.890145] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-17T02:57:12.690163] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-17T02:57:12.838587] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T02:57:13.123616] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T02:57:13.490149] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-17T02:57:13.974187] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T02:57:14.290201] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-17T02:57:14.862452] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:57:15.090175] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-17T02:57:15.890114] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-17T02:57:15.956284] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T02:57:16.011068] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T02:57:16.690202] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-17T02:57:17.428981] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T02:57:17.490088] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-17T02:57:18.290155] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-17T02:57:18.406410] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:57:19.090180] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-17T02:57:19.890128] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-17T02:57:20.043937] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-17T02:57:20.654203] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-17T02:57:20.690119] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-17T02:57:20.756731] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T02:57:21.336005] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T02:57:21.490119] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-17T02:57:22.290190] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-17T02:57:22.445797] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:57:22.564707] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:57:23.090207] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-17T02:57:23.869076] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T02:57:23.890093] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-17T02:57:24.690156] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-17T02:57:24.910403] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:57:25.405134] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T02:57:25.495249] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-17T02:57:25.504097] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T02:57:26.290197] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-17T02:57:27.090182] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-17T02:57:27.287567] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:57:27.578853] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:57:27.890151] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-17T02:57:28.690169] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-17T02:57:28.913437] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T02:57:29.490178] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-17T02:57:29.623396] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:57:29.687929] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T02:57:30.290145] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-17T02:57:31.090199] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-17T02:57:31.214191] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:57:31.240121] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T02:57:31.890164] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-17T02:57:32.452946] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T02:57:32.690123] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-17T02:57:33.141599] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T02:57:33.490159] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-17T02:57:34.290192] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-17T02:57:34.342026] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:57:34.350609] [INFO ] [REMOTE ] COLD: Full fetch complete (73794 records). [2025-09-17T02:57:34.350836] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-17T02:57:34.762345] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-17T02:57:34.762459] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-17T02:57:34.763270] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-17T02:57:34.763330] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-17T02:57:34.764867] [DEBUG] [LOCAL ] COLD: Trimmed 73794 records to 51879 (keeping 200 days of data) [2025-09-17T02:57:34.891321] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T02:57:35.104150] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-17T02:57:35.125854] [DEBUG] [LOCAL ] COLD: Primary data saved (51879 records). [2025-09-17T02:57:35.125989] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-17T02:57:35.126091] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COLD took 36.5s. Estimated remaining: 4h 31m 11s. Rate: 6.9 symbols/min [2025-09-17T02:57:35.308517] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:35.354542] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:57:35.355320] [DEBUG] [LOCAL ] COP: Loaded 40077 existing records from primary storage. [2025-09-17T02:57:35.358884] [INFO ] [MAIN ] COP: Loaded 40077 existing records. [2025-09-17T02:57:35.403913] [INFO ] [REMOTE ] COOK: Full fetch complete (32706 records). [2025-09-17T02:57:35.436853] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-17T02:57:35.644739] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:35.655810] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-17T02:57:35.671187] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-17T02:57:35.701118] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-17T02:57:35.701236] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-17T02:57:35.901484] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-17T02:57:36.239225] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-17T02:57:36.239382] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-17T02:57:36.250860] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-17T02:57:36.261312] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-17T02:57:36.322456] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:36.323289] [DEBUG] [LOCAL ] COOK: Trimmed 32706 records to 24123 (keeping 200 days of data) [2025-09-17T02:57:36.460737] [DEBUG] [LOCAL ] COOK: Primary data saved (24123 records). [2025-09-17T02:57:36.460911] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-17T02:57:36.461009] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COOK took 28.6s. Estimated remaining: 4h 30m 36s. Rate: 6.9 symbols/min [2025-09-17T02:57:36.630266] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:36.654184] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T02:57:36.696302] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-11. [2025-09-17T02:57:36.699995] [DEBUG] [LOCAL ] COR: Loaded 34601 existing records from primary storage. [2025-09-17T02:57:36.700175] [INFO ] [MAIN ] COR: Loaded 34601 existing records. [2025-09-17T02:57:36.879853] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:36.880129] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-17T02:57:36.880186] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-17T02:57:36.881074] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-17T02:57:36.881133] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-17T02:57:37.232580] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:37.391221] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:57:37.490162] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-11. [2025-09-17T02:57:38.290170] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-17T02:57:38.359483] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:57:39.090138] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-17T02:57:39.164533] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T02:57:39.890153] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-17T02:57:40.158686] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:57:40.690108] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-17T02:57:41.066928] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T02:57:41.340918] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:57:41.490147] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-17T02:57:42.293863] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-17T02:57:42.295147] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:57:42.303186] [INFO ] [REMOTE ] COMP: Full fetch complete (76867 records). [2025-09-17T02:57:42.303339] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-17T02:57:42.705394] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-17T02:57:42.705516] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-17T02:57:42.706419] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-17T02:57:42.706483] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-17T02:57:42.708073] [DEBUG] [LOCAL ] COMP: Trimmed 76867 records to 53386 (keeping 200 days of data) [2025-09-17T02:57:43.025136] [DEBUG] [LOCAL ] COMP: Primary data saved (53386 records). [2025-09-17T02:57:43.025306] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-17T02:57:43.025420] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. COMP took 38.7s. Estimated remaining: 4h 30m 19s. Rate: 6.9 symbols/min [2025-09-17T02:57:43.098742] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-17T02:57:43.196738] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:43.226771] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T02:57:43.267742] [DEBUG] [LOCAL ] COTY: Loaded 39719 existing records from primary storage. [2025-09-17T02:57:43.267914] [INFO ] [MAIN ] COTY: Loaded 39719 existing records. [2025-09-17T02:57:43.451226] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:43.451474] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-17T02:57:43.451533] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-17T02:57:43.452339] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-17T02:57:43.452402] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-17T02:57:43.806764] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:43.890164] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-11. [2025-09-17T02:57:44.096374] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:57:44.545550] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:57:44.551832] [INFO ] [REMOTE ] CON: Full fetch complete (57393 records). [2025-09-17T02:57:44.551955] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-17T02:57:44.695355] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-17T02:57:44.936254] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-17T02:57:44.936361] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-17T02:57:44.937127] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-17T02:57:44.937185] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-17T02:57:44.938344] [DEBUG] [LOCAL ] CON: Trimmed 57393 records to 38860 (keeping 200 days of data) [2025-09-17T02:57:45.177126] [DEBUG] [LOCAL ] CON: Primary data saved (38860 records). [2025-09-17T02:57:45.177315] [INFO ] [MAIN ] CON: Full history saved. [2025-09-17T02:57:45.177408] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. CON took 38.9s. Estimated remaining: 4h 29m 46s. Rate: 6.9 symbols/min [2025-09-17T02:57:45.346913] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:45.388565] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:57:45.428373] [DEBUG] [LOCAL ] COUR: Loaded 36689 existing records from primary storage. [2025-09-17T02:57:45.428557] [INFO ] [MAIN ] COUR: Loaded 36689 existing records. [2025-09-17T02:57:45.495341] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-17T02:57:45.608544] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:45.608833] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-17T02:57:45.608905] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-17T02:57:45.609748] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-17T02:57:45.609811] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-17T02:57:45.959280] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:46.290112] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-17T02:57:46.790480] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T02:57:46.890039] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T02:57:47.090201] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-17T02:57:47.890174] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-17T02:57:48.187611] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T02:57:48.515849] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:57:48.690178] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-17T02:57:49.490143] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-11. [2025-09-17T02:57:49.647306] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T02:57:50.290151] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-17T02:57:50.386304] [DEBUG] [REMOTE ] COTY: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T02:57:50.386687] [WARN ] [REMOTE ] COTY: No data returned for month 2025-02 [2025-09-17T02:57:50.540354] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T02:57:50.989290] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:57:51.090097] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-17T02:57:51.890139] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-17T02:57:52.690201] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-17T02:57:52.792875] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:57:53.490158] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-17T02:57:53.744110] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T02:57:54.290177] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-17T02:57:54.575569] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:57:55.090127] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-17T02:57:55.121404] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:57:55.890171] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-17T02:57:56.312446] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T02:57:56.507238] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T02:57:56.690164] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-17T02:57:57.302338] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:57:57.490107] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-17T02:57:58.290143] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-17T02:57:58.554014] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T02:57:59.090262] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-17T02:57:59.328270] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T02:57:59.877053] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T02:57:59.890080] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-17T02:58:00.690152] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-17T02:58:01.113105] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T02:58:01.348239] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:58:01.490090] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-17T02:58:02.290186] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-17T02:58:02.410001] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T02:58:03.090160] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-17T02:58:03.274074] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T02:58:03.890166] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-17T02:58:04.118098] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:58:04.690181] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-17T02:58:05.182864] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-17T02:58:05.490135] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-17T02:58:05.629252] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T02:58:05.915507] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:58:06.290141] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-17T02:58:07.090158] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-17T02:58:07.413268] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:58:07.890115] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-17T02:58:07.952862] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:58:08.690151] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-17T02:58:08.890098] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T02:58:09.464808] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:58:09.490116] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-17T02:58:10.243514] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:58:10.290091] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-17T02:58:11.090136] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-17T02:58:11.498354] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T02:58:11.817483] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T02:58:11.890103] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-17T02:58:12.610230] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T02:58:12.616151] [INFO ] [REMOTE ] COR: Full fetch complete (68678 records). [2025-09-17T02:58:12.616333] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-17T02:58:12.695193] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-17T02:58:13.015542] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-17T02:58:13.015681] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-17T02:58:13.016442] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-17T02:58:13.016538] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-17T02:58:13.017947] [DEBUG] [LOCAL ] COR: Trimmed 68678 records to 47345 (keeping 200 days of data) [2025-09-17T02:58:13.325048] [DEBUG] [LOCAL ] COR: Primary data saved (47345 records). [2025-09-17T02:58:13.325216] [INFO ] [MAIN ] COR: Full history saved. [2025-09-17T02:58:13.325312] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COR took 36.9s. Estimated remaining: 4h 30m 49s. Rate: 6.9 symbols/min [2025-09-17T02:58:13.499698] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:13.494150] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-17T02:58:13.535256] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:58:13.582756] [DEBUG] [LOCAL ] CP: Loaded 39666 existing records from primary storage. [2025-09-17T02:58:13.582941] [INFO ] [MAIN ] CP: Loaded 39666 existing records. [2025-09-17T02:58:13.758212] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:13.758495] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-17T02:58:13.758553] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-17T02:58:13.759350] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-17T02:58:13.759415] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-17T02:58:14.150555] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:14.290142] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-11. [2025-09-17T02:58:14.675176] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T02:58:14.681793] [INFO ] [REMOTE ] COP: Full fetch complete (77626 records). [2025-09-17T02:58:14.681966] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-17T02:58:15.096537] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-17T02:58:15.100981] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-17T02:58:15.102064] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-17T02:58:15.103098] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-17T02:58:15.103433] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-17T02:58:15.106058] [DEBUG] [LOCAL ] COP: Trimmed 77626 records to 53727 (keeping 200 days of data) [2025-09-17T02:58:15.431175] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T02:58:15.489750] [INFO ] [REMOTE ] COTY: Full fetch complete (69547 records). [2025-09-17T02:58:15.490023] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-17T02:58:15.984063] [WARN ] [VALIDATOR ] COTY: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T02:58:15.986232] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:58:15.995279] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-17T02:58:15.986833] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:58:15.995543] [INFO ] [MAIN ] COP: Full history saved. [2025-09-17T02:58:15.995922] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-17T02:58:15.996246] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COP took 40.9s. Estimated remaining: 4h 30m 18s. Rate: 6.9 symbols/min [2025-09-17T02:58:15.996874] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-17T02:58:16.018412] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-09-17T02:58:16.068802] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-09-17T02:58:16.138188] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COTY took 33.1s. Estimated remaining: 4h 29m 38s. Rate: 6.9 symbols/min [2025-09-17T02:58:16.200797] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:58:16.292573] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-17T02:58:16.367132] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:16.452047] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:16.452246] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-17T02:58:16.452296] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-17T02:58:16.452406] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-17T02:58:16.452459] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-17T02:58:16.452509] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-17T02:58:16.452551] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-17T02:58:16.565988] [DEBUG] [LOCAL ] CPA: Loaded 21298 existing records from primary storage. [2025-09-17T02:58:16.587427] [INFO ] [MAIN ] CPA: Loaded 21298 existing records. [2025-09-17T02:58:17.008101] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:17.017854] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T02:58:17.043093] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-17T02:58:17.042468] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:17.043334] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-17T02:58:17.043857] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-11. [2025-09-17T02:58:17.043973] [INFO ] [REMOTE ] COUR: Full fetch complete (70797 records). [2025-09-17T02:58:17.044148] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-17T02:58:17.045071] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-17T02:58:17.045276] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-17T02:58:17.768312] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:17.787573] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T02:58:17.803039] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-11. [2025-09-17T02:58:17.864454] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-17T02:58:17.864621] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-17T02:58:17.865485] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-17T02:58:17.865550] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-17T02:58:17.867432] [DEBUG] [LOCAL ] COUR: Trimmed 70797 records to 48849 (keeping 200 days of data) [2025-09-17T02:58:18.163941] [DEBUG] [LOCAL ] COUR: Primary data saved (48849 records). [2025-09-17T02:58:18.164119] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-17T02:58:18.164225] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. COUR took 33.0s. Estimated remaining: 4h 29m 5s. Rate: 6.9 symbols/min [2025-09-17T02:58:18.315844] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-17T02:58:18.378878] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:18.381486] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-17T02:58:18.415942] [DEBUG] [LOCAL ] CPAY: Loaded 22534 existing records from primary storage. [2025-09-17T02:58:18.416136] [INFO ] [MAIN ] CPAY: Loaded 22534 existing records. [2025-09-17T02:58:18.604142] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:18.604392] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-17T02:58:18.604443] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-17T02:58:18.605079] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-17T02:58:18.605143] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-17T02:58:18.976992] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:18.980615] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:58:19.000885] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T02:58:19.090122] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-17T02:58:19.379259] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T02:58:19.890125] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-17T02:58:20.279376] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T02:58:20.690126] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-11. [2025-09-17T02:58:21.490130] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-17T02:58:22.172951] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T02:58:22.290099] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-17T02:58:22.905032] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:58:23.090130] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-17T02:58:23.684537] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T02:58:23.890180] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-17T02:58:24.543972] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T02:58:24.690136] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-17T02:58:25.366387] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:58:25.490125] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-17T02:58:25.568029] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T02:58:26.290137] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-17T02:58:26.650889] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:58:27.090124] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-17T02:58:27.509189] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T02:58:27.702416] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:58:27.890116] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-17T02:58:28.690160] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-17T02:58:28.999330] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T02:58:29.490137] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-17T02:58:29.846911] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T02:58:30.290184] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-17T02:58:30.867631] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:58:30.885042] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T02:58:31.090130] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-17T02:58:31.890140] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-17T02:58:32.164156] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:58:32.690135] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-17T02:58:33.490151] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-17T02:58:33.735133] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T02:58:34.119344] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:58:34.290156] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-17T02:58:34.452039] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:58:35.090119] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-17T02:58:35.890137] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-17T02:58:36.178421] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T02:58:36.272073] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:58:36.690245] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-17T02:58:37.293199] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:58:37.310575] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T02:58:37.490103] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-17T02:58:37.789601] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-17T02:58:38.290137] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-17T02:58:38.654169] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T02:58:39.090171] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-17T02:58:39.890130] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-17T02:58:40.260822] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:58:40.261636] [INFO ] [REMOTE ] CPAC: Full fetch complete (1889 records). [2025-09-17T02:58:40.261740] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-17T02:58:40.439851] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T02:58:40.440042] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:58:40.440093] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:58:40.440136] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-17T02:58:40.440205] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-17T02:58:40.440253] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-17T02:58:40.440305] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-17T02:58:40.440377] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. CPAC took 24.3s. Estimated remaining: 4h 29m 45s. Rate: 6.9 symbols/min [2025-09-17T02:58:40.606549] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:40.618068] [DEBUG] [LOCAL ] CPF: Loaded 10949 existing records from primary storage. [2025-09-17T02:58:40.618210] [INFO ] [MAIN ] CPF: Loaded 10949 existing records. [2025-09-17T02:58:40.696177] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-17T02:58:40.801945] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:40.802319] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-17T02:58:40.802497] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-17T02:58:40.803122] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-17T02:58:40.803230] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-17T02:58:41.200922] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T02:58:41.204756] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:41.490143] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-17T02:58:42.287129] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T02:58:42.294202] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-11. [2025-09-17T02:58:42.841199] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:58:43.090099] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-17T02:58:43.344254] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T02:58:43.890131] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-17T02:58:44.315953] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T02:58:44.690150] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-17T02:58:44.984392] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:58:45.490182] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-17T02:58:45.627822] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T02:58:46.290195] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-17T02:58:46.838502] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T02:58:47.090111] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-17T02:58:47.890146] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-17T02:58:48.063437] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T02:58:48.503954] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T02:58:48.690140] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-17T02:58:49.196142] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T02:58:49.466611] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T02:58:49.471886] [INFO ] [REMOTE ] CPA: Full fetch complete (42536 records). [2025-09-17T02:58:49.472031] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-17T02:58:49.497952] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-17T02:58:49.872514] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-17T02:58:49.872616] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-17T02:58:49.873174] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-17T02:58:49.873228] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-17T02:58:49.874143] [DEBUG] [LOCAL ] CPA: Trimmed 42536 records to 29179 (keeping 200 days of data) [2025-09-17T02:58:50.056128] [DEBUG] [LOCAL ] CPA: Primary data saved (29179 records). [2025-09-17T02:58:50.056302] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-17T02:58:50.056391] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CPA took 34.1s. Estimated remaining: 4h 29m 40s. Rate: 6.9 symbols/min [2025-09-17T02:58:50.225163] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:50.235942] [DEBUG] [LOCAL ] CPK: Loaded 9239 existing records from primary storage. [2025-09-17T02:58:50.236071] [INFO ] [MAIN ] CPK: Loaded 9239 existing records. [2025-09-17T02:58:50.298757] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-17T02:58:50.419899] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:50.420815] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-17T02:58:50.420878] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-17T02:58:50.421488] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-17T02:58:50.421546] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-17T02:58:50.788807] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:51.090156] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-17T02:58:51.335551] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T02:58:51.492920] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:58:51.496633] [INFO ] [REMOTE ] CPAY: Full fetch complete (45250 records). [2025-09-17T02:58:51.496751] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-17T02:58:51.869344] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-17T02:58:51.869444] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-17T02:58:51.870013] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-17T02:58:51.870069] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-17T02:58:51.871155] [DEBUG] [LOCAL ] CPAY: Trimmed 45250 records to 31348 (keeping 200 days of data) [2025-09-17T02:58:51.924764] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-17T02:58:52.063010] [DEBUG] [LOCAL ] CPAY: Primary data saved (31348 records). [2025-09-17T02:58:52.063164] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-17T02:58:52.063255] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CPAY took 33.9s. Estimated remaining: 4h 29m 7s. Rate: 6.9 symbols/min [2025-09-17T02:58:52.238311] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:52.251495] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:58:52.303294] [DEBUG] [LOCAL ] CPNG: Loaded 40038 existing records from primary storage. [2025-09-17T02:58:52.303458] [INFO ] [MAIN ] CPNG: Loaded 40038 existing records. [2025-09-17T02:58:52.479257] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:52.479527] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-17T02:58:52.479578] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-17T02:58:52.480319] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-17T02:58:52.480379] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-17T02:58:52.697203] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-17T02:58:52.838870] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:53.323220] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:58:53.329614] [INFO ] [REMOTE ] CP: Full fetch complete (77011 records). [2025-09-17T02:58:53.329797] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-17T02:58:53.496064] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-11. [2025-09-17T02:58:53.721304] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-17T02:58:53.721417] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-17T02:58:53.722530] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-17T02:58:53.722614] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-17T02:58:53.724383] [DEBUG] [LOCAL ] CP: Trimmed 77011 records to 53294 (keeping 200 days of data) [2025-09-17T02:58:53.855108] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:58:54.069769] [DEBUG] [LOCAL ] CP: Primary data saved (53294 records). [2025-09-17T02:58:54.069947] [INFO ] [MAIN ] CP: Full history saved. [2025-09-17T02:58:54.070047] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CP took 40.7s. Estimated remaining: 4h 28m 34s. Rate: 6.9 symbols/min [2025-09-17T02:58:54.245483] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:54.255821] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T02:58:54.295108] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-17T02:58:54.297135] [DEBUG] [LOCAL ] CPRI: Loaded 39119 existing records from primary storage. [2025-09-17T02:58:54.297323] [INFO ] [MAIN ] CPRI: Loaded 39119 existing records. [2025-09-17T02:58:54.476033] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:54.476287] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-17T02:58:54.476350] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-17T02:58:54.477208] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-17T02:58:54.477283] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-17T02:58:54.824823] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:55.090101] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-17T02:58:55.423467] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T02:58:55.890133] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-11. [2025-09-17T02:58:55.909275] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:58:56.690131] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-17T02:58:57.471494] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T02:58:57.490075] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-17T02:58:57.735331] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T02:58:58.290116] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-11. [2025-09-17T02:58:58.431309] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T02:58:59.090123] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-17T02:58:59.890144] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-17T02:59:00.513875] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T02:59:00.687910] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T02:59:00.692024] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-17T02:59:00.853693] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T02:59:01.490190] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-17T02:59:02.290160] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-17T02:59:02.300678] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T02:59:02.969358] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-17T02:59:02.989335] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T02:59:03.090135] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-17T02:59:03.890134] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-17T02:59:04.063612] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T02:59:04.690144] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-17T02:59:05.490110] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-17T02:59:05.997729] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-17T02:59:06.157247] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T02:59:06.290146] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-17T02:59:06.455329] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T02:59:07.090154] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-17T02:59:07.240298] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T02:59:07.890146] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-17T02:59:08.690177] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-17T02:59:08.730628] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:59:08.733236] [INFO ] [REMOTE ] CPF: Full fetch complete (24262 records). [2025-09-17T02:59:08.733358] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-17T02:59:09.135182] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-17T02:59:09.135297] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-17T02:59:09.135742] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-17T02:59:09.135814] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-17T02:59:09.136474] [DEBUG] [LOCAL ] CPF: Trimmed 24262 records to 15552 (keeping 200 days of data) [2025-09-17T02:59:09.232768] [DEBUG] [LOCAL ] CPF: Primary data saved (15552 records). [2025-09-17T02:59:09.233028] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-17T02:59:09.233367] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPF took 28.8s. Estimated remaining: 4h 28m 49s. Rate: 6.9 symbols/min [2025-09-17T02:59:09.354858] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-17T02:59:09.490174] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-17T02:59:10.290144] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-17T02:59:10.437436] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T02:59:11.090146] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-17T02:59:11.470256] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T02:59:11.700844] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T02:59:11.890117] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-17T02:59:12.690136] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-17T02:59:12.906099] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:59:13.366856] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T02:59:13.490184] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-17T02:59:14.084200] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T02:59:14.151089] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T02:59:14.290172] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-17T02:59:15.090140] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-17T02:59:15.294473] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:59:15.890156] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-17T02:59:16.567684] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:59:16.690197] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-17T02:59:17.490146] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-17T02:59:17.505838] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T02:59:18.237686] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-17T02:59:18.290093] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-17T02:59:19.090172] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-17T02:59:19.140887] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T02:59:19.885434] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T02:59:19.887959] [INFO ] [REMOTE ] CPK: Full fetch complete (17356 records). [2025-09-17T02:59:19.888411] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-17T02:59:19.922604] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-17T02:59:20.309794] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-17T02:59:20.309935] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-17T02:59:20.310471] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-17T02:59:20.310528] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-17T02:59:20.311313] [DEBUG] [LOCAL ] CPK: Trimmed 17356 records to 13129 (keeping 200 days of data) [2025-09-17T02:59:20.404240] [DEBUG] [LOCAL ] CPK: Primary data saved (13129 records). [2025-09-17T02:59:20.404507] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-17T02:59:20.404674] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPK took 30.3s. Estimated remaining: 4h 28m 49s. Rate: 6.9 symbols/min [2025-09-17T02:59:20.495030] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-17T02:59:20.690136] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-17T02:59:21.765628] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T02:59:21.777356] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-17T02:59:22.826207] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T02:59:22.837985] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-17T02:59:23.593750] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T02:59:23.612156] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-17T02:59:25.168523] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-17T02:59:25.180006] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-17T02:59:25.597404] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:59:25.608800] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-17T02:59:27.194861] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:59:27.201444] [INFO ] [REMOTE ] CPRI: Full fetch complete (76043 records). [2025-09-17T02:59:27.201608] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-17T02:59:27.617141] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-17T02:59:27.618942] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T02:59:27.619231] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-17T02:59:27.627149] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-17T02:59:27.627331] [INFO ] [REMOTE ] CPNG: Full fetch complete (77554 records). [2025-09-17T02:59:27.627557] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-17T02:59:27.627491] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-17T02:59:27.730471] [DEBUG] [LOCAL ] CPRI: Trimmed 76043 records to 52592 (keeping 200 days of data) [2025-09-17T02:59:28.297555] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-17T02:59:28.299239] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-17T02:59:28.303786] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-17T02:59:28.305320] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-17T02:59:28.319604] [DEBUG] [LOCAL ] CPNG: Trimmed 77554 records to 53671 (keeping 200 days of data) [2025-09-17T02:59:28.910302] [DEBUG] [LOCAL ] CPRI: Primary data saved (52592 records). [2025-09-17T02:59:28.913249] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-17T02:59:28.919621] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPRI took 34.8s. Estimated remaining: 4h 28m 39s. Rate: 6.9 symbols/min [2025-09-17T02:59:29.008674] [DEBUG] [LOCAL ] CPNG: Primary data saved (53671 records). [2025-09-17T02:59:29.008871] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-17T02:59:29.008973] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPNG took 36.9s. Estimated remaining: 4h 27m 60s. Rate: 6.9 symbols/min [2025-09-17T02:59:29.641627] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.759544] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.744624] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.783516] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.810129] [DEBUG] [LOCAL ] CPS: Loaded 18635 existing records from primary storage. [2025-09-17T02:59:29.815478] [INFO ] [MAIN ] CPS: Loaded 18635 existing records. [2025-09-17T02:59:29.815907] [DEBUG] [LOCAL ] CQP: Loaded 15075 existing records from primary storage. [2025-09-17T02:59:29.838229] [INFO ] [MAIN ] CQP: Loaded 15075 existing records. [2025-09-17T02:59:30.021893] [DEBUG] [LOCAL ] CR: Loaded 17929 existing records from primary storage. [2025-09-17T02:59:30.059404] [DEBUG] [LOCAL ] CPT: Loaded 32824 existing records from primary storage. [2025-09-17T02:59:30.064760] [INFO ] [MAIN ] CR: Loaded 17929 existing records. [2025-09-17T02:59:30.086706] [INFO ] [MAIN ] CPT: Loaded 32824 existing records. [2025-09-17T02:59:30.383135] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.388404] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.452358] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.447084] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.505592] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-17T02:59:30.528077] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-17T02:59:30.547027] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-17T02:59:30.561132] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-17T02:59:30.561065] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.576301] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-17T02:59:30.601489] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.588861] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-17T02:59:30.645779] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-17T02:59:30.645903] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.646361] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.646426] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-17T02:59:30.647015] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-17T02:59:30.647056] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-17T02:59:30.673305] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-17T02:59:30.777708] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-17T02:59:31.970154] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:31.973608] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:32.003581] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-11. [2025-09-17T02:59:32.040385] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-11. [2025-09-17T02:59:32.124495] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:32.149800] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:32.150468] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-11. [2025-09-17T02:59:32.150189] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-11. [2025-09-17T02:59:33.161816] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:59:33.166681] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-17T02:59:33.215194] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:59:33.219968] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-17T02:59:33.294236] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T02:59:33.298838] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-17T02:59:33.770285] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:59:33.779591] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-17T02:59:33.901359] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T02:59:33.906332] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-17T02:59:34.124810] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:59:34.129290] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-17T02:59:34.355835] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T02:59:34.361086] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-17T02:59:34.886270] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T02:59:34.891058] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-17T02:59:35.069855] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:59:35.095180] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-17T02:59:35.107663] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:59:35.214373] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T02:59:35.890118] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-17T02:59:36.102810] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T02:59:36.255080] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:59:36.624744] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T02:59:36.690089] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-17T02:59:37.490133] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-17T02:59:37.625099] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T02:59:38.290139] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-17T02:59:38.577847] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T02:59:39.090132] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-17T02:59:39.758000] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T02:59:39.890169] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-17T02:59:40.359145] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T02:59:40.512065] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T02:59:40.690139] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-17T02:59:41.490193] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-17T02:59:42.111524] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T02:59:42.290162] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-17T02:59:42.659411] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T02:59:43.090143] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-17T02:59:43.890162] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-17T02:59:43.955531] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T02:59:44.121500] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T02:59:44.690111] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-17T02:59:45.069955] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T02:59:45.490132] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-17T02:59:45.825066] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T02:59:46.290154] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-17T02:59:47.069670] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T02:59:47.090090] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-17T02:59:47.695739] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T02:59:47.890133] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-17T02:59:47.964370] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:59:48.690164] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-17T02:59:49.131984] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:59:49.490158] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-17T02:59:50.290122] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-17T02:59:50.347299] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:59:50.393667] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T02:59:51.090159] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-17T02:59:51.398582] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:59:51.720503] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:59:51.722849] [INFO ] [REMOTE ] CQP: Full fetch complete (31030 records). [2025-09-17T02:59:51.722978] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-17T02:59:51.899518] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-17T02:59:52.100787] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-17T02:59:52.100894] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-17T02:59:52.101373] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-17T02:59:52.101436] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-17T02:59:52.102240] [DEBUG] [LOCAL ] CQP: Trimmed 31030 records to 20155 (keeping 200 days of data) [2025-09-17T02:59:52.229018] [DEBUG] [LOCAL ] CQP: Primary data saved (20155 records). [2025-09-17T02:59:52.229170] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-17T02:59:52.229275] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CQP took 23.2s. Estimated remaining: 4h 28m 43s. Rate: 6.9 symbols/min [2025-09-17T02:59:52.406087] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:52.415200] [DEBUG] [LOCAL ] CRBD: Loaded 6926 existing records from primary storage. [2025-09-17T02:59:52.415317] [INFO ] [MAIN ] CRBD: Loaded 6926 existing records. [2025-09-17T02:59:52.592595] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:52.593032] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-17T02:59:52.593106] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-17T02:59:52.593464] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-17T02:59:52.593534] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-17T02:59:52.693750] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-17T02:59:52.948477] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:53.136151] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:59:53.490116] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-17T02:59:53.882745] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:59:54.296719] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-11. [2025-09-17T02:59:54.301220] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:59:54.305679] [INFO ] [REMOTE ] CR: Full fetch complete (34767 records). [2025-09-17T02:59:54.305816] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-17T02:59:54.542809] [DEBUG] [REMOTE ] CRBD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:59:54.591940] [WARN ] [REMOTE ] CRBD: No data returned for month 2024-11 [2025-09-17T02:59:54.698447] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-17T02:59:54.698591] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-17T02:59:54.699208] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-17T02:59:54.699312] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-17T02:59:54.701012] [DEBUG] [LOCAL ] CR: Trimmed 34767 records to 24734 (keeping 200 days of data) [2025-09-17T02:59:54.862902] [DEBUG] [LOCAL ] CR: Primary data saved (24734 records). [2025-09-17T02:59:54.863069] [INFO ] [MAIN ] CR: Full history saved. [2025-09-17T02:59:54.863205] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CR took 25.9s. Estimated remaining: 4h 28m 12s. Rate: 6.9 symbols/min [2025-09-17T02:59:55.030683] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:55.071286] [DEBUG] [LOCAL ] CRBG: Loaded 39103 existing records from primary storage. [2025-09-17T02:59:55.071481] [INFO ] [MAIN ] CRBG: Loaded 39103 existing records. [2025-09-17T02:59:55.100485] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-17T02:59:55.249889] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:55.250127] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-17T02:59:55.250202] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-17T02:59:55.251126] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-17T02:59:55.251197] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-17T02:59:55.605756] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:55.890121] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-17T02:59:56.690091] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-17T02:59:57.005290] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T02:59:57.098233] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:59:57.457634] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:59:57.490083] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-17T02:59:58.035413] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:59:58.290125] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-17T02:59:59.090135] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-17T02:59:59.808510] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T02:59:59.873916] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T02:59:59.890074] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-17T03:00:00.690146] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-11. [2025-09-17T03:00:01.495234] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-17T03:00:01.510264] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T03:00:02.290204] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-17T03:00:03.046018] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T03:00:03.049214] [INFO ] [REMOTE ] CPS: Full fetch complete (36031 records). [2025-09-17T03:00:03.049343] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-17T03:00:03.099628] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-17T03:00:03.462786] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-17T03:00:03.463021] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-17T03:00:03.463748] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-17T03:00:03.463829] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-17T03:00:03.464979] [DEBUG] [LOCAL ] CPS: Trimmed 36031 records to 26379 (keeping 200 days of data) [2025-09-17T03:00:03.596021] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-11 (2.91 seconds). [2025-09-17T03:00:03.673218] [DEBUG] [LOCAL ] CPS: Primary data saved (26379 records). [2025-09-17T03:00:03.673382] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-17T03:00:03.673544] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPS took 34.7s. Estimated remaining: 4h 28m 4s. Rate: 6.9 symbols/min [2025-09-17T03:00:03.889266] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:03.890093] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-17T03:00:03.926832] [DEBUG] [LOCAL ] CRC: Loaded 32855 existing records from primary storage. [2025-09-17T03:00:03.927016] [INFO ] [MAIN ] CRC: Loaded 32855 existing records. [2025-09-17T03:00:04.111024] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:04.111310] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-17T03:00:04.111386] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-17T03:00:04.112191] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-17T03:00:04.112279] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-17T03:00:04.411031] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T03:00:04.495638] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:04.690325] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-11. [2025-09-17T03:00:05.490119] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-17T03:00:05.883824] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-17T03:00:06.043728] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:00:06.093992] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T03:00:06.134853] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-17T03:00:06.290135] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-17T03:00:07.090162] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-17T03:00:07.890164] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-17T03:00:08.473602] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T03:00:08.690122] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-17T03:00:09.490185] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-17T03:00:09.835512] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-17T03:00:10.290177] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-17T03:00:13.151146] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (5.26 seconds). [2025-09-17T03:00:13.161555] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-17T03:00:13.857268] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (3.57 seconds). [2025-09-17T03:00:13.870701] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-17T03:00:13.871423] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (4.38 seconds). [2025-09-17T03:00:13.874933] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-17T03:00:14.090626] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (5.40 seconds). [2025-09-17T03:00:14.097477] [INFO ] [REMOTE ] CPT: Full fetch complete (63255 records). [2025-09-17T03:00:14.097725] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-17T03:00:14.526949] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-17T03:00:14.535975] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-17T03:00:14.536357] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T03:00:14.537722] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-17T03:00:14.540574] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-17T03:00:14.541619] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-17T03:00:14.543614] [DEBUG] [LOCAL ] CPT: Trimmed 63255 records to 44332 (keeping 200 days of data) [2025-09-17T03:00:14.864210] [DEBUG] [LOCAL ] CPT: Primary data saved (44332 records). [2025-09-17T03:00:14.864462] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-17T03:00:14.865565] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPT took 45.9s. Estimated remaining: 4h 28m 4s. Rate: 6.9 symbols/min [2025-09-17T03:00:14.902190] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:00:14.999155] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-17T03:00:15.065996] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:15.074348] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-17T03:00:15.076080] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-17T03:00:15.076385] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-17T03:00:15.075926] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T03:00:15.078080] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-17T03:00:15.080036] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-17T03:00:15.081098] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-17T03:00:15.105527] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-17T03:00:15.417437] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:00:15.505420] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:15.734083] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T03:00:15.890159] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-11. [2025-09-17T03:00:16.208838] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:16.209175] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-11 [2025-09-17T03:00:16.690127] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-17T03:00:17.490108] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-17T03:00:17.580634] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-17T03:00:17.726324] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:17.726724] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-17T03:00:18.290127] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-17T03:00:18.736669] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T03:00:18.738224] [INFO ] [REMOTE ] CRBD: Full fetch complete (15225 records). [2025-09-17T03:00:18.738313] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-17T03:00:18.922622] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-17T03:00:18.923070] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:00:18.923256] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:00:18.923563] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-17T03:00:18.923770] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-17T03:00:18.923853] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-17T03:00:18.924327] [DEBUG] [LOCAL ] CRBD: Deleted derivative data file. [2025-09-17T03:00:18.924458] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBD took 26.7s. Estimated remaining: 4h 27m 39s. Rate: 6.9 symbols/min [2025-09-17T03:00:19.098295] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-17T03:00:19.099998] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:19.132999] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:00:19.181421] [DEBUG] [LOCAL ] CRGY: Loaded 38979 existing records from primary storage. [2025-09-17T03:00:19.181615] [INFO ] [MAIN ] CRGY: Loaded 38979 existing records. [2025-09-17T03:00:19.360783] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:19.361052] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-17T03:00:19.361183] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-17T03:00:19.362082] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-17T03:00:19.362161] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-17T03:00:19.709297] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:19.890134] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-17T03:00:20.494390] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:00:20.690160] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-17T03:00:21.183904] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T03:00:21.490147] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-17T03:00:21.776031] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:21.776382] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-17T03:00:22.298694] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-17T03:00:22.322213] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:00:22.549750] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:22.550160] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-17T03:00:23.090152] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-17T03:00:23.890146] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-17T03:00:24.105945] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:24.106270] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-17T03:00:24.690099] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-17T03:00:24.818608] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:00:25.490157] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-17T03:00:26.140618] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:00:26.290140] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-17T03:00:26.995199] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:00:27.090105] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-17T03:00:27.567209] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:00:27.890208] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-17T03:00:28.523839] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:00:28.690213] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-17T03:00:28.916601] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:28.917250] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-17T03:00:29.145825] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:00:29.490162] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-17T03:00:30.290197] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-11. [2025-09-17T03:00:30.760313] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:00:30.766854] [INFO ] [REMOTE ] CRBG: Full fetch complete (75528 records). [2025-09-17T03:00:30.767003] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-17T03:00:31.107530] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-17T03:00:31.167476] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-17T03:00:31.167580] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-17T03:00:31.168401] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-17T03:00:31.168462] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-17T03:00:31.170118] [DEBUG] [LOCAL ] CRBG: Trimmed 75528 records to 52342 (keeping 200 days of data) [2025-09-17T03:00:31.526796] [DEBUG] [LOCAL ] CRBG: Primary data saved (52342 records). [2025-09-17T03:00:31.526986] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-17T03:00:31.527089] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRBG took 36.7s. Estimated remaining: 4h 27m 44s. Rate: 6.9 symbols/min [2025-09-17T03:00:31.718215] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:31.798302] [DEBUG] [LOCAL ] CRH: Loaded 39829 existing records from primary storage. [2025-09-17T03:00:31.801504] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T03:00:31.801990] [INFO ] [MAIN ] CRH: Loaded 39829 existing records. [2025-09-17T03:00:31.895359] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-17T03:00:31.996825] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:31.997114] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-17T03:00:31.997182] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-17T03:00:31.998129] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-17T03:00:31.998194] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-17T03:00:32.350551] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:32.690191] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-11. [2025-09-17T03:00:32.871925] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:00:33.490200] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-17T03:00:33.691791] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:00:34.113843] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:00:34.290169] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-17T03:00:34.545023] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T03:00:34.550702] [INFO ] [REMOTE ] CRC: Full fetch complete (61784 records). [2025-09-17T03:00:34.550823] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-17T03:00:34.940537] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-17T03:00:34.940655] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-17T03:00:34.941345] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-17T03:00:34.941399] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-17T03:00:34.942602] [DEBUG] [LOCAL ] CRC: Trimmed 61784 records to 44456 (keeping 200 days of data) [2025-09-17T03:00:35.121948] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-17T03:00:35.218045] [DEBUG] [LOCAL ] CRC: Primary data saved (44456 records). [2025-09-17T03:00:35.218219] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-17T03:00:35.218316] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRC took 31.5s. Estimated remaining: 4h 27m 18s. Rate: 6.9 symbols/min [2025-09-17T03:00:35.386465] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:35.386727] [DEBUG] [LOCAL ] CRI: No existing data file found in primary storage. [2025-09-17T03:00:35.386779] [WARN ] [MAIN ] CRI: No existing data found, performing full refresh instead. [2025-09-17T03:00:35.386890] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-17T03:00:35.386940] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-17T03:00:35.386986] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-17T03:00:35.387030] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-17T03:00:35.743516] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:35.890108] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-11. [2025-09-17T03:00:36.074135] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:00:36.595161] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T03:00:36.690140] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-17T03:00:37.239965] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:00:37.490153] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-17T03:00:38.045345] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:00:38.146416] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:38.146799] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-17T03:00:38.290164] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-17T03:00:39.090183] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-17T03:00:39.888516] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T03:00:39.897582] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-17T03:00:40.690131] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-17T03:00:41.339368] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T03:00:41.490139] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-17T03:00:41.610805] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:00:42.147846] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:00:42.290200] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-17T03:00:42.732346] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:00:43.090154] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-17T03:00:43.890179] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-17T03:00:44.049256] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:00:44.348506] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T03:00:44.690151] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-17T03:00:45.490241] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-17T03:00:45.549819] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T03:00:46.290152] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-17T03:00:47.083520] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T03:00:47.094189] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-17T03:00:47.526741] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-17T03:00:47.619411] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:00:47.890114] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-17T03:00:48.608217] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T03:00:48.690151] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-17T03:00:49.490207] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-17T03:00:50.201366] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T03:00:50.290102] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-17T03:00:50.332300] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-17T03:00:50.898509] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:00:51.090124] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-17T03:00:51.890134] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-17T03:00:52.150393] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:00:52.690125] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-17T03:00:52.819456] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:00:53.490211] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-17T03:00:53.827330] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:00:54.290165] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-17T03:00:54.435068] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T03:00:54.816437] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T03:00:55.090185] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-17T03:00:55.903600] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-17T03:00:55.906607] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T03:00:56.690163] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-17T03:00:56.725595] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T03:00:56.732180] [INFO ] [REMOTE ] CRGY: Full fetch complete (75708 records). [2025-09-17T03:00:56.732344] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-17T03:00:57.128807] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-17T03:00:57.128918] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-17T03:00:57.129765] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-17T03:00:57.129831] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-17T03:00:57.131302] [DEBUG] [LOCAL ] CRGY: Trimmed 75708 records to 52518 (keeping 200 days of data) [2025-09-17T03:00:57.460869] [DEBUG] [LOCAL ] CRGY: Primary data saved (52518 records). [2025-09-17T03:00:57.461038] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-17T03:00:57.461136] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CRGY took 38.5s. Estimated remaining: 4h 27m 56s. Rate: 6.9 symbols/min [2025-09-17T03:00:57.497517] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-17T03:00:57.655906] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:57.691785] [DEBUG] [LOCAL ] CRK: Loaded 38747 existing records from primary storage. [2025-09-17T03:00:57.691985] [INFO ] [MAIN ] CRK: Loaded 38747 existing records. [2025-09-17T03:00:57.877243] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:57.877768] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-17T03:00:57.877832] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-17T03:00:57.878813] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-17T03:00:57.878878] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-17T03:00:58.245288] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:58.290083] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-11. [2025-09-17T03:00:58.529018] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:00:58.627305] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-17T03:00:58.635975] [INFO ] [REMOTE ] CRCL: Full fetch complete (27489 records). [2025-09-17T03:00:58.636105] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-17T03:00:58.820283] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-17T03:00:58.820691] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:00:58.820746] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:00:58.820786] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-17T03:00:58.820869] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-17T03:00:58.820930] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-17T03:00:58.820998] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-17T03:00:58.821065] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRCL took 44.0s. Estimated remaining: 4h 27m 22s. Rate: 6.9 symbols/min [2025-09-17T03:00:58.987521] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:59.020910] [DEBUG] [LOCAL ] CRL: Loaded 31389 existing records from primary storage. [2025-09-17T03:00:59.021085] [INFO ] [MAIN ] CRL: Loaded 31389 existing records. [2025-09-17T03:00:59.095807] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-17T03:00:59.201331] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:59.201555] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-17T03:00:59.201613] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-17T03:00:59.202485] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-17T03:00:59.202547] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-17T03:00:59.556477] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:59.587292] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T03:00:59.792428] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T03:00:59.890087] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-17T03:01:00.690187] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-17T03:01:00.957417] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:01:01.490185] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-11. [2025-09-17T03:01:01.742455] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:01:02.290133] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-17T03:01:02.485785] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T03:01:02.762687] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:01:03.090145] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-17T03:01:03.858119] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T03:01:03.890092] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-17T03:01:04.690142] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-17T03:01:04.756594] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:01:05.490139] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-17T03:01:05.627413] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:01:06.133433] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:01:06.139547] [INFO ] [REMOTE ] CRI: Full fetch complete (70615 records). [2025-09-17T03:01:06.139704] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-17T03:01:06.295193] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-17T03:01:06.533414] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-17T03:01:06.533520] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-17T03:01:06.534343] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-17T03:01:06.534416] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-17T03:01:06.535869] [DEBUG] [LOCAL ] CRI: Trimmed 70615 records to 50019 (keeping 200 days of data) [2025-09-17T03:01:06.846341] [DEBUG] [LOCAL ] CRI: Primary data saved (50019 records). [2025-09-17T03:01:06.846522] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-17T03:01:06.846626] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRI took 31.6s. Estimated remaining: 4h 27m 11s. Rate: 6.9 symbols/min [2025-09-17T03:01:07.014038] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:07.014244] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-09-17T03:01:07.014293] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-09-17T03:01:07.014413] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-17T03:01:07.014476] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-17T03:01:07.014582] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-09-17T03:01:07.014626] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-17T03:01:07.093563] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-17T03:01:07.376342] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:07.402218] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T03:01:07.635090] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T03:01:07.890133] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-11. [2025-09-17T03:01:08.671781] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T03:01:08.690103] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-17T03:01:09.490189] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-17T03:01:09.969111] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T03:01:10.045797] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:01:10.052422] [INFO ] [REMOTE ] CRH: Full fetch complete (77136 records). [2025-09-17T03:01:10.052596] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-17T03:01:10.295241] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-17T03:01:10.462465] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-17T03:01:10.462568] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-17T03:01:10.463501] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-17T03:01:10.463564] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-17T03:01:10.465320] [DEBUG] [LOCAL ] CRH: Trimmed 77136 records to 53476 (keeping 200 days of data) [2025-09-17T03:01:10.822437] [DEBUG] [LOCAL ] CRH: Primary data saved (53476 records). [2025-09-17T03:01:10.825192] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-17T03:01:10.825329] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRH took 39.3s. Estimated remaining: 4h 26m 46s. Rate: 6.9 symbols/min [2025-09-17T03:01:10.873701] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T03:01:11.002802] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:11.039256] [DEBUG] [LOCAL ] CRS: Loaded 32329 existing records from primary storage. [2025-09-17T03:01:11.039443] [INFO ] [MAIN ] CRS: Loaded 32329 existing records. [2025-09-17T03:01:11.097024] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-17T03:01:11.221823] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:11.222058] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-17T03:01:11.222115] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-17T03:01:11.222998] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-17T03:01:11.223063] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-17T03:01:11.572867] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:11.694950] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:01:11.890144] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-11. [2025-09-17T03:01:12.690177] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-17T03:01:13.304745] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-17T03:01:13.422565] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T03:01:13.490192] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-17T03:01:14.174877] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:01:14.290214] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-17T03:01:15.090129] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-17T03:01:15.725473] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T03:01:15.890179] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-17T03:01:15.920396] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:01:16.690138] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-17T03:01:16.801212] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T03:01:17.490174] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-17T03:01:17.972512] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T03:01:18.102280] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:01:18.290100] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-17T03:01:18.811802] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T03:01:19.090176] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-17T03:01:19.890128] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-17T03:01:20.392375] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T03:01:20.660154] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-17T03:01:20.690141] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-17T03:01:21.254553] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:01:21.490118] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-17T03:01:22.280199] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T03:01:22.290315] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-17T03:01:23.090112] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-17T03:01:23.757806] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T03:01:23.855036] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:01:23.890083] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-17T03:01:24.690161] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-17T03:01:24.834152] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T03:01:25.490200] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-17T03:01:26.129450] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T03:01:26.144020] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:01:26.290191] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-17T03:01:26.965616] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T03:01:27.090128] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-17T03:01:27.719374] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T03:01:27.890152] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-17T03:01:28.461138] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T03:01:28.690135] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-17T03:01:29.490092] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-17T03:01:29.573519] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T03:01:29.977541] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T03:01:30.290142] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-17T03:01:31.090143] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-17T03:01:31.499375] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:01:31.893065] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-17T03:01:31.896287] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:01:31.906139] [INFO ] [REMOTE ] CRK: Full fetch complete (75274 records). [2025-09-17T03:01:31.906383] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-17T03:01:32.323540] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-17T03:01:32.323702] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-17T03:01:32.324635] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-17T03:01:32.324788] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-17T03:01:32.326355] [DEBUG] [LOCAL ] CRK: Trimmed 75274 records to 52103 (keeping 200 days of data) [2025-09-17T03:01:32.574419] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:01:32.689316] [DEBUG] [LOCAL ] CRK: Primary data saved (52103 records). [2025-09-17T03:01:32.689514] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-17T03:01:32.689620] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRK took 35.2s. Estimated remaining: 4h 27m 22s. Rate: 6.9 symbols/min [2025-09-17T03:01:32.701471] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-17T03:01:32.865249] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:32.870673] [DEBUG] [LOCAL ] CRT: Loaded 3500 existing records from primary storage. [2025-09-17T03:01:32.870828] [INFO ] [MAIN ] CRT: Loaded 3500 existing records. [2025-09-17T03:01:33.050269] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:33.050535] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-17T03:01:33.050589] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-17T03:01:33.050901] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-17T03:01:33.050986] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-17T03:01:33.409374] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:33.490109] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-11. [2025-09-17T03:01:33.902700] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-11 (0.41 seconds). [2025-09-17T03:01:34.119013] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T03:01:34.271027] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:01:34.290092] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-17T03:01:35.090137] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-17T03:01:35.617907] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:01:35.823813] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T03:01:35.890099] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-17T03:01:36.690210] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-17T03:01:37.196163] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T03:01:37.366579] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:01:37.372550] [INFO ] [REMOTE ] CRS: Full fetch complete (62261 records). [2025-09-17T03:01:37.372838] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-17T03:01:37.495313] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-17T03:01:37.758497] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-17T03:01:37.758609] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-17T03:01:37.759371] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-17T03:01:37.759428] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-17T03:01:37.760781] [DEBUG] [LOCAL ] CRS: Trimmed 62261 records to 43571 (keeping 200 days of data) [2025-09-17T03:01:38.046561] [DEBUG] [LOCAL ] CRS: Primary data saved (43571 records). [2025-09-17T03:01:38.046801] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-17T03:01:38.046952] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRS took 27.2s. Estimated remaining: 4h 27m 2s. Rate: 6.9 symbols/min [2025-09-17T03:01:38.222106] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:38.255018] [DEBUG] [LOCAL ] CSAN: Loaded 31504 existing records from primary storage. [2025-09-17T03:01:38.255210] [INFO ] [MAIN ] CSAN: Loaded 31504 existing records. [2025-09-17T03:01:38.298191] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-17T03:01:38.436772] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:38.437007] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-17T03:01:38.437071] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-17T03:01:38.437750] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-17T03:01:38.437814] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-17T03:01:38.831192] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:39.031087] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T03:01:39.090084] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-17T03:01:39.890156] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-17T03:01:40.087252] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-17T03:01:40.113258] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T03:01:40.118789] [INFO ] [REMOTE ] CRL: Full fetch complete (62619 records). [2025-09-17T03:01:40.118958] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-17T03:01:40.434300] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T03:01:40.526669] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-17T03:01:40.526805] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-17T03:01:40.527631] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-17T03:01:40.527737] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-17T03:01:40.529282] [DEBUG] [LOCAL ] CRL: Trimmed 62619 records to 43871 (keeping 200 days of data) [2025-09-17T03:01:40.708703] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-11. [2025-09-17T03:01:40.804472] [DEBUG] [LOCAL ] CRL: Primary data saved (43871 records). [2025-09-17T03:01:40.804676] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-17T03:01:40.804800] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRL took 42.0s. Estimated remaining: 4h 26m 33s. Rate: 6.9 symbols/min [2025-09-17T03:01:40.976024] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:40.997452] [DEBUG] [LOCAL ] CSL: Loaded 22516 existing records from primary storage. [2025-09-17T03:01:40.997609] [INFO ] [MAIN ] CSL: Loaded 22516 existing records. [2025-09-17T03:01:41.176453] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:41.176714] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-17T03:01:41.176772] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-17T03:01:41.177378] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-17T03:01:41.177437] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-17T03:01:41.495552] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-17T03:01:41.534316] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:42.206471] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T03:01:42.290084] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-17T03:01:43.090126] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-11. [2025-09-17T03:01:43.890156] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-17T03:01:43.913939] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:01:44.657292] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-17T03:01:44.663904] [INFO ] [REMOTE ] CRM: Full fetch complete (77773 records). [2025-09-17T03:01:44.664057] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-17T03:01:44.698160] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-17T03:01:45.080323] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-17T03:01:45.080434] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-17T03:01:45.081309] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-17T03:01:45.081389] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-17T03:01:45.082921] [DEBUG] [LOCAL ] CRM: Trimmed 77773 records to 53770 (keeping 200 days of data) [2025-09-17T03:01:45.207386] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T03:01:45.463569] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-17T03:01:45.463794] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-17T03:01:45.463905] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRM took 38.6s. Estimated remaining: 4h 26m 10s. Rate: 6.9 symbols/min [2025-09-17T03:01:45.497295] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-17T03:01:45.643770] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:45.655200] [DEBUG] [LOCAL ] CSR: Loaded 9535 existing records from primary storage. [2025-09-17T03:01:45.655370] [INFO ] [MAIN ] CSR: Loaded 9535 existing records. [2025-09-17T03:01:45.839749] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:45.840125] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-17T03:01:45.840197] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-17T03:01:45.844854] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-17T03:01:45.844983] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-17T03:01:45.879413] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (4.38 seconds). [2025-09-17T03:01:46.231754] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:46.256044] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T03:01:46.290091] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-11. [2025-09-17T03:01:46.675935] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:01:47.090131] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-17T03:01:47.169507] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T03:01:47.890182] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-17T03:01:48.379245] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T03:01:48.583159] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:01:48.690164] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-17T03:01:49.123496] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T03:01:49.490134] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-17T03:01:50.104984] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:01:50.290137] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-17T03:01:51.090136] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-17T03:01:51.307324] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T03:01:51.890171] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-17T03:01:52.197731] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:01:52.690157] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-17T03:01:52.711982] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T03:01:53.081053] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T03:01:53.490161] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-17T03:01:54.111334] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T03:01:54.290150] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-17T03:01:54.839414] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T03:01:55.090128] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-17T03:01:55.890145] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-17T03:01:56.666976] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:01:56.690077] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-17T03:01:56.794230] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T03:01:57.490148] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-17T03:01:57.928380] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T03:01:58.290195] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-17T03:01:58.937758] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:01:59.090136] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-17T03:01:59.783217] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:01:59.890117] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-17T03:02:00.113110] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T03:02:00.690167] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-17T03:02:01.461561] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:02:01.490100] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-17T03:02:02.140955] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:02:02.290164] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-17T03:02:02.952346] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T03:02:03.064588] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T03:02:03.090087] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-17T03:02:03.890133] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-17T03:02:03.942736] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T03:02:04.690139] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-17T03:02:05.490121] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-17T03:02:05.520087] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T03:02:05.530685] [INFO ] [REMOTE ] CRT: Full fetch complete (7578 records). [2025-09-17T03:02:05.544198] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-17T03:02:05.578237] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:02:06.000079] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-17T03:02:06.000275] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-17T03:02:06.000840] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-17T03:02:06.000960] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-17T03:02:06.001933] [DEBUG] [LOCAL ] CRT: Trimmed 7578 records to 4909 (keeping 200 days of data) [2025-09-17T03:02:06.041596] [DEBUG] [LOCAL ] CRT: Primary data saved (4909 records). [2025-09-17T03:02:06.041842] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-17T03:02:06.041990] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CRT took 33.4s. Estimated remaining: 4h 26m 42s. Rate: 6.9 symbols/min [2025-09-17T03:02:06.292052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-17T03:02:06.327716] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:06.391266] [DEBUG] [LOCAL ] CSTM: Loaded 35217 existing records from primary storage. [2025-09-17T03:02:06.391555] [INFO ] [MAIN ] CSTM: Loaded 35217 existing records. [2025-09-17T03:02:06.674002] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:06.674361] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-17T03:02:06.674425] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-17T03:02:06.675484] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-17T03:02:06.675566] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-17T03:02:07.097117] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:02:07.095296] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-17T03:02:07.141889] [INFO ] [REMOTE ] CSAN: Full fetch complete (60635 records). [2025-09-17T03:02:07.189036] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-17T03:02:07.212465] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:07.604488] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-17T03:02:07.604704] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-17T03:02:07.605855] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-17T03:02:07.606225] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-17T03:02:07.608078] [DEBUG] [LOCAL ] CSAN: Trimmed 60635 records to 42022 (keeping 200 days of data) [2025-09-17T03:02:07.729060] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T03:02:07.890178] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-11. [2025-09-17T03:02:07.894307] [DEBUG] [LOCAL ] CSAN: Primary data saved (42022 records). [2025-09-17T03:02:07.894406] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-17T03:02:07.894532] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CSAN took 29.8s. Estimated remaining: 4h 26m 10s. Rate: 6.9 symbols/min [2025-09-17T03:02:08.071839] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:08.086909] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:02:08.099856] [DEBUG] [LOCAL ] CSV: Loaded 8953 existing records from primary storage. [2025-09-17T03:02:08.100026] [INFO ] [MAIN ] CSV: Loaded 8953 existing records. [2025-09-17T03:02:08.281614] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:08.281917] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-17T03:02:08.282002] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-17T03:02:08.282441] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-17T03:02:08.282523] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-17T03:02:08.662437] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:08.690097] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-11. [2025-09-17T03:02:09.078785] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:02:09.432280] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:02:09.490146] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-17T03:02:10.290129] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-17T03:02:10.355176] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T03:02:11.090141] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-17T03:02:11.774447] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:02:11.890122] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-17T03:02:12.070171] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T03:02:12.690135] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-17T03:02:12.862088] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T03:02:13.316939] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T03:02:13.490134] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-17T03:02:14.290155] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-17T03:02:15.090186] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-17T03:02:15.167704] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:02:15.358317] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:02:15.680494] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:02:15.890159] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-17T03:02:16.391354] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T03:02:16.394089] [INFO ] [REMOTE ] CSR: Full fetch complete (17414 records). [2025-09-17T03:02:16.394250] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-17T03:02:16.695204] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-17T03:02:16.809877] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-17T03:02:16.810000] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-17T03:02:16.810373] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-17T03:02:16.810458] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-17T03:02:16.811274] [DEBUG] [LOCAL ] CSR: Trimmed 17414 records to 12356 (keeping 200 days of data) [2025-09-17T03:02:16.896109] [DEBUG] [LOCAL ] CSR: Primary data saved (12356 records). [2025-09-17T03:02:16.896288] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-17T03:02:16.896402] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CSR took 31.4s. Estimated remaining: 4h 26m 2s. Rate: 6.9 symbols/min [2025-09-17T03:02:17.078143] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:17.078377] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-17T03:02:17.078429] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-17T03:02:17.078539] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-17T03:02:17.078590] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-17T03:02:17.078658] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-17T03:02:17.078705] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-17T03:02:17.434980] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:17.490149] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-11. [2025-09-17T03:02:17.701026] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:17.701399] [WARN ] [REMOTE ] CSW: No data returned for month 2024-11 [2025-09-17T03:02:18.290139] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-17T03:02:18.462948] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:02:18.511491] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:18.511998] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-17T03:02:19.090123] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-17T03:02:19.890121] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-17T03:02:20.690136] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-17T03:02:20.901138] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:02:20.995303] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:02:21.490141] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-17T03:02:21.858959] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T03:02:21.942508] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:21.942909] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-17T03:02:22.290136] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-17T03:02:23.090119] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-17T03:02:23.159444] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:02:23.164094] [INFO ] [REMOTE ] CSL: Full fetch complete (44374 records). [2025-09-17T03:02:23.164285] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-17T03:02:23.560112] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-17T03:02:23.560280] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-17T03:02:23.560964] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-17T03:02:23.561044] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-17T03:02:23.562661] [DEBUG] [LOCAL ] CSL: Trimmed 44374 records to 31340 (keeping 200 days of data) [2025-09-17T03:02:23.780167] [DEBUG] [LOCAL ] CSL: Primary data saved (31340 records). [2025-09-17T03:02:23.780364] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-17T03:02:23.780497] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSL took 43.0s. Estimated remaining: 4h 25m 47s. Rate: 6.9 symbols/min [2025-09-17T03:02:23.895197] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-17T03:02:23.959350] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:23.967047] [DEBUG] [LOCAL ] CTBB: Loaded 4822 existing records from primary storage. [2025-09-17T03:02:23.967196] [INFO ] [MAIN ] CTBB: Loaded 4822 existing records. [2025-09-17T03:02:24.144938] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:24.145920] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-17T03:02:24.146114] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-17T03:02:24.151862] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-17T03:02:24.156386] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-17T03:02:24.156730] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T03:02:24.207034] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:24.257740] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-17T03:02:24.538628] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:24.690135] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-17T03:02:25.332503] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T03:02:25.490146] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-17T03:02:26.290140] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-17T03:02:26.323059] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T03:02:26.508390] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:26.508750] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-17T03:02:27.090200] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-17T03:02:27.761575] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T03:02:27.890198] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-17T03:02:28.690181] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-11. [2025-09-17T03:02:29.346692] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T03:02:29.490160] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-17T03:02:29.555607] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:02:30.290152] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-17T03:02:30.470182] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T03:02:31.090146] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-17T03:02:31.193943] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T03:02:31.890187] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-17T03:02:31.907483] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:02:31.910517] [INFO ] [REMOTE ] CSV: Full fetch complete (19252 records). [2025-09-17T03:02:31.910681] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-17T03:02:32.351072] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-17T03:02:32.351183] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-17T03:02:32.351628] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-17T03:02:32.351703] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-17T03:02:32.352379] [DEBUG] [LOCAL ] CSV: Trimmed 19252 records to 13134 (keeping 200 days of data) [2025-09-17T03:02:32.437886] [DEBUG] [LOCAL ] CSV: Primary data saved (13134 records). [2025-09-17T03:02:32.438051] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-17T03:02:32.438151] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSV took 24.5s. Estimated remaining: 4h 25m 38s. Rate: 6.9 symbols/min [2025-09-17T03:02:32.611904] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:32.618949] [DEBUG] [LOCAL ] CTDD: Loaded 3822 existing records from primary storage. [2025-09-17T03:02:32.619116] [INFO ] [MAIN ] CTDD: Loaded 3822 existing records. [2025-09-17T03:02:32.695464] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-17T03:02:32.814462] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:32.814763] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-17T03:02:32.814834] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-17T03:02:32.815115] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-17T03:02:32.815179] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-17T03:02:33.191287] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:33.219199] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:02:33.459513] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T03:02:33.490081] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-17T03:02:33.889413] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T03:02:34.290174] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-17T03:02:35.090155] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-11. [2025-09-17T03:02:35.503671] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T03:02:35.833299] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:02:35.890197] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-17T03:02:36.364218] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:02:36.690148] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-17T03:02:37.490234] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-17T03:02:37.947731] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:02:37.965543] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T03:02:38.290216] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-17T03:02:39.090183] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-17T03:02:39.312719] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:39.313311] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-17T03:02:39.826413] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:02:39.890147] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-17T03:02:40.488207] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T03:02:40.690132] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-17T03:02:41.277707] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:02:41.490134] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-17T03:02:42.290188] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-17T03:02:42.505559] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:42.505980] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-17T03:02:42.941475] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:02:42.947573] [INFO ] [REMOTE ] CSTM: Full fetch complete (68703 records). [2025-09-17T03:02:42.947773] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-17T03:02:43.095246] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-17T03:02:43.345674] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-17T03:02:43.345798] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-17T03:02:43.346588] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-17T03:02:43.346690] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-17T03:02:43.348492] [DEBUG] [LOCAL ] CSTM: Trimmed 68703 records to 47878 (keeping 200 days of data) [2025-09-17T03:02:43.644200] [DEBUG] [LOCAL ] CSTM: Primary data saved (47878 records). [2025-09-17T03:02:43.644388] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-17T03:02:43.644521] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSTM took 37.6s. Estimated remaining: 4h 25m 38s. Rate: 6.9 symbols/min [2025-09-17T03:02:43.816035] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:43.816255] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-17T03:02:43.816307] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-17T03:02:43.816422] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-17T03:02:43.816474] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-17T03:02:43.816525] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-17T03:02:43.816567] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-17T03:02:43.895208] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-17T03:02:44.219708] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:44.220901] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:02:44.577401] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T03:02:44.690126] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-17T03:02:45.490167] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-17T03:02:45.592509] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T03:02:45.990053] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T03:02:46.290150] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-17T03:02:47.090151] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-17T03:02:47.351870] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T03:02:47.522440] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T03:02:47.890139] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-17T03:02:48.335259] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T03:02:48.690205] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-17T03:02:49.399906] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T03:02:49.490151] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-17T03:02:50.122254] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T03:02:50.290128] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-11. [2025-09-17T03:02:50.525534] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2024-11 (0.24 seconds). [2025-09-17T03:02:51.090169] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-17T03:02:51.318947] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:51.319282] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-17T03:02:51.890140] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-17T03:02:52.393169] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T03:02:52.690132] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-17T03:02:53.366523] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T03:02:53.490133] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-17T03:02:53.712861] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:53.713188] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-17T03:02:54.290192] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-17T03:02:55.090138] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-17T03:02:55.311927] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T03:02:55.314348] [INFO ] [REMOTE ] CSW: Full fetch complete (7329 records). [2025-09-17T03:02:55.314432] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-17T03:02:55.495543] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-17T03:02:55.495810] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:02:55.495887] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:02:55.495945] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-17T03:02:55.496031] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-17T03:02:55.496129] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-17T03:02:55.496203] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-17T03:02:55.496282] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSW took 38.6s. Estimated remaining: 4h 25m 40s. Rate: 6.9 symbols/min [2025-09-17T03:02:55.616103] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T03:02:55.679186] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:55.679379] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-17T03:02:55.679425] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-17T03:02:55.679540] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-17T03:02:55.679586] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-17T03:02:55.679633] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-17T03:02:55.679708] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-17T03:02:55.896744] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-17T03:02:56.070658] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:56.212344] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:56.212685] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-17T03:02:56.690140] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-17T03:02:57.421613] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T03:02:57.490130] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-11. [2025-09-17T03:02:57.706195] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:57.706560] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-11 [2025-09-17T03:02:58.290139] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-17T03:02:58.922824] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T03:02:58.924392] [INFO ] [REMOTE ] CTBB: Full fetch complete (11250 records). [2025-09-17T03:02:58.924486] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-17T03:02:59.091896] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-17T03:02:59.303831] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-17T03:02:59.303933] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-17T03:02:59.304205] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-17T03:02:59.304306] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-17T03:02:59.304830] [DEBUG] [LOCAL ] CTBB: Trimmed 11250 records to 7339 (keeping 200 days of data) [2025-09-17T03:02:59.349865] [DEBUG] [LOCAL ] CTBB: Primary data saved (7339 records). [2025-09-17T03:02:59.349976] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-17T03:02:59.350060] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTBB took 35.6s. Estimated remaining: 4h 25m 15s. Rate: 6.9 symbols/min [2025-09-17T03:02:59.516924] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:59.536372] [DEBUG] [LOCAL ] CTO: Loaded 19613 existing records from primary storage. [2025-09-17T03:02:59.536517] [INFO ] [MAIN ] CTO: Loaded 19613 existing records. [2025-09-17T03:02:59.716199] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:59.716460] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-17T03:02:59.716522] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-17T03:02:59.717146] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-17T03:02:59.717215] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-17T03:02:59.896046] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-17T03:02:59.949683] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T03:03:00.093629] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:00.200727] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:00.201094] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-17T03:03:00.690148] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-17T03:03:01.329350] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:03:01.331088] [INFO ] [REMOTE ] CTDD: Full fetch complete (8635 records). [2025-09-17T03:03:01.331429] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-17T03:03:01.495314] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-17T03:03:01.757098] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-17T03:03:01.757242] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-17T03:03:01.757791] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-17T03:03:01.757859] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-17T03:03:01.758426] [DEBUG] [LOCAL ] CTDD: Trimmed 8635 records to 5902 (keeping 200 days of data) [2025-09-17T03:03:01.801457] [DEBUG] [LOCAL ] CTDD: Primary data saved (5902 records). [2025-09-17T03:03:01.801745] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-17T03:03:01.801884] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CTDD took 29.4s. Estimated remaining: 4h 24m 45s. Rate: 6.9 symbols/min [2025-09-17T03:03:01.994099] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:02.026621] [DEBUG] [LOCAL ] CTOS: Loaded 26856 existing records from primary storage. [2025-09-17T03:03:02.026878] [INFO ] [MAIN ] CTOS: Loaded 26856 existing records. [2025-09-17T03:03:02.222939] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:02.223311] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-17T03:03:02.223378] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-17T03:03:02.224149] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-17T03:03:02.224250] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-17T03:03:02.295434] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-17T03:03:02.369031] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:02.394864] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-17T03:03:02.632415] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:03.090146] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-17T03:03:03.890154] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-11. [2025-09-17T03:03:04.032138] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:04.032505] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-17T03:03:04.100155] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:04.100745] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-17T03:03:04.690147] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-17T03:03:05.008473] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T03:03:05.100166] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T03:03:05.490134] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-17T03:03:06.290145] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-17T03:03:06.325626] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:03:07.090142] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-11. [2025-09-17T03:03:07.232377] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:03:07.890194] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-17T03:03:08.098492] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T03:03:08.690150] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-17T03:03:09.029288] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:03:09.197624] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T03:03:09.490144] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-17T03:03:10.290142] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-17T03:03:10.410377] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T03:03:11.090195] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-17T03:03:11.749387] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T03:03:11.898313] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-17T03:03:11.902145] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T03:03:12.170834] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T03:03:12.690129] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-17T03:03:13.442934] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T03:03:13.490095] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-17T03:03:14.290167] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-17T03:03:14.348556] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T03:03:14.912535] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T03:03:15.090124] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-17T03:03:15.890158] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-17T03:03:16.690141] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-17T03:03:17.074824] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:03:17.301108] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T03:03:17.490336] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-17T03:03:17.933417] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:03:18.290183] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-17T03:03:18.676313] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T03:03:19.090146] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-17T03:03:19.394352] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:03:19.890142] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-17T03:03:20.091162] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T03:03:20.145689] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:20.146100] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-17T03:03:20.690133] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-17T03:03:21.490194] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-17T03:03:21.502146] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:03:21.505255] [INFO ] [REMOTE ] CTEV: Full fetch complete (13025 records). [2025-09-17T03:03:21.505388] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-17T03:03:21.699973] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 138 unique days, need 200 days [2025-09-17T03:03:21.700422] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:03:21.700478] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:03:21.700528] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-17T03:03:21.700604] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-17T03:03:21.700679] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-17T03:03:21.700734] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-17T03:03:21.700837] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTEV took 26.2s. Estimated remaining: 4h 25m 14s. Rate: 6.9 symbols/min [2025-09-17T03:03:21.871200] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:21.910880] [DEBUG] [LOCAL ] CTRA: Loaded 40002 existing records from primary storage. [2025-09-17T03:03:21.911051] [INFO ] [MAIN ] CTRA: Loaded 40002 existing records. [2025-09-17T03:03:22.092433] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:22.092702] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-17T03:03:22.092755] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-17T03:03:22.093900] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-17T03:03:22.093963] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-17T03:03:22.299295] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-17T03:03:22.459905] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:22.639683] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:22.640118] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-17T03:03:22.640206] [INFO ] [REMOTE ] CTEST: Full fetch complete (1021 records). [2025-09-17T03:03:22.640283] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-17T03:03:22.640940] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:03:22.641015] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:03:22.641063] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:03:22.641110] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-17T03:03:22.641175] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-17T03:03:22.641222] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-17T03:03:22.641280] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-17T03:03:22.641352] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CTEST took 39.0s. Estimated remaining: 4h 24m 39s. Rate: 6.9 symbols/min [2025-09-17T03:03:22.813616] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:22.849004] [DEBUG] [LOCAL ] CTRE: Loaded 36634 existing records from primary storage. [2025-09-17T03:03:22.849181] [INFO ] [MAIN ] CTRE: Loaded 36634 existing records. [2025-09-17T03:03:23.025912] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:23.026185] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-17T03:03:23.026243] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-17T03:03:23.027244] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-17T03:03:23.027306] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-17T03:03:23.095320] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-17T03:03:23.398940] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T03:03:23.431882] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:23.890115] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-11. [2025-09-17T03:03:24.294610] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:03:24.690194] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-17T03:03:25.320870] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T03:03:25.490140] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-17T03:03:25.596887] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T03:03:26.290137] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-17T03:03:27.090155] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-11. [2025-09-17T03:03:27.495302] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T03:03:27.892018] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-17T03:03:27.894967] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:03:28.690105] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-17T03:03:28.791892] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:03:29.490175] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-17T03:03:29.817772] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T03:03:29.855464] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T03:03:30.290196] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-17T03:03:30.907125] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T03:03:31.090145] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-17T03:03:31.822909] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:03:31.890090] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-17T03:03:32.361579] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:03:32.690193] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-17T03:03:33.490129] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-17T03:03:33.999436] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T03:03:34.036054] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T03:03:34.290144] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-17T03:03:35.090110] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-17T03:03:35.126465] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:03:35.873629] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:03:35.890079] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-17T03:03:36.262410] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T03:03:36.690146] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-17T03:03:37.490185] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-17T03:03:37.953308] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T03:03:38.031283] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T03:03:38.290166] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-17T03:03:38.803918] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T03:03:39.090132] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-17T03:03:39.671169] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:03:39.890156] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-17T03:03:40.543263] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:03:40.690116] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-17T03:03:41.489658] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T03:03:41.499851] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-17T03:03:41.910843] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:03:42.290118] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-17T03:03:42.611473] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T03:03:42.617727] [INFO ] [REMOTE ] CTO: Full fetch complete (41944 records). [2025-09-17T03:03:42.618057] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-17T03:03:43.000706] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-17T03:03:43.000815] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-17T03:03:43.001361] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-17T03:03:43.001416] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-17T03:03:43.002525] [DEBUG] [LOCAL ] CTO: Trimmed 41944 records to 28582 (keeping 200 days of data) [2025-09-17T03:03:43.094596] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-17T03:03:43.187161] [DEBUG] [LOCAL ] CTO: Primary data saved (28582 records). [2025-09-17T03:03:43.187360] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-17T03:03:43.187461] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTO took 43.8s. Estimated remaining: 4h 25m 10s. Rate: 6.9 symbols/min [2025-09-17T03:03:43.360827] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:43.394916] [DEBUG] [LOCAL ] CTRI: Loaded 29346 existing records from primary storage. [2025-09-17T03:03:43.395111] [INFO ] [MAIN ] CTRI: Loaded 29346 existing records. [2025-09-17T03:03:43.578331] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:43.578599] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-17T03:03:43.578679] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-17T03:03:43.579523] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-17T03:03:43.579588] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-17T03:03:43.909227] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-17T03:03:43.951133] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:44.025902] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:03:44.244482] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:03:44.248952] [INFO ] [REMOTE ] CTOS: Full fetch complete (53403 records). [2025-09-17T03:03:44.249069] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-17T03:03:44.645134] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-17T03:03:44.645254] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-17T03:03:44.646004] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-17T03:03:44.646080] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-17T03:03:44.647416] [DEBUG] [LOCAL ] CTOS: Trimmed 53403 records to 37086 (keeping 200 days of data) [2025-09-17T03:03:44.695055] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-11. [2025-09-17T03:03:44.859914] [DEBUG] [LOCAL ] CTOS: Primary data saved (37086 records). [2025-09-17T03:03:44.860098] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-17T03:03:44.860207] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTOS took 43.1s. Estimated remaining: 4h 24m 37s. Rate: 6.9 symbols/min [2025-09-17T03:03:45.038949] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:45.053720] [DEBUG] [LOCAL ] CTS: Loaded 13918 existing records from primary storage. [2025-09-17T03:03:45.053875] [INFO ] [MAIN ] CTS: Loaded 13918 existing records. [2025-09-17T03:03:45.236551] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:45.236951] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-17T03:03:45.237409] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-17T03:03:45.238066] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-17T03:03:45.238197] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-17T03:03:45.509497] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-17T03:03:45.563780] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:03:45.655279] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:46.094334] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T03:03:46.290143] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-17T03:03:47.090148] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-17T03:03:47.220897] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T03:03:47.887148] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T03:03:47.896125] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-17T03:03:48.376007] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:03:48.690137] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-11. [2025-09-17T03:03:49.499465] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-17T03:03:49.500808] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:03:49.602111] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T03:03:49.608709] [INFO ] [REMOTE ] CTRA: Full fetch complete (77510 records). [2025-09-17T03:03:49.608877] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-17T03:03:49.999123] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-17T03:03:49.999259] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-17T03:03:50.000349] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-17T03:03:50.000417] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-17T03:03:50.001998] [DEBUG] [LOCAL ] CTRA: Trimmed 77510 records to 53650 (keeping 200 days of data) [2025-09-17T03:03:50.294221] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-17T03:03:50.335389] [DEBUG] [LOCAL ] CTRA: Primary data saved (53650 records). [2025-09-17T03:03:50.335515] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-17T03:03:50.335601] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRA took 28.6s. Estimated remaining: 4h 24m 18s. Rate: 6.9 symbols/min [2025-09-17T03:03:50.502623] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:50.538710] [DEBUG] [LOCAL ] CTVA: Loaded 39714 existing records from primary storage. [2025-09-17T03:03:50.538896] [INFO ] [MAIN ] CTVA: Loaded 39714 existing records. [2025-09-17T03:03:50.723581] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:50.723858] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-17T03:03:50.723916] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-17T03:03:50.724783] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-17T03:03:50.724847] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-17T03:03:51.075515] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:51.090087] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-11. [2025-09-17T03:03:51.154071] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T03:03:51.283272] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T03:03:51.890135] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-17T03:03:52.690161] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-17T03:03:52.771569] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T03:03:52.962228] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:03:53.490193] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-17T03:03:53.767811] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T03:03:54.290191] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-17T03:03:54.926543] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:03:55.090148] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-17T03:03:55.873801] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T03:03:55.890077] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-17T03:03:56.041734] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T03:03:56.690081] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-17T03:03:56.726145] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T03:03:57.490134] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-17T03:03:58.290145] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-17T03:03:58.495768] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T03:03:58.688097] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T03:03:59.090162] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-17T03:03:59.742784] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:03:59.749731] [INFO ] [REMOTE ] CTRE: Full fetch complete (70885 records). [2025-09-17T03:03:59.749937] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-17T03:03:59.895351] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-17T03:04:00.174908] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-17T03:04:00.175328] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-17T03:04:00.176762] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-17T03:04:00.176870] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-17T03:04:00.188094] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:04:00.194144] [DEBUG] [LOCAL ] CTRE: Trimmed 70885 records to 49196 (keeping 200 days of data) [2025-09-17T03:04:00.515742] [DEBUG] [LOCAL ] CTRE: Primary data saved (49196 records). [2025-09-17T03:04:00.516000] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-17T03:04:00.516123] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRE took 37.9s. Estimated remaining: 4h 24m 14s. Rate: 6.9 symbols/min [2025-09-17T03:04:00.699207] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-17T03:04:00.703244] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:00.705096] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-17T03:04:00.705175] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-17T03:04:00.705323] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-17T03:04:00.705383] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-17T03:04:00.705432] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-17T03:04:00.705473] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-17T03:04:01.092781] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:01.374754] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T03:04:01.490101] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-17T03:04:01.886092] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:04:02.290139] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-17T03:04:02.980208] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:04:03.090138] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-17T03:04:03.699049] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:04:03.890178] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-11. [2025-09-17T03:04:04.242238] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T03:04:04.650236] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T03:04:04.690101] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-17T03:04:05.490133] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-17T03:04:06.290191] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-17T03:04:06.408142] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:04:06.848751] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:04:06.971290] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T03:04:07.090174] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-17T03:04:07.890133] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-17T03:04:08.472275] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:04:08.690164] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-17T03:04:09.049554] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:04:09.055595] [INFO ] [REMOTE ] CTRI: Full fetch complete (50169 records). [2025-09-17T03:04:09.055737] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-17T03:04:09.444321] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-17T03:04:09.444478] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-17T03:04:09.445263] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-17T03:04:09.445347] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-17T03:04:09.446622] [DEBUG] [LOCAL ] CTRI: Trimmed 50169 records to 37167 (keeping 200 days of data) [2025-09-17T03:04:09.515975] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-17T03:04:09.725342] [DEBUG] [LOCAL ] CTRI: Primary data saved (37167 records). [2025-09-17T03:04:09.725551] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-17T03:04:09.725678] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRI took 26.5s. Estimated remaining: 4h 24m 7s. Rate: 6.9 symbols/min [2025-09-17T03:04:09.981361] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:10.038586] [DEBUG] [LOCAL ] CUBE: Loaded 37936 existing records from primary storage. [2025-09-17T03:04:10.039174] [INFO ] [MAIN ] CUBE: Loaded 37936 existing records. [2025-09-17T03:04:10.284735] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:04:10.309222] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-17T03:04:10.416050] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:10.416614] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-17T03:04:10.431425] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-17T03:04:10.432879] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:04:10.438148] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-17T03:04:10.438687] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-17T03:04:10.711948] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-17T03:04:10.803436] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:11.090145] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-17T03:04:11.335817] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-17T03:04:11.890141] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-11. [2025-09-17T03:04:12.690132] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-17T03:04:12.950101] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-17T03:04:13.220334] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T03:04:13.490335] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-17T03:04:14.265285] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T03:04:14.290069] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-17T03:04:15.093091] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-17T03:04:15.094880] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:04:15.444843] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T03:04:15.890135] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-17T03:04:16.690133] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-17T03:04:17.490130] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-17T03:04:17.527523] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:04:17.530411] [INFO ] [REMOTE ] CTS: Full fetch complete (26349 records). [2025-09-17T03:04:17.530527] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-17T03:04:17.877213] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T03:04:17.909425] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-17T03:04:17.909527] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-17T03:04:17.910008] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-17T03:04:17.910185] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-17T03:04:17.911127] [DEBUG] [LOCAL ] CTS: Trimmed 26349 records to 19337 (keeping 200 days of data) [2025-09-17T03:04:18.029977] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T03:04:18.072478] [DEBUG] [LOCAL ] CTS: Primary data saved (19337 records). [2025-09-17T03:04:18.072670] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-17T03:04:18.072773] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTS took 33.2s. Estimated remaining: 4h 23m 57s. Rate: 6.9 symbols/min [2025-09-17T03:04:18.249568] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:18.268906] [DEBUG] [LOCAL ] CUBI: Loaded 19849 existing records from primary storage. [2025-09-17T03:04:18.269070] [INFO ] [MAIN ] CUBI: Loaded 19849 existing records. [2025-09-17T03:04:18.298681] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-17T03:04:18.454790] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:18.455056] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-17T03:04:18.455126] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-17T03:04:18.455557] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-17T03:04:18.455615] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-17T03:04:18.815048] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:19.090132] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-17T03:04:19.747891] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:04:19.890127] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-17T03:04:20.315589] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:04:20.690132] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-17T03:04:20.977630] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-17T03:04:21.495233] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-11. [2025-09-17T03:04:21.516508] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T03:04:22.290121] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-17T03:04:22.873415] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T03:04:23.090138] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-17T03:04:23.890180] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-17T03:04:24.047842] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:04:24.133157] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-17T03:04:24.476954] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:04:24.690155] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-17T03:04:25.036370] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T03:04:25.490128] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-17T03:04:26.290107] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-17T03:04:26.308335] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T03:04:27.090183] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-17T03:04:27.628058] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T03:04:27.890130] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-17T03:04:28.041689] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:04:28.048441] [INFO ] [REMOTE ] CTVA: Full fetch complete (76750 records). [2025-09-17T03:04:28.048593] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-17T03:04:28.448048] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-17T03:04:28.448167] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-17T03:04:28.449009] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-17T03:04:28.449067] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-17T03:04:28.450506] [DEBUG] [LOCAL ] CTVA: Trimmed 76750 records to 53231 (keeping 200 days of data) [2025-09-17T03:04:28.699947] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-17T03:04:28.783397] [DEBUG] [LOCAL ] CTVA: Primary data saved (53231 records). [2025-09-17T03:04:28.783569] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-17T03:04:28.783683] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CTVA took 38.4s. Estimated remaining: 4h 23m 55s. Rate: 6.9 symbols/min [2025-09-17T03:04:28.959917] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:28.996053] [DEBUG] [LOCAL ] CUK: Loaded 37737 existing records from primary storage. [2025-09-17T03:04:28.996219] [INFO ] [MAIN ] CUK: Loaded 37737 existing records. [2025-09-17T03:04:29.174246] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:29.174542] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-17T03:04:29.174810] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-17T03:04:29.175618] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-17T03:04:29.175714] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-17T03:04:29.311472] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:04:29.495321] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-17T03:04:29.572046] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:30.169099] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T03:04:30.290108] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-11. [2025-09-17T03:04:30.351476] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T03:04:31.090143] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-17T03:04:31.890189] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-17T03:04:32.071395] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T03:04:32.690112] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-17T03:04:32.718391] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:04:32.881522] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:04:33.490160] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-17T03:04:33.833844] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T03:04:33.834574] [INFO ] [REMOTE ] CUBB: Full fetch complete (922 records). [2025-09-17T03:04:33.834709] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-17T03:04:34.048027] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T03:04:34.048208] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:04:34.048253] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:04:34.048303] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-17T03:04:34.048369] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-17T03:04:34.048410] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-17T03:04:34.048474] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-17T03:04:34.048548] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CUBB took 33.5s. Estimated remaining: 4h 23m 35s. Rate: 6.9 symbols/min [2025-09-17T03:04:34.225164] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:34.229367] [DEBUG] [LOCAL ] CULP: Loaded 2000 existing records from primary storage. [2025-09-17T03:04:34.229798] [INFO ] [MAIN ] CULP: Loaded 2000 existing records. [2025-09-17T03:04:34.296736] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-17T03:04:34.460245] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:34.461026] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-17T03:04:34.462475] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T03:04:34.462589] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-17T03:04:34.472795] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-17T03:04:34.472889] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-17T03:04:34.845239] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:35.090134] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-17T03:04:35.788789] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T03:04:35.890096] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-17T03:04:36.445007] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T03:04:36.690174] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-11. [2025-09-17T03:04:37.004372] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T03:04:37.176532] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T03:04:37.490192] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-17T03:04:38.290178] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-17T03:04:38.935456] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T03:04:39.090153] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-17T03:04:39.245572] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T03:04:39.890195] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-17T03:04:40.469589] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T03:04:40.690160] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-17T03:04:40.740676] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T03:04:41.225145] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T03:04:41.490152] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-17T03:04:42.290130] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-17T03:04:42.823075] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T03:04:43.090103] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-17T03:04:43.456049] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:04:43.890196] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-17T03:04:44.415942] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:04:44.690155] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-17T03:04:45.279587] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:04:45.354773] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:04:45.490134] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-17T03:04:46.082961] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T03:04:46.290137] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-17T03:04:46.612288] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T03:04:47.090138] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-17T03:04:47.579320] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T03:04:47.890167] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-17T03:04:48.487421] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:04:48.690164] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-17T03:04:49.490154] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-17T03:04:50.290195] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-17T03:04:50.397732] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T03:04:50.429203] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T03:04:51.090125] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-17T03:04:51.466940] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:04:51.473897] [INFO ] [REMOTE ] CUBE: Full fetch complete (72735 records). [2025-09-17T03:04:51.474046] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-17T03:04:51.861053] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-17T03:04:51.861161] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-17T03:04:51.861981] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-17T03:04:51.862048] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-17T03:04:51.863465] [DEBUG] [LOCAL ] CUBE: Trimmed 72735 records to 50775 (keeping 200 days of data) [2025-09-17T03:04:51.923730] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-17T03:04:52.198013] [DEBUG] [LOCAL ] CUBE: Primary data saved (50775 records). [2025-09-17T03:04:52.198353] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-17T03:04:52.198576] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CUBE took 42.5s. Estimated remaining: 4h 23m 57s. Rate: 6.9 symbols/min [2025-09-17T03:04:52.374541] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:52.404008] [DEBUG] [LOCAL ] CURB: Loaded 23660 existing records from primary storage. [2025-09-17T03:04:52.404239] [INFO ] [MAIN ] CURB: Loaded 23660 existing records. [2025-09-17T03:04:52.509829] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T03:04:52.595931] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:52.596274] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-17T03:04:52.596341] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-17T03:04:52.597059] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-17T03:04:52.597135] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-17T03:04:52.690434] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-17T03:04:52.991961] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:53.030809] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:04:53.227369] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:04:53.228476] [INFO ] [REMOTE ] CULP: Full fetch complete (4729 records). [2025-09-17T03:04:53.228591] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-17T03:04:53.495301] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-17T03:04:53.606026] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-17T03:04:53.606146] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-17T03:04:53.606337] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-17T03:04:53.606413] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-17T03:04:53.606883] [DEBUG] [LOCAL ] CULP: Trimmed 4729 records to 3102 (keeping 200 days of data) [2025-09-17T03:04:53.626276] [DEBUG] [LOCAL ] CULP: Primary data saved (3102 records). [2025-09-17T03:04:53.626392] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-17T03:04:53.626518] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CULP took 19.6s. Estimated remaining: 4h 23m 24s. Rate: 6.9 symbols/min [2025-09-17T03:04:53.803159] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:53.824890] [DEBUG] [LOCAL ] CURV: Loaded 20011 existing records from primary storage. [2025-09-17T03:04:53.825067] [INFO ] [MAIN ] CURV: Loaded 20011 existing records. [2025-09-17T03:04:54.001957] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:54.002211] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-17T03:04:54.002283] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-17T03:04:54.002752] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-17T03:04:54.002819] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-17T03:04:54.295289] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-11. [2025-09-17T03:04:54.364145] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:54.482414] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:04:55.090185] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-11. [2025-09-17T03:04:55.388360] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:04:55.890184] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-17T03:04:56.389473] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:04:56.690133] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-17T03:04:56.907036] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:04:57.490137] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-17T03:04:57.829004] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:04:58.290145] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-17T03:04:59.101683] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-17T03:04:59.104547] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T03:04:59.598319] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T03:04:59.868006] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:04:59.890105] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-17T03:05:00.690182] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-17T03:05:01.125575] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T03:05:01.129659] [INFO ] [REMOTE ] CUBI: Full fetch complete (38912 records). [2025-09-17T03:05:01.129808] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-17T03:05:01.497587] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-17T03:05:01.522538] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-17T03:05:01.522702] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-17T03:05:01.523305] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-17T03:05:01.523484] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-17T03:05:01.524767] [DEBUG] [LOCAL ] CUBI: Trimmed 38912 records to 27203 (keeping 200 days of data) [2025-09-17T03:05:01.702588] [DEBUG] [LOCAL ] CUBI: Primary data saved (27203 records). [2025-09-17T03:05:01.702800] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-17T03:05:01.702935] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CUBI took 43.6s. Estimated remaining: 4h 23m 14s. Rate: 6.9 symbols/min [2025-09-17T03:05:02.290202] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-17T03:05:02.681166] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T03:05:02.825001] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T03:05:03.090185] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-17T03:05:03.181573] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T03:05:03.890259] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-17T03:05:04.690205] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-17T03:05:04.958937] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:05:05.002458] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T03:05:05.490186] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-17T03:05:06.211219] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T03:05:06.290158] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-17T03:05:07.090134] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-17T03:05:07.295526] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:05:07.819060] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T03:05:07.890132] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-17T03:05:08.028559] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:05:08.690184] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-17T03:05:08.857304] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T03:05:09.490155] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-17T03:05:10.056403] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T03:05:10.063861] [INFO ] [REMOTE ] CUK: Full fetch complete (73409 records). [2025-09-17T03:05:10.064103] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-17T03:05:10.308252] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-17T03:05:10.475596] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-17T03:05:10.475757] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-17T03:05:10.476720] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-17T03:05:10.476785] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-17T03:05:10.478729] [DEBUG] [LOCAL ] CUK: Trimmed 73409 records to 51034 (keeping 200 days of data) [2025-09-17T03:05:10.783626] [DEBUG] [LOCAL ] CUK: Primary data saved (51034 records). [2025-09-17T03:05:10.783814] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-17T03:05:10.783958] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CUK took 42.0s. Estimated remaining: 4h 23m 6s. Rate: 6.9 symbols/min [2025-09-17T03:05:10.872574] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:05:11.089095] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T03:05:11.093825] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-17T03:05:11.890139] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-17T03:05:12.294847] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:05:12.690120] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-17T03:05:12.920839] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T03:05:13.490190] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-17T03:05:13.858286] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T03:05:14.290149] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-17T03:05:14.383912] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T03:05:15.090169] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-17T03:05:15.441972] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:05:15.447715] [INFO ] [REMOTE ] CURB: Full fetch complete (47065 records). [2025-09-17T03:05:15.447838] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-17T03:05:15.840960] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-17T03:05:15.841084] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-17T03:05:15.841724] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-17T03:05:15.841804] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-17T03:05:15.842881] [DEBUG] [LOCAL ] CURB: Trimmed 47065 records to 33001 (keeping 200 days of data) [2025-09-17T03:05:16.047038] [DEBUG] [LOCAL ] CURB: Primary data saved (33001 records). [2025-09-17T03:05:16.047205] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-17T03:05:16.047315] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURB took 23.8s. Estimated remaining: 4h 22m 46s. Rate: 6.9 symbols/min [2025-09-17T03:05:16.552717] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:05:16.560677] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-17T03:05:17.927772] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:05:17.934582] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-17T03:05:19.158229] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T03:05:19.163315] [INFO ] [REMOTE ] CURV: Full fetch complete (39828 records). [2025-09-17T03:05:19.163434] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-17T03:05:19.539154] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-17T03:05:19.539266] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-17T03:05:19.539814] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-17T03:05:19.539874] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-17T03:05:19.541160] [DEBUG] [LOCAL ] CURV: Trimmed 39828 records to 26461 (keeping 200 days of data) [2025-09-17T03:05:19.698535] [DEBUG] [LOCAL ] CURV: Primary data saved (26461 records). [2025-09-17T03:05:19.698714] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-17T03:05:19.698814] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURV took 26.1s. Estimated remaining: 4h 22m 21s. Rate: 6.9 symbols/min [2025-09-17T03:05:20.318792] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.298770] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.316802] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.395259] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.395786] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-09-17T03:05:20.395847] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-09-17T03:05:20.395954] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-17T03:05:20.396004] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-17T03:05:20.396112] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-09-17T03:05:20.396183] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-17T03:05:20.437064] [DEBUG] [LOCAL ] CVEO: Loaded 11755 existing records from primary storage. [2025-09-17T03:05:20.480736] [INFO ] [MAIN ] CVEO: Loaded 11755 existing records. [2025-09-17T03:05:20.825514] [DEBUG] [LOCAL ] CUZ: Loaded 36954 existing records from primary storage. [2025-09-17T03:05:20.847575] [DEBUG] [LOCAL ] CVE: Loaded 39924 existing records from primary storage. [2025-09-17T03:05:20.857928] [INFO ] [MAIN ] CUZ: Loaded 36954 existing records. [2025-09-17T03:05:20.878161] [INFO ] [MAIN ] CVE: Loaded 39924 existing records. [2025-09-17T03:05:21.138964] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:21.248775] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-17T03:05:21.297550] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-17T03:05:21.289011] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:21.355905] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-11. [2025-09-17T03:05:21.360114] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:21.395913] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:21.390575] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-17T03:05:21.396295] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-17T03:05:21.396558] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-17T03:05:21.396265] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-17T03:05:21.396730] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-17T03:05:21.396835] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-17T03:05:21.426689] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-17T03:05:21.432894] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-17T03:05:21.453423] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-17T03:05:21.453310] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-17T03:05:22.398345] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:22.419948] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-11. [2025-09-17T03:05:22.530222] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:22.551471] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-11. [2025-09-17T03:05:22.551036] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:22.552614] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-11. [2025-09-17T03:05:22.782981] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T03:05:22.793040] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-17T03:05:23.353525] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T03:05:23.356735] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-17T03:05:23.865501] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T03:05:23.875139] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-17T03:05:24.021518] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:05:24.031842] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-17T03:05:24.073838] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T03:05:24.084003] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-17T03:05:24.160288] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T03:05:24.690190] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-17T03:05:25.289388] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:05:25.358601] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:05:25.490087] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-17T03:05:25.530343] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T03:05:25.641984] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:05:26.290200] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-17T03:05:26.882765] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:05:27.090179] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-17T03:05:27.699096] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T03:05:27.890129] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-17T03:05:28.690193] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-17T03:05:28.932530] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T03:05:29.190158] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T03:05:29.245487] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:05:29.490175] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-17T03:05:30.290172] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-17T03:05:31.090124] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-17T03:05:31.285744] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:05:31.401117] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:05:31.890140] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-17T03:05:32.690129] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-17T03:05:32.762920] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T03:05:33.465925] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:05:33.490074] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-17T03:05:34.290165] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-17T03:05:34.563365] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T03:05:34.913033] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:05:35.090166] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-17T03:05:35.281460] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:05:35.890176] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-17T03:05:36.142905] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T03:05:36.690192] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-17T03:05:37.490187] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-17T03:05:37.734724] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T03:05:38.290158] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-17T03:05:38.321710] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T03:05:38.448309] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:05:39.090156] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-17T03:05:39.890140] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-17T03:05:40.015657] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:05:40.690137] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-17T03:05:40.720697] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:05:41.020418] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T03:05:41.490136] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-17T03:05:42.186773] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T03:05:42.290145] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-17T03:05:43.090140] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-17T03:05:43.278021] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:05:43.647815] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:05:43.865679] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T03:05:43.890085] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-17T03:05:44.498802] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T03:05:44.690172] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-17T03:05:45.490174] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-17T03:05:45.988732] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T03:05:46.290126] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-17T03:05:46.608340] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T03:05:47.090134] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-17T03:05:47.890111] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-17T03:05:47.891159] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T03:05:47.898869] [INFO ] [REMOTE ] CUZ: Full fetch complete (70507 records). [2025-09-17T03:05:47.899066] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-17T03:05:48.299187] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-17T03:05:48.299334] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-17T03:05:48.300278] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-17T03:05:48.300366] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-17T03:05:48.301892] [DEBUG] [LOCAL ] CUZ: Trimmed 70507 records to 49328 (keeping 200 days of data) [2025-09-17T03:05:48.619145] [DEBUG] [LOCAL ] CUZ: Primary data saved (49328 records). [2025-09-17T03:05:48.619366] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-17T03:05:48.619492] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CUZ took 28.9s. Estimated remaining: 4h 23m 18s. Rate: 6.9 symbols/min [2025-09-17T03:05:48.708598] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-17T03:05:48.818189] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:48.825157] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:05:48.827721] [INFO ] [REMOTE ] CVEO: Full fetch complete (20169 records). [2025-09-17T03:05:48.827823] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-17T03:05:48.944745] [DEBUG] [LOCAL ] CVLG: Loaded 11374 existing records from primary storage. [2025-09-17T03:05:48.950492] [INFO ] [MAIN ] CVLG: Loaded 11374 existing records. [2025-09-17T03:05:49.374393] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:49.409797] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-17T03:05:49.410045] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-17T03:05:49.409920] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-17T03:05:49.410460] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-17T03:05:49.410519] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-17T03:05:49.411043] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-17T03:05:49.411161] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-17T03:05:49.411210] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-17T03:05:49.480339] [DEBUG] [LOCAL ] CVEO: Trimmed 20169 records to 15752 (keeping 200 days of data) [2025-09-17T03:05:49.801889] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-17T03:05:49.872696] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-17T03:05:49.902120] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:49.915392] [DEBUG] [LOCAL ] CVEO: Primary data saved (15752 records). [2025-09-17T03:05:49.915515] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-17T03:05:49.915610] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CVEO took 30.2s. Estimated remaining: 4h 22m 45s. Rate: 6.9 symbols/min [2025-09-17T03:05:50.092792] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:50.132270] [DEBUG] [LOCAL ] CVNA: Loaded 39474 existing records from primary storage. [2025-09-17T03:05:50.132457] [INFO ] [MAIN ] CVNA: Loaded 39474 existing records. [2025-09-17T03:05:50.295039] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-11. [2025-09-17T03:05:50.318677] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:50.318860] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-17T03:05:50.318936] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-17T03:05:50.319941] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-17T03:05:50.320011] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-17T03:05:50.692783] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:50.721005] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T03:05:50.917574] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T03:05:51.090151] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-17T03:05:51.431933] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T03:05:51.890152] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-11. [2025-09-17T03:05:52.315685] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T03:05:52.361376] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:05:52.690155] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-17T03:05:53.490150] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-17T03:05:54.124815] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:05:54.130777] [INFO ] [REMOTE ] CVI: Full fetch complete (67039 records). [2025-09-17T03:05:54.130952] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-17T03:05:54.296493] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-17T03:05:54.521511] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-17T03:05:54.521633] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-17T03:05:54.522447] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-17T03:05:54.522509] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-17T03:05:54.524000] [DEBUG] [LOCAL ] CVI: Trimmed 67039 records to 46411 (keeping 200 days of data) [2025-09-17T03:05:54.850298] [DEBUG] [LOCAL ] CVI: Primary data saved (46411 records). [2025-09-17T03:05:54.850507] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-17T03:05:54.850611] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CVI took 35.2s. Estimated remaining: 4h 22m 24s. Rate: 6.9 symbols/min [2025-09-17T03:05:55.091150] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-17T03:05:55.177595] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:55.181985] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T03:05:55.193298] [INFO ] [REMOTE ] CVE: Full fetch complete (77391 records). [2025-09-17T03:05:55.193552] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-17T03:05:55.357280] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T03:05:55.441440] [DEBUG] [LOCAL ] CVS: Loaded 40048 existing records from primary storage. [2025-09-17T03:05:55.480281] [INFO ] [MAIN ] CVS: Loaded 40048 existing records. [2025-09-17T03:05:55.922977] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-17T03:05:55.985500] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:56.002128] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-17T03:05:56.070479] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-17T03:05:56.090813] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-17T03:05:56.090966] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-17T03:05:56.092258] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-17T03:05:56.092533] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-17T03:05:56.092701] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-17T03:05:56.092970] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-17T03:05:56.160904] [DEBUG] [LOCAL ] CVE: Trimmed 77391 records to 53560 (keeping 200 days of data) [2025-09-17T03:05:56.516347] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:05:56.708967] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-17T03:05:56.714452] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:56.837699] [DEBUG] [LOCAL ] CVE: Primary data saved (53560 records). [2025-09-17T03:05:56.837874] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-17T03:05:56.837973] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVE took 37.1s. Estimated remaining: 4h 21m 54s. Rate: 6.9 symbols/min [2025-09-17T03:05:57.007199] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:57.018751] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:05:57.061544] [DEBUG] [LOCAL ] CVX: Loaded 40110 existing records from primary storage. [2025-09-17T03:05:57.061736] [INFO ] [MAIN ] CVX: Loaded 40110 existing records. [2025-09-17T03:05:57.238876] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:57.239128] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-17T03:05:57.239192] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-17T03:05:57.240082] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-17T03:05:57.240145] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-17T03:05:57.493257] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-17T03:05:57.600926] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:57.645618] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T03:05:58.290142] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-11. [2025-09-17T03:05:58.345491] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T03:05:59.090141] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-17T03:05:59.890167] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-17T03:06:00.035388] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T03:06:00.264607] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T03:06:00.643289] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T03:06:00.690135] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-17T03:06:01.490132] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-11. [2025-09-17T03:06:02.290134] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-17T03:06:03.090201] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-17T03:06:04.119152] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (3.43 seconds). [2025-09-17T03:06:04.132064] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-17T03:06:04.545875] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-17T03:06:04.690265] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-17T03:06:04.792945] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-11 (3.30 seconds). [2025-09-17T03:06:04.866559] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:06:05.490168] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-17T03:06:05.729078] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T03:06:06.144212] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T03:06:06.196964] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T03:06:06.290149] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-17T03:06:07.090172] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-17T03:06:07.462088] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:06:07.890127] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-17T03:06:08.538880] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:06:08.690158] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-17T03:06:08.778943] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T03:06:09.490117] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-17T03:06:09.527252] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T03:06:10.290178] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-17T03:06:10.854438] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T03:06:10.857327] [INFO ] [REMOTE ] CVLG: Full fetch complete (20182 records). [2025-09-17T03:06:10.857495] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-17T03:06:11.095362] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-17T03:06:11.244432] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-17T03:06:11.244537] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-17T03:06:11.244989] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-17T03:06:11.245052] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-17T03:06:11.245699] [DEBUG] [LOCAL ] CVLG: Trimmed 20182 records to 15371 (keeping 200 days of data) [2025-09-17T03:06:11.343524] [DEBUG] [LOCAL ] CVLG: Primary data saved (15371 records). [2025-09-17T03:06:11.343703] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-17T03:06:11.343824] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVLG took 22.7s. Estimated remaining: 4h 22m 4s. Rate: 6.9 symbols/min [2025-09-17T03:06:11.517456] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:11.535543] [DEBUG] [LOCAL ] CW: Loaded 16921 existing records from primary storage. [2025-09-17T03:06:11.535736] [INFO ] [MAIN ] CW: Loaded 16921 existing records. [2025-09-17T03:06:11.712474] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:06:11.712801] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-17T03:06:11.712875] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-17T03:06:11.713504] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-17T03:06:11.713588] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-17T03:06:11.913086] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-17T03:06:11.998453] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T03:06:12.119131] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:12.637893] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T03:06:12.690075] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-17T03:06:13.119617] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:06:13.167762] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T03:06:13.490143] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-17T03:06:14.290166] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-11. [2025-09-17T03:06:15.090138] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-17T03:06:15.692137] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T03:06:15.890088] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-17T03:06:16.438522] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-17T03:06:16.526029] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T03:06:16.690084] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-17T03:06:17.490133] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-17T03:06:18.277383] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-17T03:06:18.290071] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-17T03:06:19.090124] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-17T03:06:19.643268] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T03:06:19.751689] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-09-17T03:06:19.890114] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-17T03:06:20.199279] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-17T03:06:20.690164] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-17T03:06:20.727577] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:06:20.944497] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:06:21.490147] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-17T03:06:22.290195] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-17T03:06:22.599784] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T03:06:22.606213] [INFO ] [REMOTE ] CVNA: Full fetch complete (76599 records). [2025-09-17T03:06:22.606392] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-17T03:06:23.014590] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-17T03:06:23.014823] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-17T03:06:23.015789] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-17T03:06:23.015857] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-17T03:06:23.017464] [DEBUG] [LOCAL ] CVNA: Trimmed 76599 records to 53080 (keeping 200 days of data) [2025-09-17T03:06:23.106996] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-17T03:06:23.342772] [DEBUG] [LOCAL ] CVNA: Primary data saved (53080 records). [2025-09-17T03:06:23.342939] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-17T03:06:23.343036] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVNA took 33.4s. Estimated remaining: 4h 22m 5s. Rate: 6.9 symbols/min [2025-09-17T03:06:23.520556] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:23.520865] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-09-17T03:06:23.521003] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-09-17T03:06:23.521142] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-17T03:06:23.521208] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-17T03:06:23.521306] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-17T03:06:23.521358] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-17T03:06:23.747465] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T03:06:23.895279] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-17T03:06:23.950320] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:24.344056] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T03:06:24.513578] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-17T03:06:24.690139] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-17T03:06:25.490131] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-17T03:06:25.698418] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T03:06:25.779072] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T03:06:26.290181] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-17T03:06:27.090172] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-11. [2025-09-17T03:06:27.895197] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-17T03:06:27.914918] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T03:06:28.400678] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T03:06:28.441745] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T03:06:28.690152] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-17T03:06:29.490143] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-17T03:06:29.536939] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T03:06:30.290144] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-17T03:06:30.952444] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T03:06:31.090148] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-17T03:06:31.142764] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T03:06:31.349431] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:06:31.890112] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-17T03:06:32.379296] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:06:32.690173] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-17T03:06:33.490129] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-17T03:06:34.085589] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-17T03:06:34.251493] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T03:06:34.290131] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-17T03:06:34.641837] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T03:06:35.090139] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-17T03:06:35.161970] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:06:35.890130] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-17T03:06:36.690130] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-17T03:06:37.201364] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T03:06:37.208035] [INFO ] [REMOTE ] CVX: Full fetch complete (77768 records). [2025-09-17T03:06:37.208274] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-17T03:06:37.492107] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-17T03:06:37.577106] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:06:37.614682] [INFO ] [REMOTE ] CW: Full fetch complete (33461 records). [2025-09-17T03:06:37.637483] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-17T03:06:37.637683] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-17T03:06:37.637795] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-17T03:06:37.638906] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-17T03:06:37.639054] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-17T03:06:37.742089] [DEBUG] [LOCAL ] CVX: Trimmed 77768 records to 53760 (keeping 200 days of data) [2025-09-17T03:06:38.306863] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T03:06:38.307918] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-17T03:06:38.321404] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-17T03:06:38.323738] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-17T03:06:38.324384] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-17T03:06:38.326750] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-17T03:06:38.330204] [DEBUG] [LOCAL ] CW: Trimmed 33461 records to 22793 (keeping 200 days of data) [2025-09-17T03:06:38.558340] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-17T03:06:38.560056] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-17T03:06:38.561920] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVX took 41.7s. Estimated remaining: 4h 22m 17s. Rate: 6.9 symbols/min [2025-09-17T03:06:38.752992] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:38.777129] [DEBUG] [LOCAL ] CW: Primary data saved (22793 records). [2025-09-17T03:06:38.777308] [INFO ] [MAIN ] CW: Full history saved. [2025-09-17T03:06:38.777412] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CW took 27.4s. Estimated remaining: 4h 21m 42s. Rate: 6.9 symbols/min [2025-09-17T03:06:38.975331] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:38.976662] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-09-17T03:06:38.976809] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-09-17T03:06:38.976729] [DEBUG] [LOCAL ] CWEN: Loaded 33122 existing records from primary storage. [2025-09-17T03:06:38.977057] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-17T03:06:38.976983] [INFO ] [MAIN ] CWEN: Loaded 33122 existing records. [2025-09-17T03:06:38.977127] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-17T03:06:39.044548] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-09-17T03:06:39.065598] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-17T03:06:39.249158] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:06:39.286027] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-17T03:06:39.295005] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-17T03:06:39.374050] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-17T03:06:39.413091] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-17T03:06:39.661565] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:39.678090] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-11. [2025-09-17T03:06:39.860463] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T03:06:39.905156] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-17T03:06:39.977815] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:40.330005] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T03:06:40.337815] [INFO ] [REMOTE ] CVS: Full fetch complete (77701 records). [2025-09-17T03:06:40.338084] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-17T03:06:40.694218] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-11. [2025-09-17T03:06:40.736475] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-17T03:06:40.736582] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-17T03:06:40.737457] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-17T03:06:40.737516] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-17T03:06:40.739015] [DEBUG] [LOCAL ] CVS: Trimmed 77701 records to 53698 (keeping 200 days of data) [2025-09-17T03:06:41.094595] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:06:41.125575] [DEBUG] [LOCAL ] CVS: Primary data saved (53698 records). [2025-09-17T03:06:41.125770] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-17T03:06:41.125890] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CVS took 46.3s. Estimated remaining: 4h 21m 13s. Rate: 6.9 symbols/min [2025-09-17T03:06:41.299683] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:41.332568] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T03:06:41.371411] [DEBUG] [LOCAL ] CWK: Loaded 36655 existing records from primary storage. [2025-09-17T03:06:41.371597] [INFO ] [MAIN ] CWK: Loaded 36655 existing records. [2025-09-17T03:06:41.495244] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-17T03:06:41.551793] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:06:41.552594] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-17T03:06:41.552680] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-17T03:06:41.553579] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-17T03:06:41.553668] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-17T03:06:41.916729] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:42.300454] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-17T03:06:42.303231] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:06:42.906638] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:06:43.090145] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-17T03:06:43.890112] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-17T03:06:43.926113] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:06:44.383741] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:06:44.690139] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-17T03:06:45.321384] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:06:45.490122] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-11. [2025-09-17T03:06:46.290135] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-17T03:06:46.687682] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T03:06:46.786890] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:06:47.090153] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-17T03:06:47.890150] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-17T03:06:48.060206] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:06:48.587105] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:06:48.690110] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-17T03:06:49.101928] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:06:49.490174] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-17T03:06:50.188663] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T03:06:50.290113] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-17T03:06:51.090130] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-17T03:06:51.295294] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:06:51.465943] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:06:51.890167] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-17T03:06:52.343586] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T03:06:52.690146] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-17T03:06:53.497053] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-17T03:06:53.516997] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:06:54.295206] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-17T03:06:54.314195] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T03:06:55.090165] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-17T03:06:55.141319] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T03:06:55.897496] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-17T03:06:55.920617] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T03:06:56.514124] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T03:06:56.690131] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-17T03:06:57.493022] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:06:57.490153] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-17T03:06:57.990632] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T03:06:58.290158] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-17T03:06:59.090158] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-17T03:06:59.127810] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:06:59.791189] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T03:06:59.890090] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-17T03:07:00.690203] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-17T03:07:00.962264] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:07:01.325920] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:07:01.490149] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-17T03:07:02.290219] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-17T03:07:02.320794] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:07:03.077293] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:07:03.083289] [INFO ] [REMOTE ] CWH: Full fetch complete (72436 records). [2025-09-17T03:07:03.083448] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-17T03:07:03.096148] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-17T03:07:03.474001] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-17T03:07:03.474114] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-17T03:07:03.475038] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-17T03:07:03.475111] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-17T03:07:03.476515] [DEBUG] [LOCAL ] CWH: Trimmed 72436 records to 51418 (keeping 200 days of data) [2025-09-17T03:07:03.792803] [DEBUG] [LOCAL ] CWH: Primary data saved (51418 records). [2025-09-17T03:07:03.792977] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-17T03:07:03.793093] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWH took 25.0s. Estimated remaining: 4h 21m 48s. Rate: 6.9 symbols/min [2025-09-17T03:07:03.893376] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-17T03:07:03.965274] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:03.984973] [DEBUG] [LOCAL ] CWT: Loaded 20240 existing records from primary storage. [2025-09-17T03:07:03.985122] [INFO ] [MAIN ] CWT: Loaded 20240 existing records. [2025-09-17T03:07:04.169767] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:04.170135] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-17T03:07:04.170274] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-17T03:07:04.180786] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-17T03:07:04.195010] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-17T03:07:04.300887] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T03:07:04.563689] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:04.690092] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-11. [2025-09-17T03:07:04.995466] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:07:05.191560] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:07:05.490114] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-17T03:07:06.025305] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T03:07:06.290155] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-17T03:07:06.808163] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T03:07:07.090211] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-17T03:07:07.562709] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:07:07.890184] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-17T03:07:08.299864] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:07:08.305331] [INFO ] [REMOTE ] CWEN: Full fetch complete (64105 records). [2025-09-17T03:07:08.305466] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-17T03:07:08.697382] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-17T03:07:08.698245] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-17T03:07:08.699672] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-17T03:07:08.700579] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-17T03:07:08.700668] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-17T03:07:08.702118] [DEBUG] [LOCAL ] CWEN: Trimmed 64105 records to 45036 (keeping 200 days of data) [2025-09-17T03:07:08.828582] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T03:07:09.009742] [DEBUG] [LOCAL ] CWEN: Primary data saved (45036 records). [2025-09-17T03:07:09.009969] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-17T03:07:09.010131] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 30.4s. Estimated remaining: 4h 21m 28s. Rate: 6.9 symbols/min [2025-09-17T03:07:09.180768] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:09.216933] [DEBUG] [LOCAL ] CX: Loaded 39346 existing records from primary storage. [2025-09-17T03:07:09.217100] [INFO ] [MAIN ] CX: Loaded 39346 existing records. [2025-09-17T03:07:09.393824] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:09.394063] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-17T03:07:09.394113] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-17T03:07:09.394890] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-17T03:07:09.394958] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-17T03:07:09.495044] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-17T03:07:09.760081] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:09.911028] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:07:10.290189] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-17T03:07:11.095561] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-17T03:07:11.108239] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:07:11.119938] [INFO ] [REMOTE ] CWAN: Full fetch complete (74881 records). [2025-09-17T03:07:11.120197] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-17T03:07:11.520068] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-17T03:07:11.520184] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-17T03:07:11.521296] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-17T03:07:11.521383] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-17T03:07:11.522957] [DEBUG] [LOCAL ] CWAN: Trimmed 74881 records to 52389 (keeping 200 days of data) [2025-09-17T03:07:11.787817] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T03:07:11.886115] [DEBUG] [LOCAL ] CWAN: Primary data saved (52389 records). [2025-09-17T03:07:11.886292] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-17T03:07:11.886383] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWAN took 48.5s. Estimated remaining: 4h 21m 1s. Rate: 6.9 symbols/min [2025-09-17T03:07:11.897918] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-17T03:07:12.065023] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:12.071250] [DEBUG] [LOCAL ] CXE: Loaded 4683 existing records from primary storage. [2025-09-17T03:07:12.071397] [INFO ] [MAIN ] CXE: Loaded 4683 existing records. [2025-09-17T03:07:12.263961] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:12.264265] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-17T03:07:12.264333] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-17T03:07:12.264614] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-17T03:07:12.264768] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-17T03:07:12.635448] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T03:07:12.639085] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:12.690116] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-11. [2025-09-17T03:07:13.350585] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:07:13.490128] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-17T03:07:14.290167] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-11. [2025-09-17T03:07:14.517821] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T03:07:14.582854] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T03:07:14.847818] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T03:07:15.090143] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-17T03:07:15.890142] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-17T03:07:16.690201] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-17T03:07:16.891538] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:07:17.449753] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T03:07:17.490099] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-17T03:07:17.647668] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:07:18.290139] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-17T03:07:19.035072] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T03:07:19.090090] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-17T03:07:19.243654] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T03:07:19.613494] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T03:07:19.890124] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-17T03:07:20.690153] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-17T03:07:20.986703] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:07:21.490194] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-17T03:07:21.934037] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T03:07:22.290143] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-17T03:07:22.736292] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T03:07:22.743031] [INFO ] [REMOTE ] CWK: Full fetch complete (70633 records). [2025-09-17T03:07:22.743235] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-17T03:07:23.095222] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-17T03:07:23.144041] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-17T03:07:23.144143] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-17T03:07:23.144993] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-17T03:07:23.145051] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-17T03:07:23.146885] [DEBUG] [LOCAL ] CWK: Trimmed 70633 records to 49395 (keeping 200 days of data) [2025-09-17T03:07:23.443088] [DEBUG] [LOCAL ] CWK: Primary data saved (49395 records). [2025-09-17T03:07:23.443248] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-17T03:07:23.443360] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 42.3s. Estimated remaining: 4h 21m 1s. Rate: 6.9 symbols/min [2025-09-17T03:07:23.613386] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:23.620629] [DEBUG] [LOCAL ] CXH: Loaded 3921 existing records from primary storage. [2025-09-17T03:07:23.620807] [INFO ] [MAIN ] CXH: Loaded 3921 existing records. [2025-09-17T03:07:23.805543] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:23.805827] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-17T03:07:23.805898] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-17T03:07:23.806168] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-17T03:07:23.806228] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-17T03:07:23.898118] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-17T03:07:24.177591] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:24.207200] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T03:07:24.591322] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:07:24.612893] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:07:24.690140] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-11. [2025-09-17T03:07:25.195058] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T03:07:25.490118] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-17T03:07:25.938453] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T03:07:26.290142] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-17T03:07:26.785780] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T03:07:27.090138] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-17T03:07:27.890159] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-17T03:07:28.468047] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:07:28.594491] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T03:07:28.690144] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-17T03:07:29.490147] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-17T03:07:29.875505] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T03:07:29.899864] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:07:30.290154] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-17T03:07:30.620232] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T03:07:31.090198] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-17T03:07:31.890216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-17T03:07:32.360996] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:07:32.403659] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T03:07:32.690145] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-17T03:07:33.490152] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-17T03:07:34.206228] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T03:07:34.290140] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-17T03:07:34.332892] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T03:07:34.794827] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T03:07:35.090149] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-17T03:07:35.890137] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-17T03:07:36.290582] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T03:07:36.690197] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-17T03:07:37.343345] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T03:07:37.345860] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T03:07:37.347865] [INFO ] [REMOTE ] CXE: Full fetch complete (11859 records). [2025-09-17T03:07:37.358829] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-17T03:07:37.506234] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-17T03:07:37.730956] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-17T03:07:37.731066] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-17T03:07:37.731390] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-17T03:07:37.731476] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-17T03:07:37.731980] [DEBUG] [LOCAL ] CXE: Trimmed 11859 records to 7151 (keeping 200 days of data) [2025-09-17T03:07:37.776048] [DEBUG] [LOCAL ] CXE: Primary data saved (7151 records). [2025-09-17T03:07:37.776227] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-17T03:07:37.776338] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CXE took 25.9s. Estimated remaining: 4h 21m 10s. Rate: 6.9 symbols/min [2025-09-17T03:07:37.949123] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:37.986664] [DEBUG] [LOCAL ] CXM: Loaded 35428 existing records from primary storage. [2025-09-17T03:07:37.986877] [INFO ] [MAIN ] CXM: Loaded 35428 existing records. [2025-09-17T03:07:38.177826] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T03:07:38.184147] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:38.185121] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-17T03:07:38.185187] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-17T03:07:38.186103] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-17T03:07:38.186167] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-17T03:07:38.295325] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-17T03:07:38.544408] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:39.090202] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-17T03:07:39.225875] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T03:07:39.890132] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-17T03:07:40.447666] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:07:40.690134] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-17T03:07:40.896452] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T03:07:41.281053] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:07:41.490136] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-11. [2025-09-17T03:07:42.290138] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-17T03:07:42.791788] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:07:43.004999] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T03:07:43.008941] [INFO ] [REMOTE ] CWT: Full fetch complete (40126 records). [2025-09-17T03:07:43.009065] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-17T03:07:43.090115] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-17T03:07:43.383654] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-17T03:07:43.383755] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-17T03:07:43.384296] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-17T03:07:43.384349] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-17T03:07:43.385335] [DEBUG] [LOCAL ] CWT: Trimmed 40126 records to 27984 (keeping 200 days of data) [2025-09-17T03:07:43.557202] [DEBUG] [LOCAL ] CWT: Primary data saved (27984 records). [2025-09-17T03:07:43.557365] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-17T03:07:43.557463] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CWT took 39.8s. Estimated remaining: 4h 20m 52s. Rate: 6.9 symbols/min [2025-09-17T03:07:43.727864] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:43.749666] [DEBUG] [LOCAL ] CXT: Loaded 22307 existing records from primary storage. [2025-09-17T03:07:43.749835] [INFO ] [MAIN ] CXT: Loaded 22307 existing records. [2025-09-17T03:07:43.899953] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-17T03:07:43.928800] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:43.928965] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-17T03:07:43.929023] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-17T03:07:43.929691] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-17T03:07:43.929753] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-17T03:07:44.287498] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:44.690136] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-17T03:07:44.737837] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T03:07:45.256307] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T03:07:45.490149] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-17T03:07:45.871355] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T03:07:46.290156] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-17T03:07:46.889892] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T03:07:47.090195] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-11. [2025-09-17T03:07:47.890114] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-17T03:07:47.920234] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T03:07:48.690139] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-17T03:07:49.205119] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (3.71 seconds). [2025-09-17T03:07:49.261495] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T03:07:49.262981] [INFO ] [REMOTE ] CXH: Full fetch complete (5536 records). [2025-09-17T03:07:49.263067] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-17T03:07:49.490212] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-17T03:07:49.621503] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-17T03:07:49.621614] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-17T03:07:49.621831] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-17T03:07:49.621901] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-17T03:07:49.622313] [DEBUG] [LOCAL ] CXH: Trimmed 5536 records to 4413 (keeping 200 days of data) [2025-09-17T03:07:49.648674] [DEBUG] [LOCAL ] CXH: Primary data saved (4413 records). [2025-09-17T03:07:49.648908] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-17T03:07:49.649036] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CXH took 26.2s. Estimated remaining: 4h 20m 35s. Rate: 6.9 symbols/min [2025-09-17T03:07:49.820143] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:49.820440] [DEBUG] [LOCAL ] CXW: No existing data file found in primary storage. [2025-09-17T03:07:49.820500] [WARN ] [MAIN ] CXW: No existing data found, performing full refresh instead. [2025-09-17T03:07:49.820676] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-17T03:07:49.820727] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-17T03:07:49.820771] [DEBUG] [LOCAL ] CXW: No primary data file found to delete. [2025-09-17T03:07:49.820812] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-17T03:07:49.962054] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T03:07:50.218148] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:50.290159] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-11. [2025-09-17T03:07:50.635262] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:07:51.090186] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-17T03:07:51.890177] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-17T03:07:52.156049] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:07:52.450959] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:07:52.457851] [INFO ] [REMOTE ] CX: Full fetch complete (76208 records). [2025-09-17T03:07:52.458085] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-17T03:07:52.695279] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-17T03:07:52.881003] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-17T03:07:52.881131] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-17T03:07:52.882003] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-17T03:07:52.882069] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-17T03:07:52.883684] [DEBUG] [LOCAL ] CX: Trimmed 76208 records to 52846 (keeping 200 days of data) [2025-09-17T03:07:53.208815] [DEBUG] [LOCAL ] CX: Primary data saved (52846 records). [2025-09-17T03:07:53.209004] [INFO ] [MAIN ] CX: Full history saved. [2025-09-17T03:07:53.209112] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CX took 44.2s. Estimated remaining: 4h 20m 11s. Rate: 6.9 symbols/min [2025-09-17T03:07:53.399464] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:53.436910] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:07:53.456087] [DEBUG] [LOCAL ] CYD: Loaded 19154 existing records from primary storage. [2025-09-17T03:07:53.456728] [INFO ] [MAIN ] CYD: Loaded 19154 existing records. [2025-09-17T03:07:53.497093] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-17T03:07:53.685268] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:53.685540] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-17T03:07:53.685604] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-17T03:07:53.686233] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-17T03:07:53.686297] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-17T03:07:54.042920] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:54.070377] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:07:54.290170] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-11. [2025-09-17T03:07:54.523970] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T03:07:54.962205] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T03:07:55.090116] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-17T03:07:55.890185] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-17T03:07:55.962182] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T03:07:56.565592] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:07:56.690129] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-17T03:07:57.490142] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-17T03:07:58.176078] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:07:58.290114] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-17T03:07:58.957739] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T03:07:59.090179] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-17T03:07:59.665582] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:07:59.773918] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T03:07:59.890207] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-17T03:08:00.690156] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-17T03:08:01.490135] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-17T03:08:01.557958] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:08:02.290180] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-17T03:08:02.499878] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T03:08:03.070176] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T03:08:03.090104] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-17T03:08:03.387129] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T03:08:03.890134] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-17T03:08:04.690218] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-17T03:08:05.490214] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-17T03:08:06.094545] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T03:08:06.290151] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-17T03:08:06.334501] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:08:07.090225] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-17T03:08:07.185153] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (4.10 seconds). [2025-09-17T03:08:07.862371] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T03:08:07.890095] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-17T03:08:08.471561] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:08:08.690122] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-17T03:08:09.013157] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (5.12 seconds). [2025-09-17T03:08:09.490133] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-17T03:08:09.618162] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:08:09.970875] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T03:08:10.290117] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-17T03:08:11.007118] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:08:11.090092] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-17T03:08:11.890137] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-17T03:08:12.436226] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T03:08:12.690140] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-17T03:08:13.065036] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:08:13.490166] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-17T03:08:13.749253] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T03:08:14.290149] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-17T03:08:14.765420] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:08:15.090134] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-17T03:08:15.172061] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T03:08:15.890130] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-17T03:08:16.690140] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-17T03:08:16.746294] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:08:16.801063] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T03:08:17.490155] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-17T03:08:17.595732] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (7.31 seconds). [2025-09-17T03:08:18.127721] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:08:18.133614] [INFO ] [REMOTE ] CXM: Full fetch complete (68954 records). [2025-09-17T03:08:18.133776] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-17T03:08:18.292497] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-17T03:08:18.529163] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-17T03:08:18.529306] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-17T03:08:18.530112] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-17T03:08:18.530193] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-17T03:08:18.531692] [DEBUG] [LOCAL ] CXM: Trimmed 68954 records to 47979 (keeping 200 days of data) [2025-09-17T03:08:18.817148] [DEBUG] [LOCAL ] CXM: Primary data saved (47979 records). [2025-09-17T03:08:18.817320] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-17T03:08:18.817430] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 41.0s. Estimated remaining: 4h 20m 54s. Rate: 6.9 symbols/min [2025-09-17T03:08:18.990473] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:19.023906] [DEBUG] [LOCAL ] CYH: Loaded 35832 existing records from primary storage. [2025-09-17T03:08:19.024073] [INFO ] [MAIN ] CYH: Loaded 35832 existing records. [2025-09-17T03:08:19.093595] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-17T03:08:19.232383] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:19.235225] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-17T03:08:19.235479] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-17T03:08:19.237045] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T03:08:19.245966] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-17T03:08:19.246400] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-17T03:08:19.624264] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:19.688859] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:08:19.890131] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-11. [2025-09-17T03:08:20.370327] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:08:20.374370] [INFO ] [REMOTE ] CXT: Full fetch complete (44653 records). [2025-09-17T03:08:20.374502] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-17T03:08:20.699286] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-17T03:08:20.752542] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-17T03:08:20.752657] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-17T03:08:20.753232] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-17T03:08:20.753287] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-17T03:08:20.754351] [DEBUG] [LOCAL ] CXT: Trimmed 44653 records to 30981 (keeping 200 days of data) [2025-09-17T03:08:20.943186] [DEBUG] [LOCAL ] CXT: Primary data saved (30981 records). [2025-09-17T03:08:20.943335] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-17T03:08:20.943430] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXT took 37.4s. Estimated remaining: 4h 20m 25s. Rate: 6.9 symbols/min [2025-09-17T03:08:21.115288] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:21.152504] [DEBUG] [LOCAL ] D: Loaded 40007 existing records from primary storage. [2025-09-17T03:08:21.152708] [INFO ] [MAIN ] D: Loaded 40007 existing records. [2025-09-17T03:08:21.330557] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:21.330828] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-17T03:08:21.330887] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-17T03:08:21.331741] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-17T03:08:21.331803] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-17T03:08:21.496330] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-17T03:08:21.709840] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:21.737024] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T03:08:22.125825] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:08:22.290135] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-17T03:08:22.670550] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T03:08:22.675893] [INFO ] [REMOTE ] CXW: Full fetch complete (65089 records). [2025-09-17T03:08:22.676091] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-17T03:08:23.082467] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-17T03:08:23.082591] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-17T03:08:23.083341] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-17T03:08:23.083407] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-17T03:08:23.084833] [DEBUG] [LOCAL ] CXW: Trimmed 65089 records to 44708 (keeping 200 days of data) [2025-09-17T03:08:23.137412] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-17T03:08:23.357879] [DEBUG] [LOCAL ] CXW: Primary data saved (44708 records). [2025-09-17T03:08:23.358174] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-17T03:08:23.358266] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CXW took 33.7s. Estimated remaining: 4h 19m 57s. Rate: 6.9 symbols/min [2025-09-17T03:08:23.527958] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:23.537440] [DEBUG] [LOCAL ] DAC: Loaded 9052 existing records from primary storage. [2025-09-17T03:08:23.537580] [INFO ] [MAIN ] DAC: Loaded 9052 existing records. [2025-09-17T03:08:23.715458] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:23.715827] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-17T03:08:23.716115] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-17T03:08:23.716722] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-17T03:08:23.716800] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-17T03:08:23.893728] [INFO ] [REMOTE ] D: Fetching primary data for 2024-11. [2025-09-17T03:08:23.964385] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:08:24.140067] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:24.141165] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:08:24.145167] [INFO ] [REMOTE ] CYD: Full fetch complete (30948 records). [2025-09-17T03:08:24.145258] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-17T03:08:24.528878] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-17T03:08:24.529041] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-17T03:08:24.529538] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-17T03:08:24.529613] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-17T03:08:24.530525] [DEBUG] [LOCAL ] CYD: Trimmed 30948 records to 26833 (keeping 200 days of data) [2025-09-17T03:08:24.694149] [DEBUG] [LOCAL ] CYD: Primary data saved (26833 records). [2025-09-17T03:08:24.690950] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-11. [2025-09-17T03:08:24.694609] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-17T03:08:24.695666] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYD took 31.5s. Estimated remaining: 4h 19m 25s. Rate: 6.9 symbols/min [2025-09-17T03:08:24.874175] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:24.911808] [DEBUG] [LOCAL ] DAL: Loaded 40103 existing records from primary storage. [2025-09-17T03:08:24.911977] [INFO ] [MAIN ] DAL: Loaded 40103 existing records. [2025-09-17T03:08:25.095942] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:25.096206] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-17T03:08:25.096267] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-17T03:08:25.097154] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-17T03:08:25.097245] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-17T03:08:25.471110] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:25.490087] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-17T03:08:25.558075] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:08:25.753159] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T03:08:26.290145] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-17T03:08:27.090174] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-17T03:08:27.182311] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T03:08:27.890235] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-17T03:08:27.892185] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T03:08:28.690176] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-17T03:08:29.490166] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-11. [2025-09-17T03:08:31.513624] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T03:08:31.524158] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-17T03:08:32.145554] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (5.06 seconds). [2025-09-17T03:08:32.150041] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-17T03:08:33.279589] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T03:08:33.284350] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-17T03:08:33.418656] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T03:08:33.430578] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-17T03:08:34.029699] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (6.14 seconds). [2025-09-17T03:08:34.039906] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-17T03:08:34.306989] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:08:34.310674] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-17T03:08:35.187165] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T03:08:35.190731] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-17T03:08:35.263113] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T03:08:35.732104] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (7.04 seconds). [2025-09-17T03:08:35.890146] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-17T03:08:36.690134] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-17T03:08:37.154715] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (3.72 seconds). [2025-09-17T03:08:37.490169] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-17T03:08:37.503870] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T03:08:38.084024] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T03:08:38.290139] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-17T03:08:38.614755] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-17T03:08:38.935121] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T03:08:39.090139] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-17T03:08:39.890142] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-17T03:08:40.487575] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:08:40.695481] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-17T03:08:40.701219] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T03:08:41.490148] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-17T03:08:41.623710] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T03:08:42.290124] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-17T03:08:42.743148] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (5.25 seconds). [2025-09-17T03:08:43.090165] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-17T03:08:43.133714] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T03:08:43.868963] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:08:43.890117] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-17T03:08:44.001208] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T03:08:44.690137] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-17T03:08:45.167504] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:08:45.490128] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-17T03:08:46.290174] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-17T03:08:46.745194] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T03:08:47.099509] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-17T03:08:47.107254] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T03:08:47.130140] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:08:47.131949] [INFO ] [REMOTE ] DAC: Full fetch complete (20164 records). [2025-09-17T03:08:47.132141] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-17T03:08:47.493931] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-17T03:08:47.494038] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-17T03:08:47.494409] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-17T03:08:47.494460] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-17T03:08:47.495075] [DEBUG] [LOCAL ] DAC: Trimmed 20164 records to 12820 (keeping 200 days of data) [2025-09-17T03:08:47.574077] [DEBUG] [LOCAL ] DAC: Primary data saved (12820 records). [2025-09-17T03:08:47.574232] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-17T03:08:47.574326] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. DAC took 24.2s. Estimated remaining: 4h 20m 0s. Rate: 6.9 symbols/min [2025-09-17T03:08:47.741109] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:47.776605] [DEBUG] [LOCAL ] DAN: Loaded 36555 existing records from primary storage. [2025-09-17T03:08:47.776935] [INFO ] [MAIN ] DAN: Loaded 36555 existing records. [2025-09-17T03:08:47.895271] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-17T03:08:47.959758] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:47.959977] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-17T03:08:47.960037] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-17T03:08:47.961031] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-17T03:08:47.961097] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-17T03:08:48.314978] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:48.690188] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-11. [2025-09-17T03:08:49.490186] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-17T03:08:49.562159] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-17T03:08:49.646984] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T03:08:49.869796] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T03:08:50.290160] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-17T03:08:51.090146] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-17T03:08:51.140008] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:08:51.890169] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-17T03:08:52.690185] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-17T03:08:53.322023] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:08:53.331174] [INFO ] [REMOTE ] CYH: Full fetch complete (70420 records). [2025-09-17T03:08:53.331438] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-17T03:08:53.451881] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-17T03:08:53.556919] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-17T03:08:54.019265] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-17T03:08:54.019483] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-17T03:08:54.020427] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-17T03:08:54.020705] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-17T03:08:54.059446] [DEBUG] [LOCAL ] CYH: Trimmed 70420 records to 48064 (keeping 200 days of data) [2025-09-17T03:08:54.061422] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (3.77 seconds). [2025-09-17T03:08:54.292878] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-17T03:08:54.321734] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:08:54.406060] [DEBUG] [LOCAL ] CYH: Primary data saved (48064 records). [2025-09-17T03:08:54.406242] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-17T03:08:54.406347] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. CYH took 35.6s. Estimated remaining: 4h 19m 46s. Rate: 6.9 symbols/min [2025-09-17T03:08:54.576925] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:54.590710] [DEBUG] [LOCAL ] DAO: Loaded 13384 existing records from primary storage. [2025-09-17T03:08:54.590851] [INFO ] [MAIN ] DAO: Loaded 13384 existing records. [2025-09-17T03:08:54.765549] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:54.765803] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-17T03:08:54.765862] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-17T03:08:54.766425] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-17T03:08:54.766488] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-17T03:08:55.094885] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-17T03:08:55.119760] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:55.724578] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-17T03:08:55.890150] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-17T03:08:55.946055] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:08:56.554823] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:08:56.690182] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-17T03:08:57.490221] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-17T03:08:58.100551] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:08:58.295196] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-17T03:08:58.311910] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T03:08:59.090204] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-11. [2025-09-17T03:08:59.455579] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T03:08:59.737934] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:08:59.890123] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-17T03:09:00.100802] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T03:09:00.690141] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-17T03:09:01.443189] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:09:01.490148] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-17T03:09:02.140999] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:09:02.147599] [INFO ] [REMOTE ] D: Full fetch complete (77503 records). [2025-09-17T03:09:02.147811] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-17T03:09:02.295290] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-17T03:09:02.564305] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-17T03:09:02.564442] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-17T03:09:02.565465] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-17T03:09:02.565543] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-17T03:09:02.567226] [DEBUG] [LOCAL ] D: Trimmed 77503 records to 53647 (keeping 200 days of data) [2025-09-17T03:09:02.921841] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-09-17T03:09:02.922029] [INFO ] [MAIN ] D: Full history saved. [2025-09-17T03:09:02.922154] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. D took 42.0s. Estimated remaining: 4h 19m 36s. Rate: 6.9 symbols/min [2025-09-17T03:09:03.093941] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-17T03:09:03.095567] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:03.096823] [DEBUG] [LOCAL ] DAR: No existing data file found in primary storage. [2025-09-17T03:09:03.096892] [WARN ] [MAIN ] DAR: No existing data found, performing full refresh instead. [2025-09-17T03:09:03.097018] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-17T03:09:03.097072] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-17T03:09:03.097126] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-17T03:09:03.097165] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-17T03:09:03.469269] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:03.890142] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-11. [2025-09-17T03:09:04.185387] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-17T03:09:04.473392] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T03:09:04.500071] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:09:04.690135] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-17T03:09:05.490182] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-17T03:09:05.539020] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T03:09:05.735975] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T03:09:06.290128] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-17T03:09:07.090100] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-17T03:09:07.191066] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:09:07.366487] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:09:07.890145] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-17T03:09:08.637229] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T03:09:08.643827] [INFO ] [REMOTE ] DAL: Full fetch complete (77714 records). [2025-09-17T03:09:08.644008] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-17T03:09:08.695371] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-17T03:09:09.058219] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-17T03:09:09.058485] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-17T03:09:09.059397] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-17T03:09:09.059597] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-17T03:09:09.081165] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:09:09.088701] [DEBUG] [LOCAL ] DAL: Trimmed 77714 records to 53753 (keeping 200 days of data) [2025-09-17T03:09:09.427559] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-17T03:09:09.427762] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-17T03:09:09.427867] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. DAL took 44.7s. Estimated remaining: 4h 19m 21s. Rate: 6.9 symbols/min [2025-09-17T03:09:09.495311] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-17T03:09:09.600355] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:09.631065] [DEBUG] [LOCAL ] DAVA: Loaded 30657 existing records from primary storage. [2025-09-17T03:09:09.631232] [INFO ] [MAIN ] DAVA: Loaded 30657 existing records. [2025-09-17T03:09:09.810141] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:09:09.810394] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-17T03:09:09.810451] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-17T03:09:09.811254] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-17T03:09:09.811320] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-17T03:09:10.198276] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:10.228746] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:09:10.290076] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-17T03:09:10.846062] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T03:09:11.090145] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-17T03:09:11.563401] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:09:11.863961] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T03:09:11.890089] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-17T03:09:12.690142] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-11. [2025-09-17T03:09:13.154811] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T03:09:13.490136] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-17T03:09:14.132986] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:09:14.290159] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-17T03:09:14.982514] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:09:15.090154] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-17T03:09:15.890151] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-17T03:09:16.690186] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-17T03:09:18.035575] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T03:09:18.043335] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-17T03:09:18.401604] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T03:09:18.412879] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-17T03:09:18.704064] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (3.61 seconds). [2025-09-17T03:09:18.980595] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T03:09:19.090139] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-17T03:09:19.584767] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (5.29 seconds). [2025-09-17T03:09:19.858919] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:09:19.890082] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-17T03:09:20.409141] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:09:20.690126] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-17T03:09:21.490133] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-17T03:09:21.551955] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:09:22.172131] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:09:22.290114] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-17T03:09:22.744078] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T03:09:23.090132] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-17T03:09:23.561618] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:09:23.890128] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-17T03:09:24.538006] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:09:24.690096] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-17T03:09:25.122338] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:09:25.490185] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-17T03:09:25.976822] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T03:09:26.290143] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-17T03:09:26.543159] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:09:26.942495] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:09:27.090128] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-17T03:09:27.776234] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T03:09:27.890136] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-17T03:09:28.690182] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-17T03:09:29.073307] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:09:29.490169] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-17T03:09:29.962502] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:09:29.971852] [INFO ] [REMOTE ] DAR: Full fetch complete (74333 records). [2025-09-17T03:09:29.972087] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-17T03:09:30.295275] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-17T03:09:30.368736] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-17T03:09:30.368858] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-17T03:09:30.369691] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-17T03:09:30.369751] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-17T03:09:30.371288] [DEBUG] [LOCAL ] DAR: Trimmed 74333 records to 51810 (keeping 200 days of data) [2025-09-17T03:09:30.466745] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:09:30.470721] [INFO ] [REMOTE ] DAO: Full fetch complete (32466 records). [2025-09-17T03:09:30.471576] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-17T03:09:31.074206] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-17T03:09:31.074311] [DEBUG] [LOCAL ] DAR: Primary data saved (51810 records). [2025-09-17T03:09:31.074578] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-17T03:09:31.074749] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAR took 28.2s. Estimated remaining: 4h 19m 51s. Rate: 6.9 symbols/min [2025-09-17T03:09:31.074783] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-17T03:09:31.096343] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-17T03:09:31.120190] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-17T03:09:31.160881] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-17T03:09:31.253408] [DEBUG] [LOCAL ] DAO: Trimmed 32466 records to 21549 (keeping 200 days of data) [2025-09-17T03:09:31.256716] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:31.257183] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-09-17T03:09:31.257244] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-09-17T03:09:31.257374] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-17T03:09:31.257605] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-17T03:09:31.257691] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-09-17T03:09:31.257739] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-17T03:09:31.629005] [DEBUG] [LOCAL ] DAO: Primary data saved (21549 records). [2025-09-17T03:09:31.666548] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-17T03:09:31.677515] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAO took 37.3s. Estimated remaining: 4h 19m 18s. Rate: 6.9 symbols/min [2025-09-17T03:09:31.829294] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:31.894396] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-11. [2025-09-17T03:09:31.941422] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:31.968215] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T03:09:32.008536] [DEBUG] [LOCAL ] DB: Loaded 39078 existing records from primary storage. [2025-09-17T03:09:32.008719] [INFO ] [MAIN ] DB: Loaded 39078 existing records. [2025-09-17T03:09:32.190377] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:09:32.190696] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-17T03:09:32.190750] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-17T03:09:32.191675] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-17T03:09:32.191738] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-17T03:09:32.549865] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:32.565938] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:09:32.572560] [INFO ] [REMOTE ] DAN: Full fetch complete (70855 records). [2025-09-17T03:09:32.572714] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-17T03:09:32.695276] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-17T03:09:32.962689] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-17T03:09:32.962799] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-17T03:09:32.963607] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-17T03:09:32.963681] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-17T03:09:32.965314] [DEBUG] [LOCAL ] DAN: Trimmed 70855 records to 49040 (keeping 200 days of data) [2025-09-17T03:09:33.272604] [DEBUG] [LOCAL ] DAN: Primary data saved (49040 records). [2025-09-17T03:09:33.272872] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-17T03:09:33.273049] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAN took 45.7s. Estimated remaining: 4h 18m 48s. Rate: 6.9 symbols/min [2025-09-17T03:09:33.442526] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:33.442760] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-17T03:09:33.442814] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-17T03:09:33.442926] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-17T03:09:33.442969] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-17T03:09:33.443015] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-17T03:09:33.443064] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-17T03:09:33.504828] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-11. [2025-09-17T03:09:33.797513] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:33.831660] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T03:09:34.074343] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T03:09:34.080403] [INFO ] [REMOTE ] DAVA: Full fetch complete (54745 records). [2025-09-17T03:09:34.080558] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-17T03:09:34.295390] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-17T03:09:34.468142] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-17T03:09:34.468242] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-17T03:09:34.469210] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-17T03:09:34.469271] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-17T03:09:34.470529] [DEBUG] [LOCAL ] DAVA: Trimmed 54745 records to 40301 (keeping 200 days of data) [2025-09-17T03:09:34.708730] [DEBUG] [LOCAL ] DAVA: Primary data saved (40301 records). [2025-09-17T03:09:34.708887] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-17T03:09:34.709005] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAVA took 25.3s. Estimated remaining: 4h 18m 17s. Rate: 6.9 symbols/min [2025-09-17T03:09:34.885574] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:34.917074] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:09:34.952636] [DEBUG] [LOCAL ] DBI: Loaded 33046 existing records from primary storage. [2025-09-17T03:09:34.952822] [INFO ] [MAIN ] DBI: Loaded 33046 existing records. [2025-09-17T03:09:35.095247] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-17T03:09:35.141324] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:09:35.141697] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-17T03:09:35.141790] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-17T03:09:35.142715] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-17T03:09:35.142802] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-17T03:09:35.505353] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:35.890215] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-11. [2025-09-17T03:09:35.958910] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:09:36.690164] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-17T03:09:36.723036] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:09:36.752012] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T03:09:37.490133] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-17T03:09:38.270167] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T03:09:38.290079] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-17T03:09:38.999600] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:09:39.090106] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-17T03:09:39.533779] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T03:09:39.890131] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-17T03:09:40.690150] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-11. [2025-09-17T03:09:40.833393] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:09:41.467247] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:09:41.490090] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-17T03:09:41.871081] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T03:09:42.290147] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-17T03:09:43.090142] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-17T03:09:43.260093] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:09:43.603425] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T03:09:43.890141] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-17T03:09:44.345657] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T03:09:44.690166] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-17T03:09:45.212842] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T03:09:45.490174] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-17T03:09:45.598139] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T03:09:46.290220] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-17T03:09:46.906494] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T03:09:47.090095] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-17T03:09:47.890131] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-17T03:09:48.026813] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T03:09:48.368945] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:09:48.690140] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-17T03:09:48.772612] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T03:09:49.490213] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-17T03:09:50.297927] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-17T03:09:50.303363] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:09:51.085337] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:09:51.095725] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-17T03:09:51.808989] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T03:09:51.838035] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:09:51.890119] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-17T03:09:52.690144] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-17T03:09:53.421989] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T03:09:53.490170] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-17T03:09:54.284003] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:09:54.294401] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-17T03:09:54.958801] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T03:09:54.981563] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T03:09:55.090127] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-17T03:09:55.890140] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-17T03:09:56.693811] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-17T03:09:56.701225] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T03:09:57.403726] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T03:09:57.411817] [INFO ] [REMOTE ] DAY: Full fetch complete (71679 records). [2025-09-17T03:09:57.412007] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-17T03:09:57.495238] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-17T03:09:57.810604] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-17T03:09:57.810740] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-17T03:09:57.811595] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-17T03:09:57.811671] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-17T03:09:57.813416] [DEBUG] [LOCAL ] DAY: Trimmed 71679 records to 50078 (keeping 200 days of data) [2025-09-17T03:09:57.933733] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T03:09:58.135583] [DEBUG] [LOCAL ] DAY: Primary data saved (50078 records). [2025-09-17T03:09:58.135772] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-17T03:09:58.135872] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DAY took 27.1s. Estimated remaining: 4h 18m 53s. Rate: 6.9 symbols/min [2025-09-17T03:09:58.290939] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-17T03:09:58.310265] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:58.310490] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-09-17T03:09:58.310542] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-09-17T03:09:58.310684] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-17T03:09:58.310758] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-17T03:09:58.310813] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-09-17T03:09:58.310857] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-17T03:09:58.671138] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:59.095371] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-11. [2025-09-17T03:09:59.110271] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T03:09:59.172319] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T03:09:59.862115] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T03:09:59.890101] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-17T03:10:00.690149] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-17T03:10:01.490142] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-17T03:10:01.571866] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T03:10:02.290099] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-17T03:10:02.687733] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T03:10:02.733877] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T03:10:03.090186] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-17T03:10:03.840381] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T03:10:03.890131] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-17T03:10:03.928104] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T03:10:04.690211] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-17T03:10:05.437616] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T03:10:05.490130] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-17T03:10:05.732303] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:10:06.233166] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:10:06.290140] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-17T03:10:07.090192] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-17T03:10:07.669330] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T03:10:07.675218] [INFO ] [REMOTE ] DBI: Full fetch complete (66648 records). [2025-09-17T03:10:07.675381] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-17T03:10:07.899769] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-17T03:10:07.900574] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T03:10:08.098197] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-17T03:10:08.098302] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-17T03:10:08.099092] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-17T03:10:08.099153] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-17T03:10:08.100420] [DEBUG] [LOCAL ] DBI: Trimmed 66648 records to 45312 (keeping 200 days of data) [2025-09-17T03:10:08.364301] [DEBUG] [LOCAL ] DBI: Primary data saved (45312 records). [2025-09-17T03:10:08.364451] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-17T03:10:08.364557] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DBI took 33.7s. Estimated remaining: 4h 18m 48s. Rate: 6.9 symbols/min [2025-09-17T03:10:08.546262] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:08.581811] [DEBUG] [LOCAL ] DBRG: Loaded 36985 existing records from primary storage. [2025-09-17T03:10:08.582009] [INFO ] [MAIN ] DBRG: Loaded 36985 existing records. [2025-09-17T03:10:08.695271] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-17T03:10:08.763298] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:08.763544] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-17T03:10:08.763681] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-17T03:10:08.764590] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-17T03:10:08.764689] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-17T03:10:09.121331] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:09.139339] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T03:10:09.262177] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T03:10:09.490145] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-17T03:10:10.254040] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T03:10:10.290106] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-17T03:10:11.005415] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T03:10:11.090121] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-17T03:10:11.682208] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:10:11.890131] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-17T03:10:12.690138] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-17T03:10:12.948297] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T03:10:13.490178] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-11. [2025-09-17T03:10:14.290129] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-17T03:10:14.685382] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:10:14.991711] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T03:10:15.090124] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-17T03:10:15.265400] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:10:15.268763] [INFO ] [REMOTE ] DBD: Full fetch complete (30218 records). [2025-09-17T03:10:15.268882] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-17T03:10:15.646982] [DEBUG] [VALIDATOR ] DBD: All expected trading days are present. [2025-09-17T03:10:15.647094] [DEBUG] [VALIDATOR ] DBD: Primary data validation passed. [2025-09-17T03:10:15.647629] [INFO ] [MAIN ] DBD: Fetched primary data is valid. [2025-09-17T03:10:15.647711] [DEBUG] [LOCAL ] DBD: Saving primary data. [2025-09-17T03:10:15.648522] [DEBUG] [LOCAL ] DBD: Trimmed 30218 records to 23783 (keeping 200 days of data) [2025-09-17T03:10:15.789228] [DEBUG] [LOCAL ] DBD: Primary data saved (23783 records). [2025-09-17T03:10:15.789380] [INFO ] [MAIN ] DBD: Full history saved. [2025-09-17T03:10:15.789468] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DBD took 42.5s. Estimated remaining: 4h 18m 36s. Rate: 6.9 symbols/min [2025-09-17T03:10:15.890152] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-17T03:10:15.962163] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:15.988516] [DEBUG] [LOCAL ] DCI: Loaded 27450 existing records from primary storage. [2025-09-17T03:10:15.988701] [INFO ] [MAIN ] DCI: Loaded 27450 existing records. [2025-09-17T03:10:16.167634] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:16.167909] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-17T03:10:16.167967] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-17T03:10:16.168742] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-17T03:10:16.168804] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-17T03:10:16.527940] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:16.594728] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T03:10:16.690109] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-11. [2025-09-17T03:10:16.817463] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T03:10:17.490145] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-17T03:10:18.158788] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:10:18.290128] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-17T03:10:19.090123] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-17T03:10:19.214560] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T03:10:19.222493] [INFO ] [REMOTE ] DB: Full fetch complete (73743 records). [2025-09-17T03:10:19.222695] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-17T03:10:19.648333] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-17T03:10:19.648455] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-17T03:10:19.649280] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-17T03:10:19.649342] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-17T03:10:19.650910] [DEBUG] [LOCAL ] DB: Trimmed 73743 records to 52651 (keeping 200 days of data) [2025-09-17T03:10:19.892668] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-17T03:10:19.987314] [DEBUG] [LOCAL ] DB: Primary data saved (52651 records). [2025-09-17T03:10:19.987495] [INFO ] [MAIN ] DB: Full history saved. [2025-09-17T03:10:19.987605] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DB took 48.3s. Estimated remaining: 4h 18m 13s. Rate: 6.9 symbols/min [2025-09-17T03:10:20.163047] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:20.163288] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-09-17T03:10:20.163535] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-09-17T03:10:20.163815] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-17T03:10:20.163959] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-17T03:10:20.164104] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-09-17T03:10:20.164218] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-17T03:10:20.385702] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T03:10:20.487083] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T03:10:20.511438] [INFO ] [REMOTE ] DBL: Full fetch complete (12482 records). [2025-09-17T03:10:20.522296] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-17T03:10:20.657148] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:20.696414] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-17T03:10:20.878941] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T03:10:21.001442] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-17T03:10:21.001550] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-17T03:10:21.001883] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-17T03:10:21.001938] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-17T03:10:21.002476] [DEBUG] [LOCAL ] DBL: Trimmed 12482 records to 9038 (keeping 200 days of data) [2025-09-17T03:10:21.065151] [DEBUG] [LOCAL ] DBL: Primary data saved (9038 records). [2025-09-17T03:10:21.065314] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-17T03:10:21.065425] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBL took 22.9s. Estimated remaining: 4h 17m 42s. Rate: 6.9 symbols/min [2025-09-17T03:10:21.238759] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:21.283582] [DEBUG] [LOCAL ] DD: Loaded 39373 existing records from primary storage. [2025-09-17T03:10:21.283792] [INFO ] [MAIN ] DD: Loaded 39373 existing records. [2025-09-17T03:10:21.464145] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:21.464378] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-17T03:10:21.464436] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-17T03:10:21.465273] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-17T03:10:21.465338] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-17T03:10:21.496570] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-11. [2025-09-17T03:10:21.822982] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:22.112068] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T03:10:22.290138] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-11. [2025-09-17T03:10:22.480813] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T03:10:23.090138] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-17T03:10:23.560049] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:10:23.766434] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:10:23.890118] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-17T03:10:24.690179] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-17T03:10:25.370484] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:10:25.490095] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-17T03:10:25.937024] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:10:26.290138] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-17T03:10:26.312912] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T03:10:27.090091] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-17T03:10:27.740916] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:10:27.890179] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-17T03:10:28.600312] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:10:28.617918] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T03:10:28.690110] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-17T03:10:29.398425] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T03:10:29.490114] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-17T03:10:30.240411] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T03:10:30.290088] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-17T03:10:30.875611] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:10:31.090135] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-17T03:10:31.890131] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-17T03:10:32.690172] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-17T03:10:32.833577] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T03:10:33.490177] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-17T03:10:33.632568] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:10:33.697271] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:10:34.171141] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T03:10:34.290149] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-17T03:10:35.050148] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T03:10:35.090141] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-17T03:10:35.890135] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-17T03:10:36.511052] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T03:10:36.690170] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-17T03:10:36.882013] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:10:37.353885] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:10:37.359248] [INFO ] [REMOTE ] DCO: Full fetch complete (19537 records). [2025-09-17T03:10:37.359354] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-17T03:10:37.498089] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-17T03:10:37.725793] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-17T03:10:37.725898] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-17T03:10:37.726283] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-17T03:10:37.726333] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-17T03:10:37.726921] [DEBUG] [LOCAL ] DCO: Trimmed 19537 records to 13446 (keeping 200 days of data) [2025-09-17T03:10:37.808210] [DEBUG] [LOCAL ] DCO: Primary data saved (13446 records). [2025-09-17T03:10:37.808383] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-17T03:10:37.808484] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DCO took 17.8s. Estimated remaining: 4h 17m 57s. Rate: 6.9 symbols/min [2025-09-17T03:10:37.980563] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:38.015790] [DEBUG] [LOCAL ] DDD: Loaded 37715 existing records from primary storage. [2025-09-17T03:10:38.015983] [INFO ] [MAIN ] DDD: Loaded 37715 existing records. [2025-09-17T03:10:38.195927] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:38.196185] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-17T03:10:38.196243] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-17T03:10:38.197070] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-17T03:10:38.197136] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-17T03:10:38.296282] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-17T03:10:38.557041] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:39.090090] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-11. [2025-09-17T03:10:39.591471] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T03:10:39.675369] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T03:10:39.890128] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-17T03:10:40.690122] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-17T03:10:40.894872] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T03:10:41.286969] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:10:41.490097] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-17T03:10:42.290107] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-17T03:10:42.359696] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T03:10:42.668950] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:10:43.090141] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-17T03:10:43.890155] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-17T03:10:44.084324] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:10:44.350504] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:10:44.690213] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-17T03:10:45.457211] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T03:10:45.490083] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-17T03:10:46.290197] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-17T03:10:46.679668] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T03:10:46.946064] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T03:10:47.090166] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-17T03:10:47.832450] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T03:10:47.890103] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-17T03:10:48.617576] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:10:48.623552] [INFO ] [REMOTE ] DBRG: Full fetch complete (72099 records). [2025-09-17T03:10:48.623713] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-17T03:10:48.698322] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-17T03:10:49.019591] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-17T03:10:49.019719] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-17T03:10:49.020518] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-17T03:10:49.020574] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-17T03:10:49.021967] [DEBUG] [LOCAL ] DBRG: Trimmed 72099 records to 49842 (keeping 200 days of data) [2025-09-17T03:10:49.316508] [DEBUG] [LOCAL ] DBRG: Primary data saved (49842 records). [2025-09-17T03:10:49.316689] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-17T03:10:49.316780] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DBRG took 41.0s. Estimated remaining: 4h 17m 57s. Rate: 6.9 symbols/min [2025-09-17T03:10:49.485250] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:49.485430] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-09-17T03:10:49.485471] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-09-17T03:10:49.485583] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-17T03:10:49.485634] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-17T03:10:49.485703] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-09-17T03:10:49.485743] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-17T03:10:49.517034] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-17T03:10:49.855013] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:49.885891] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T03:10:50.295292] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-17T03:10:50.309405] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:10:51.090201] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-11. [2025-09-17T03:10:51.350958] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T03:10:51.890209] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-17T03:10:52.008455] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:10:52.631154] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T03:10:52.690149] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-17T03:10:52.929371] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T03:10:53.490258] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-17T03:10:54.290131] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-17T03:10:54.676076] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T03:10:54.715143] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T03:10:55.090151] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-17T03:10:55.890190] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-17T03:10:56.020302] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:10:56.413267] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T03:10:56.419943] [INFO ] [REMOTE ] DD: Full fetch complete (76037 records). [2025-09-17T03:10:56.420132] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-17T03:10:56.695177] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-17T03:10:56.818327] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-17T03:10:56.818438] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-17T03:10:56.819303] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-17T03:10:56.819363] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-17T03:10:56.820834] [DEBUG] [LOCAL ] DD: Trimmed 76037 records to 52790 (keeping 200 days of data) [2025-09-17T03:10:57.280489] [DEBUG] [LOCAL ] DD: Primary data saved (52790 records). [2025-09-17T03:10:57.280778] [INFO ] [MAIN ] DD: Full history saved. [2025-09-17T03:10:57.280977] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DD took 36.2s. Estimated remaining: 4h 17m 46s. Rate: 6.9 symbols/min [2025-09-17T03:10:57.503978] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-17T03:10:57.530221] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T03:10:57.645534] [DEBUG] [REMOTE ] DDD: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-17T03:10:57.646081] [WARN ] [REMOTE ] DDD: No data returned for month 2025-04 [2025-09-17T03:10:58.264868] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T03:10:58.290184] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-17T03:10:59.090165] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-17T03:10:59.680885] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:10:59.685819] [INFO ] [REMOTE ] DCI: Full fetch complete (54330 records). [2025-09-17T03:10:59.686008] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-17T03:10:59.909555] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-17T03:11:00.072299] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-17T03:11:00.072408] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-17T03:11:00.073145] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-17T03:11:00.073206] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-17T03:11:00.074397] [DEBUG] [LOCAL ] DCI: Trimmed 54330 records to 37761 (keeping 200 days of data) [2025-09-17T03:11:00.315462] [DEBUG] [LOCAL ] DCI: Primary data saved (37761 records). [2025-09-17T03:11:00.315879] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-17T03:11:00.316029] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DCI took 44.5s. Estimated remaining: 4h 17m 20s. Rate: 6.9 symbols/min [2025-09-17T03:11:00.482815] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:11:00.690175] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-17T03:11:01.936406] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T03:11:01.948608] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-17T03:11:02.115536] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:11:02.290137] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-17T03:11:03.797943] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T03:11:03.811006] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-17T03:11:04.591433] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T03:11:04.602291] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-17T03:11:05.667829] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:11:05.679076] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-17T03:11:06.094087] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:11:06.104197] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-17T03:11:07.381983] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:11:07.391729] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-17T03:11:07.604960] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T03:11:07.616042] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-17T03:11:08.464388] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:11:08.471605] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-17T03:11:09.133690] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T03:11:09.139867] [INFO ] [REMOTE ] DDD: Full fetch complete (65820 records). [2025-09-17T03:11:09.140017] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-17T03:11:09.359454] [WARN ] [VALIDATOR ] DDD: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:11:09.360210] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:11:09.360287] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:11:09.360360] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-17T03:11:09.360466] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-17T03:11:09.360532] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-09-17T03:11:09.361011] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-09-17T03:11:09.361141] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDD took 31.6s. Estimated remaining: 4h 17m 12s. Rate: 6.9 symbols/min [2025-09-17T03:11:09.784770] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T03:11:09.791584] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-17T03:11:10.799310] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T03:11:10.804492] [INFO ] [REMOTE ] DDL: Full fetch complete (53207 records). [2025-09-17T03:11:10.804654] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-17T03:11:11.191472] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-17T03:11:11.191603] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-17T03:11:11.192341] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-17T03:11:11.192398] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-17T03:11:11.193536] [DEBUG] [LOCAL ] DDL: Trimmed 53207 records to 36243 (keeping 200 days of data) [2025-09-17T03:11:11.394977] [DEBUG] [LOCAL ] DDL: Primary data saved (36243 records). [2025-09-17T03:11:11.395148] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-17T03:11:11.395237] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDL took 22.1s. Estimated remaining: 4h 16m 44s. Rate: 6.9 symbols/min [2025-09-17T03:11:12.033804] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.088945] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.089817] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.107483] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.106179] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-09-17T03:11:12.109168] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-09-17T03:11:12.109541] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-17T03:11:12.110314] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-17T03:11:12.111195] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-09-17T03:11:12.113388] [DEBUG] [LOCAL ] DDT: Loaded 1367 existing records from primary storage. [2025-09-17T03:11:12.113545] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-17T03:11:12.113675] [INFO ] [MAIN ] DDT: Loaded 1367 existing records. [2025-09-17T03:11:12.536583] [DEBUG] [LOCAL ] DE: Loaded 35191 existing records from primary storage. [2025-09-17T03:11:12.523856] [DEBUG] [LOCAL ] DEA: Loaded 29272 existing records from primary storage. [2025-09-17T03:11:12.554405] [INFO ] [MAIN ] DE: Loaded 35191 existing records. [2025-09-17T03:11:12.582586] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:12.579557] [INFO ] [MAIN ] DEA: Loaded 29272 existing records. [2025-09-17T03:11:12.659714] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-17T03:11:12.728333] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-17T03:11:12.802374] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-17T03:11:12.848684] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-17T03:11:13.146666] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:13.157178] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:13.184155] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-11. [2025-09-17T03:11:13.186461] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-17T03:11:13.228770] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-17T03:11:13.239518] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:13.260414] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-17T03:11:13.260676] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-17T03:11:13.288745] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-17T03:11:13.288594] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-17T03:11:13.360409] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-17T03:11:13.430535] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-17T03:11:13.977319] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:14.016481] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-11. [2025-09-17T03:11:14.189068] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:14.200760] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-11. [2025-09-17T03:11:14.253043] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T03:11:14.280753] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:14.284969] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-17T03:11:14.285479] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-11. [2025-09-17T03:11:14.563338] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T03:11:14.564457] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-17T03:11:14.971029] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:11:14.974603] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-17T03:11:15.030385] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T03:11:15.090116] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-17T03:11:15.436353] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T03:11:15.611089] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T03:11:15.637072] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T03:11:15.887338] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T03:11:15.896727] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-17T03:11:16.690109] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-17T03:11:16.850970] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T03:11:17.490125] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-17T03:11:18.161847] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:11:18.290129] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-17T03:11:19.090147] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-17T03:11:19.552833] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:11:19.554261] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T03:11:19.622755] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T03:11:19.890130] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-17T03:11:20.690128] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-17T03:11:21.474745] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:11:21.490090] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-17T03:11:21.797228] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:11:22.290127] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-17T03:11:22.657114] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T03:11:22.870012] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:11:23.090131] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-17T03:11:23.865009] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T03:11:23.890079] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-17T03:11:24.690130] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-17T03:11:25.153191] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:11:25.313992] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:11:25.490125] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-17T03:11:25.951397] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T03:11:26.290125] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-17T03:11:27.090085] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-17T03:11:27.557527] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:11:27.650079] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T03:11:27.890145] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-17T03:11:28.690140] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-17T03:11:29.287899] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:11:29.299411] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T03:11:29.490159] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-17T03:11:29.859975] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:11:29.860792] [INFO ] [REMOTE ] DDT: Full fetch complete (2891 records). [2025-09-17T03:11:29.860873] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-17T03:11:30.228659] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-17T03:11:30.228802] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-17T03:11:30.228979] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-17T03:11:30.229058] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-17T03:11:30.229622] [DEBUG] [LOCAL ] DDT: Trimmed 2891 records to 2071 (keeping 200 days of data) [2025-09-17T03:11:30.242861] [DEBUG] [LOCAL ] DDT: Primary data saved (2071 records). [2025-09-17T03:11:30.242957] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-17T03:11:30.243084] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 18.8s. Estimated remaining: 4h 17m 5s. Rate: 6.9 symbols/min [2025-09-17T03:11:30.297935] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-17T03:11:30.423063] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:30.443656] [DEBUG] [LOCAL ] DEC: Loaded 21218 existing records from primary storage. [2025-09-17T03:11:30.443790] [INFO ] [MAIN ] DEC: Loaded 21218 existing records. [2025-09-17T03:11:30.620322] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:30.620589] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-17T03:11:30.620687] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-17T03:11:30.621348] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-17T03:11:30.621418] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-17T03:11:30.982138] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:31.090139] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-11. [2025-09-17T03:11:31.887200] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:11:31.896389] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-17T03:11:31.963614] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T03:11:32.690179] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-17T03:11:33.360839] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T03:11:33.490170] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-17T03:11:33.749124] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T03:11:34.290167] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-17T03:11:34.941009] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:11:35.090186] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-17T03:11:35.834331] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T03:11:35.890126] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-17T03:11:36.591118] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:11:36.690135] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-17T03:11:37.490140] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-17T03:11:37.576076] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:11:37.684671] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T03:11:38.290222] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-17T03:11:38.890101] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:11:38.895083] [INFO ] [REMOTE ] DEA: Full fetch complete (63176 records). [2025-09-17T03:11:38.895259] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-17T03:11:39.090311] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-17T03:11:39.316278] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-17T03:11:39.316397] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-17T03:11:39.317204] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-17T03:11:39.317265] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-17T03:11:39.318579] [DEBUG] [LOCAL ] DEA: Trimmed 63176 records to 41800 (keeping 200 days of data) [2025-09-17T03:11:39.580884] [DEBUG] [LOCAL ] DEA: Primary data saved (41800 records). [2025-09-17T03:11:39.581045] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-17T03:11:39.581142] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DEA took 28.2s. Estimated remaining: 4h 16m 58s. Rate: 6.9 symbols/min [2025-09-17T03:11:39.766013] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:39.801997] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:11:39.823415] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T03:11:39.859105] [DEBUG] [LOCAL ] DECK: Loaded 39727 existing records from primary storage. [2025-09-17T03:11:39.859307] [INFO ] [MAIN ] DECK: Loaded 39727 existing records. [2025-09-17T03:11:39.895238] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-17T03:11:40.043778] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:40.044034] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-17T03:11:40.044087] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-17T03:11:40.045160] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-17T03:11:40.045227] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-17T03:11:40.398036] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:40.690206] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-17T03:11:41.165985] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:11:41.315899] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T03:11:41.490169] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-17T03:11:42.290130] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-17T03:11:42.976289] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:11:43.090128] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-11. [2025-09-17T03:11:43.284173] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T03:11:43.890175] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-17T03:11:44.690112] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-17T03:11:44.900446] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T03:11:44.968548] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T03:11:45.490129] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-17T03:11:46.088355] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T03:11:46.090355] [INFO ] [REMOTE ] DDS: Full fetch complete (19372 records). [2025-09-17T03:11:46.090444] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-17T03:11:46.296599] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-17T03:11:46.463362] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-17T03:11:46.463477] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-17T03:11:46.464043] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-17T03:11:46.464109] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-17T03:11:46.464791] [DEBUG] [LOCAL ] DDS: Trimmed 19372 records to 13640 (keeping 200 days of data) [2025-09-17T03:11:46.551418] [DEBUG] [LOCAL ] DDS: Primary data saved (13640 records). [2025-09-17T03:11:46.551590] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-17T03:11:46.551709] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DDS took 35.2s. Estimated remaining: 4h 16m 44s. Rate: 6.9 symbols/min [2025-09-17T03:11:46.722098] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:46.722378] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-09-17T03:11:46.722437] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-09-17T03:11:46.722735] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-17T03:11:46.722989] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-17T03:11:46.723109] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-17T03:11:46.723189] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-17T03:11:47.108737] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:47.108819] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-17T03:11:47.136904] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T03:11:47.428576] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T03:11:47.890137] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-17T03:11:48.690233] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-11. [2025-09-17T03:11:49.030783] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T03:11:49.309664] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T03:11:49.490178] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-17T03:11:50.257980] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T03:11:50.290284] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-17T03:11:51.001288] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T03:11:51.090213] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-17T03:11:51.890139] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-17T03:11:51.924684] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:11:52.108903] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:11:52.690132] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-17T03:11:53.501361] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-17T03:11:53.507372] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:11:54.082047] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T03:11:54.290197] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-17T03:11:55.090150] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-17T03:11:55.179428] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:11:55.890168] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-17T03:11:56.146698] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T03:11:56.212527] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T03:11:56.690141] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-17T03:11:57.170904] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T03:11:57.490144] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-17T03:11:58.290143] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-17T03:11:58.783804] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T03:11:58.789979] [INFO ] [REMOTE ] DE: Full fetch complete (69528 records). [2025-09-17T03:11:58.790178] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-17T03:11:58.939515] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-17T03:11:59.095233] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-17T03:11:59.228604] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-17T03:11:59.228755] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-17T03:11:59.229687] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-17T03:11:59.229769] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-17T03:11:59.231361] [DEBUG] [LOCAL ] DE: Trimmed 69528 records to 47823 (keeping 200 days of data) [2025-09-17T03:11:59.533474] [DEBUG] [LOCAL ] DE: Primary data saved (47823 records). [2025-09-17T03:11:59.533677] [INFO ] [MAIN ] DE: Full history saved. [2025-09-17T03:11:59.533823] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 48.1s. Estimated remaining: 4h 16m 48s. Rate: 6.9 symbols/min [2025-09-17T03:11:59.704365] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:59.704626] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-09-17T03:11:59.704699] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-09-17T03:11:59.704814] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-17T03:11:59.704862] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-17T03:11:59.704910] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-17T03:11:59.704951] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-17T03:11:59.895626] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-17T03:12:00.068028] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:00.097152] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:12:00.690185] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-17T03:12:01.127998] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T03:12:01.490154] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-17T03:12:01.492685] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-17T03:12:02.290178] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-11. [2025-09-17T03:12:02.943689] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T03:12:02.983578] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T03:12:02.988519] [INFO ] [REMOTE ] DEC: Full fetch complete (42427 records). [2025-09-17T03:12:02.988799] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-17T03:12:03.095398] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-17T03:12:03.414964] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-17T03:12:03.415119] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-17T03:12:03.416064] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-17T03:12:03.416138] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-17T03:12:03.417748] [DEBUG] [LOCAL ] DEC: Trimmed 42427 records to 30937 (keeping 200 days of data) [2025-09-17T03:12:03.635207] [DEBUG] [LOCAL ] DEC: Primary data saved (30937 records). [2025-09-17T03:12:03.635492] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-17T03:12:03.635685] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEC took 33.4s. Estimated remaining: 4h 16m 26s. Rate: 6.9 symbols/min [2025-09-17T03:12:03.829783] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:03.875992] [DEBUG] [LOCAL ] DEO: Loaded 36147 existing records from primary storage. [2025-09-17T03:12:03.876256] [INFO ] [MAIN ] DEO: Loaded 36147 existing records. [2025-09-17T03:12:03.910348] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-17T03:12:04.070906] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:04.071295] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-17T03:12:04.071367] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-17T03:12:04.072384] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-17T03:12:04.072456] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-17T03:12:04.465311] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:04.690219] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-11. [2025-09-17T03:12:05.824976] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-17T03:12:05.835738] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-17T03:12:05.896727] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-11 (3.61 seconds). [2025-09-17T03:12:06.290215] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-17T03:12:06.610560] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T03:12:07.090129] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-17T03:12:07.200590] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-17T03:12:07.448910] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:12:07.890147] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-17T03:12:08.690217] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-17T03:12:08.867895] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-17T03:12:08.972592] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T03:12:09.163395] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T03:12:09.490143] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-17T03:12:10.290133] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-17T03:12:10.804146] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T03:12:11.090124] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-17T03:12:11.596842] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-17T03:12:11.765072] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T03:12:11.890117] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-17T03:12:12.690125] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-17T03:12:12.734678] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:12:13.490134] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-17T03:12:13.610170] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:12:14.290134] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-17T03:12:14.502972] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T03:12:15.090152] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-17T03:12:15.410249] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T03:12:15.417076] [INFO ] [REMOTE ] DEI: Full fetch complete (69246 records). [2025-09-17T03:12:15.417257] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-17T03:12:15.868381] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T03:12:15.903464] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-17T03:12:15.899197] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-17T03:12:15.904222] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-17T03:12:15.906107] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-17T03:12:15.906740] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-17T03:12:15.908411] [DEBUG] [LOCAL ] DEI: Trimmed 69246 records to 48518 (keeping 200 days of data) [2025-09-17T03:12:16.217494] [DEBUG] [LOCAL ] DEI: Primary data saved (48518 records). [2025-09-17T03:12:16.217816] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-17T03:12:16.218048] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DEI took 29.7s. Estimated remaining: 4h 16m 28s. Rate: 6.9 symbols/min [2025-09-17T03:12:16.394004] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:16.394249] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-09-17T03:12:16.394328] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-09-17T03:12:16.394480] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-17T03:12:16.394535] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-17T03:12:16.394593] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-09-17T03:12:16.394685] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-17T03:12:16.695343] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-17T03:12:16.761810] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:17.463532] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-17T03:12:17.490149] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-17T03:12:18.189773] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T03:12:18.290147] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-17T03:12:19.090190] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-11. [2025-09-17T03:12:19.250477] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-17T03:12:19.557916] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T03:12:19.890130] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-17T03:12:20.301327] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T03:12:20.507169] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:12:20.690183] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-17T03:12:21.490173] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-17T03:12:21.545082] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:12:22.156122] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:12:22.290108] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-17T03:12:23.090131] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-17T03:12:23.345759] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T03:12:23.352456] [INFO ] [REMOTE ] DECK: Full fetch complete (76393 records). [2025-09-17T03:12:23.352600] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-17T03:12:23.789105] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-17T03:12:23.789289] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-17T03:12:23.790305] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-17T03:12:23.790420] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-17T03:12:23.811979] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T03:12:23.819298] [DEBUG] [LOCAL ] DECK: Trimmed 76393 records to 53324 (keeping 200 days of data) [2025-09-17T03:12:23.913068] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-17T03:12:24.148227] [DEBUG] [LOCAL ] DECK: Primary data saved (53324 records). [2025-09-17T03:12:24.148394] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-17T03:12:24.148502] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 44.6s. Estimated remaining: 4h 16m 17s. Rate: 6.9 symbols/min [2025-09-17T03:12:24.321477] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:24.321681] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-09-17T03:12:24.321747] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-09-17T03:12:24.321901] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-17T03:12:24.321977] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-17T03:12:24.322045] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-09-17T03:12:24.322129] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-17T03:12:24.691409] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-17T03:12:24.696534] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:24.725381] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:12:25.490188] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-11. [2025-09-17T03:12:25.709847] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:12:26.230075] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:12:26.290118] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-17T03:12:26.360136] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T03:12:27.090126] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-17T03:12:27.292579] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T03:12:27.885210] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T03:12:27.890067] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-17T03:12:28.690136] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-17T03:12:28.957292] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T03:12:29.490131] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-17T03:12:30.239365] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T03:12:30.290075] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-17T03:12:30.479429] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:12:31.090216] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-17T03:12:31.454149] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:12:31.890190] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-17T03:12:32.081985] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:12:32.690216] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-17T03:12:33.490161] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-17T03:12:34.012562] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:12:34.290137] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-17T03:12:34.343603] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-17T03:12:34.999085] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T03:12:35.090177] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-17T03:12:35.302076] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:12:35.890177] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-17T03:12:36.372841] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:12:36.690156] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-17T03:12:36.942832] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:12:37.490205] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-17T03:12:37.726459] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T03:12:38.290198] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-17T03:12:39.090152] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-17T03:12:39.651992] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T03:12:39.768362] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:12:39.890138] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-17T03:12:40.118734] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:12:40.690199] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-17T03:12:40.998353] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T03:12:41.490222] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-17T03:12:42.290166] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-17T03:12:42.864904] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T03:12:42.982447] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T03:12:43.090199] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-17T03:12:43.143662] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T03:12:43.154246] [INFO ] [REMOTE ] DEO: Full fetch complete (71284 records). [2025-09-17T03:12:43.154508] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-17T03:12:43.561392] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-17T03:12:43.561501] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-17T03:12:43.562286] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-17T03:12:43.562345] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-17T03:12:43.563750] [DEBUG] [LOCAL ] DEO: Trimmed 71284 records to 48913 (keeping 200 days of data) [2025-09-17T03:12:43.876055] [DEBUG] [LOCAL ] DEO: Primary data saved (48913 records). [2025-09-17T03:12:43.876234] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-17T03:12:43.876349] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DEO took 40.2s. Estimated remaining: 4h 16m 40s. Rate: 6.9 symbols/min [2025-09-17T03:12:43.897032] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-17T03:12:44.059677] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T03:12:44.058883] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:44.062949] [INFO ] [REMOTE ] DFIN: Full fetch complete (33035 records). [2025-09-17T03:12:44.063043] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-17T03:12:44.173632] [DEBUG] [LOCAL ] DFP: Loaded 8662 existing records from primary storage. [2025-09-17T03:12:44.199545] [INFO ] [MAIN ] DFP: Loaded 8662 existing records. [2025-09-17T03:12:44.610042] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:44.657100] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-17T03:12:44.655152] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-17T03:12:44.657300] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-17T03:12:44.657332] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-17T03:12:44.658009] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-17T03:12:44.657966] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-17T03:12:44.658114] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-17T03:12:44.658181] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-17T03:12:44.695247] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-17T03:12:44.752018] [DEBUG] [LOCAL ] DFIN: Trimmed 33035 records to 23614 (keeping 200 days of data) [2025-09-17T03:12:45.137255] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:45.184816] [DEBUG] [LOCAL ] DFIN: Primary data saved (23614 records). [2025-09-17T03:12:45.185018] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-17T03:12:45.185130] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DFIN took 21.0s. Estimated remaining: 4h 16m 10s. Rate: 6.9 symbols/min [2025-09-17T03:12:45.361946] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:45.405394] [DEBUG] [LOCAL ] DG: Loaded 39688 existing records from primary storage. [2025-09-17T03:12:45.405634] [INFO ] [MAIN ] DG: Loaded 39688 existing records. [2025-09-17T03:12:45.499262] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-11. [2025-09-17T03:12:45.593490] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:45.593921] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-17T03:12:45.594240] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-17T03:12:45.602731] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-17T03:12:45.602857] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-17T03:12:45.670325] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:12:45.713440] [INFO ] [REMOTE ] DFH: Full fetch complete (49261 records). [2025-09-17T03:12:45.739386] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-17T03:12:46.135225] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:46.302267] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-11. [2025-09-17T03:12:46.382813] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-17T03:12:46.383480] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-17T03:12:46.383182] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T03:12:46.384200] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-17T03:12:46.384426] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-17T03:12:46.388932] [DEBUG] [LOCAL ] DFH: Trimmed 49261 records to 33205 (keeping 200 days of data) [2025-09-17T03:12:46.509523] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-17T03:12:46.630811] [DEBUG] [LOCAL ] DFH: Primary data saved (33205 records). [2025-09-17T03:12:46.630993] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-17T03:12:46.631085] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DFH took 30.4s. Estimated remaining: 4h 15m 40s. Rate: 6.9 symbols/min [2025-09-17T03:12:46.808145] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:46.808361] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-09-17T03:12:46.808414] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-09-17T03:12:46.808528] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-17T03:12:46.808580] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-17T03:12:46.808633] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-09-17T03:12:46.808693] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-17T03:12:47.099753] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-17T03:12:47.185228] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:47.890145] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-17T03:12:48.321867] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T03:12:48.697013] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-17T03:12:48.698778] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:12:48.959349] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T03:12:48.966116] [INFO ] [REMOTE ] DELL: Full fetch complete (77812 records). [2025-09-17T03:12:48.966249] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-17T03:12:49.362089] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-17T03:12:49.362197] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-17T03:12:49.363085] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-17T03:12:49.363147] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-17T03:12:49.364729] [DEBUG] [LOCAL ] DELL: Trimmed 77812 records to 53736 (keeping 200 days of data) [2025-09-17T03:12:49.490214] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-17T03:12:49.713248] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-09-17T03:12:49.713420] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-17T03:12:49.713509] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DELL took 50.2s. Estimated remaining: 4h 15m 15s. Rate: 6.9 symbols/min [2025-09-17T03:12:49.882608] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:49.898352] [DEBUG] [LOCAL ] DHF: Loaded 15920 existing records from primary storage. [2025-09-17T03:12:49.898512] [INFO ] [MAIN ] DHF: Loaded 15920 existing records. [2025-09-17T03:12:50.078732] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:50.078982] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-17T03:12:50.079042] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-17T03:12:50.079552] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-17T03:12:50.079613] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-17T03:12:50.272598] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T03:12:50.296772] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-11. [2025-09-17T03:12:50.460051] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:50.743797] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T03:12:51.090172] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-11. [2025-09-17T03:12:51.525297] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T03:12:51.890175] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-17T03:12:52.116694] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:12:52.672775] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T03:12:52.690100] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-17T03:12:53.293561] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:12:53.490191] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-17T03:12:54.290177] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-17T03:12:54.390012] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:12:54.974427] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:12:55.090131] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-17T03:12:55.890130] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-17T03:12:56.021135] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T03:12:56.690144] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-17T03:12:57.441006] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T03:12:57.490108] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-17T03:12:57.703790] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:12:58.290133] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-17T03:12:58.875470] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:12:59.090112] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-17T03:12:59.370181] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T03:12:59.890175] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-17T03:12:59.900442] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T03:13:00.690138] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-17T03:13:01.490148] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-17T03:13:01.503717] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:13:01.920841] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T03:13:02.290156] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-17T03:13:02.624198] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:13:03.090128] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-17T03:13:03.113629] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T03:13:03.890111] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-17T03:13:04.690220] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-17T03:13:04.874161] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T03:13:05.490183] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-17T03:13:05.552302] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:13:05.590943] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:13:06.290166] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-17T03:13:07.090129] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-17T03:13:07.553544] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T03:13:07.890180] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-17T03:13:08.057250] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:13:08.101548] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T03:13:08.462704] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T03:13:08.465303] [INFO ] [REMOTE ] DFP: Full fetch complete (16253 records). [2025-09-17T03:13:08.465434] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-17T03:13:08.695295] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-17T03:13:08.833709] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-17T03:13:08.833819] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-17T03:13:08.834179] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-17T03:13:08.834237] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-17T03:13:08.834907] [DEBUG] [LOCAL ] DFP: Trimmed 16253 records to 11859 (keeping 200 days of data) [2025-09-17T03:13:08.910763] [DEBUG] [LOCAL ] DFP: Primary data saved (11859 records). [2025-09-17T03:13:08.910944] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-17T03:13:08.911048] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFP took 25.0s. Estimated remaining: 4h 15m 37s. Rate: 6.9 symbols/min [2025-09-17T03:13:09.081579] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:09.125503] [DEBUG] [LOCAL ] DHI: Loaded 39803 existing records from primary storage. [2025-09-17T03:13:09.125735] [INFO ] [MAIN ] DHI: Loaded 39803 existing records. [2025-09-17T03:13:09.304631] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:13:09.304895] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-17T03:13:09.304976] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-17T03:13:09.305979] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-17T03:13:09.306039] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-17T03:13:09.498115] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-17T03:13:09.673881] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:10.290424] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-11. [2025-09-17T03:13:10.498957] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:13:11.090154] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-17T03:13:11.145065] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:13:11.730360] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:13:11.890165] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-17T03:13:12.690188] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-17T03:13:13.299760] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T03:13:13.369471] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T03:13:13.490100] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-17T03:13:14.290153] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-17T03:13:14.499885] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T03:13:14.892222] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T03:13:15.090098] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-17T03:13:15.890096] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-17T03:13:15.923721] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:13:16.690137] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-17T03:13:16.785802] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T03:13:17.495386] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-17T03:13:17.513977] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:13:18.223072] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T03:13:18.270058] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T03:13:18.290085] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-17T03:13:19.090194] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-17T03:13:19.714252] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T03:13:19.890195] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-17T03:13:20.609473] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:13:20.690129] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-17T03:13:21.490183] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-17T03:13:21.539074] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:13:21.611448] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T03:13:22.290181] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-17T03:13:22.802388] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T03:13:22.809083] [INFO ] [REMOTE ] DG: Full fetch complete (77122 records). [2025-09-17T03:13:22.809282] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-17T03:13:23.100039] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-17T03:13:23.211434] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-17T03:13:23.211622] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-17T03:13:23.212602] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-17T03:13:23.212704] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-17T03:13:23.214271] [DEBUG] [LOCAL ] DG: Trimmed 77122 records to 53312 (keeping 200 days of data) [2025-09-17T03:13:23.549976] [DEBUG] [LOCAL ] DG: Primary data saved (53312 records). [2025-09-17T03:13:23.550139] [INFO ] [MAIN ] DG: Full history saved. [2025-09-17T03:13:23.550232] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DG took 38.4s. Estimated remaining: 4h 15m 45s. Rate: 6.9 symbols/min [2025-09-17T03:13:23.724032] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:23.724257] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-17T03:13:23.724309] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-17T03:13:23.724426] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-17T03:13:23.724481] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-17T03:13:23.724534] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-17T03:13:23.724579] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-17T03:13:23.892273] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-17T03:13:24.040744] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:13:24.114938] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:24.115942] [INFO ] [REMOTE ] DGX: Full fetch complete (65130 records). [2025-09-17T03:13:24.116087] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-17T03:13:24.201255] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:13:24.521962] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-17T03:13:24.522074] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-17T03:13:24.522802] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-17T03:13:24.522869] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-17T03:13:24.524136] [DEBUG] [LOCAL ] DGX: Trimmed 65130 records to 45571 (keeping 200 days of data) [2025-09-17T03:13:24.704568] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-11. [2025-09-17T03:13:24.808383] [DEBUG] [LOCAL ] DGX: Primary data saved (45571 records). [2025-09-17T03:13:24.808526] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-17T03:13:24.808610] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DGX took 38.2s. Estimated remaining: 4h 15m 15s. Rate: 6.9 symbols/min [2025-09-17T03:13:24.980192] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:24.980348] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-09-17T03:13:24.980396] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-09-17T03:13:24.980529] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-17T03:13:24.980597] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-17T03:13:24.980688] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-17T03:13:24.980755] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-17T03:13:25.330333] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:25.490085] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-11. [2025-09-17T03:13:26.044582] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-17T03:13:26.151979] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T03:13:26.290114] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-17T03:13:26.868135] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T03:13:27.090165] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-17T03:13:27.890167] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-17T03:13:28.327717] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T03:13:28.675967] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:13:28.678617] [INFO ] [REMOTE ] DHF: Full fetch complete (29618 records). [2025-09-17T03:13:28.678741] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-17T03:13:28.699779] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-17T03:13:29.065018] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-17T03:13:29.065156] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-17T03:13:29.065945] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-17T03:13:29.066120] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-17T03:13:29.077848] [DEBUG] [LOCAL ] DHF: Trimmed 29618 records to 21188 (keeping 200 days of data) [2025-09-17T03:13:29.098602] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T03:13:29.238223] [DEBUG] [LOCAL ] DHF: Primary data saved (21188 records). [2025-09-17T03:13:29.238381] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-17T03:13:29.238472] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DHF took 39.5s. Estimated remaining: 4h 14m 54s. Rate: 6.9 symbols/min [2025-09-17T03:13:29.405881] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:29.406089] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-09-17T03:13:29.406137] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-09-17T03:13:29.406243] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-17T03:13:29.406292] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-17T03:13:29.406338] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-17T03:13:29.406377] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-17T03:13:29.497201] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-17T03:13:29.771371] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:30.290148] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-17T03:13:30.627046] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T03:13:31.090157] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-17T03:13:31.404886] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T03:13:31.890122] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-11. [2025-09-17T03:13:32.014152] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:13:32.485354] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T03:13:32.690107] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-17T03:13:32.747412] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:13:33.490174] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-17T03:13:34.079562] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T03:13:34.290129] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-17T03:13:34.490405] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T03:13:35.090303] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-17T03:13:35.777615] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T03:13:35.890334] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-17T03:13:36.681269] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:13:36.690579] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-17T03:13:37.490166] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-17T03:13:37.553280] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:13:38.278949] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T03:13:38.290185] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-17T03:13:38.875250] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T03:13:39.090193] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-17T03:13:39.890090] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-17T03:13:40.463013] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-17T03:13:40.626678] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T03:13:40.690158] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-17T03:13:40.843298] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T03:13:41.490148] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-17T03:13:42.290132] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-17T03:13:42.712690] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T03:13:42.719478] [INFO ] [REMOTE ] DHI: Full fetch complete (77041 records). [2025-09-17T03:13:42.719668] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-17T03:13:43.097284] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-17T03:13:43.150031] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-17T03:13:43.150156] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-17T03:13:43.151081] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-17T03:13:43.151144] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-17T03:13:43.152793] [DEBUG] [LOCAL ] DHI: Trimmed 77041 records to 53376 (keeping 200 days of data) [2025-09-17T03:13:43.530600] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T03:13:43.568595] [DEBUG] [LOCAL ] DHI: Primary data saved (53376 records). [2025-09-17T03:13:43.568809] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-17T03:13:43.570414] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 34.7s. Estimated remaining: 4h 15m 1s. Rate: 6.9 symbols/min [2025-09-17T03:13:43.780539] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:43.780772] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-09-17T03:13:43.780828] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-09-17T03:13:43.780940] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-17T03:13:43.780997] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-17T03:13:43.781050] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-17T03:13:43.781165] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-17T03:13:43.895309] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-17T03:13:44.152703] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:44.183195] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T03:13:44.310262] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T03:13:44.690129] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-17T03:13:45.490134] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-11. [2025-09-17T03:13:45.957030] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T03:13:46.011462] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T03:13:46.043282] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T03:13:46.290136] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-17T03:13:47.090132] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-17T03:13:47.700406] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T03:13:47.890146] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-17T03:13:48.181405] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T03:13:48.454381] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T03:13:48.690160] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-17T03:13:49.478548] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T03:13:49.490070] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-17T03:13:49.951489] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:13:50.290190] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-17T03:13:51.090206] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-17T03:13:51.622108] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:13:51.890213] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-17T03:13:52.669076] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:13:52.690092] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-17T03:13:52.941389] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T03:13:53.490139] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-17T03:13:54.290180] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-17T03:13:54.464014] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:13:54.514711] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:13:55.090101] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-17T03:13:55.091698] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T03:13:55.890207] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-17T03:13:56.275492] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:13:56.281746] [INFO ] [REMOTE ] DHT: Full fetch complete (70042 records). [2025-09-17T03:13:56.281906] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-17T03:13:56.672680] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-17T03:13:56.672791] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-17T03:13:56.673569] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-17T03:13:56.673624] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-17T03:13:56.675164] [DEBUG] [LOCAL ] DHT: Trimmed 70042 records to 48005 (keeping 200 days of data) [2025-09-17T03:13:56.730846] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-17T03:13:56.790350] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T03:13:56.988054] [DEBUG] [LOCAL ] DHT: Primary data saved (48005 records). [2025-09-17T03:13:56.988237] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-17T03:13:56.988334] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHT took 32.2s. Estimated remaining: 4h 15m 6s. Rate: 6.9 symbols/min [2025-09-17T03:13:57.158953] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:57.159146] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-09-17T03:13:57.159202] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-09-17T03:13:57.159306] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-17T03:13:57.159359] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-17T03:13:57.159415] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-09-17T03:13:57.159459] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-17T03:13:57.511258] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-17T03:13:57.516108] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:57.811366] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T03:13:58.290171] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-17T03:13:58.908384] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T03:13:59.030540] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:13:59.090174] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-17T03:13:59.890138] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-17T03:14:00.517566] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:14:00.524331] [INFO ] [REMOTE ] DHR: Full fetch complete (77113 records). [2025-09-17T03:14:00.524554] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-17T03:14:00.692351] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-11. [2025-09-17T03:14:00.900078] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T03:14:00.948633] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-17T03:14:00.949093] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-17T03:14:00.950019] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-17T03:14:00.950081] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-17T03:14:00.951523] [DEBUG] [LOCAL ] DHR: Trimmed 77113 records to 53370 (keeping 200 days of data) [2025-09-17T03:14:01.294590] [DEBUG] [LOCAL ] DHR: Primary data saved (53370 records). [2025-09-17T03:14:01.294828] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-17T03:14:01.294930] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHR took 37.7s. Estimated remaining: 4h 14m 44s. Rate: 6.9 symbols/min [2025-09-17T03:14:01.469628] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:01.493157] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-17T03:14:01.514449] [DEBUG] [LOCAL ] DINO: Loaded 39480 existing records from primary storage. [2025-09-17T03:14:01.514876] [INFO ] [MAIN ] DINO: Loaded 39480 existing records. [2025-09-17T03:14:01.694263] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:01.694552] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-17T03:14:01.694676] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-17T03:14:01.695891] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-17T03:14:01.695962] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-17T03:14:02.061290] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:02.151057] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T03:14:02.240767] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:14:02.290098] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-17T03:14:03.090147] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-17T03:14:03.744245] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T03:14:03.890128] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-11. [2025-09-17T03:14:03.984036] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T03:14:04.690144] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-17T03:14:05.490146] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-17T03:14:05.612951] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T03:14:06.247675] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T03:14:06.275776] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T03:14:06.290106] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-17T03:14:07.090135] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-17T03:14:07.161678] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:14:07.164505] [INFO ] [REMOTE ] DHX: Full fetch complete (20976 records). [2025-09-17T03:14:07.164637] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-17T03:14:07.534293] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-17T03:14:07.534413] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-17T03:14:07.534876] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-17T03:14:07.534981] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-17T03:14:07.535704] [DEBUG] [LOCAL ] DHX: Trimmed 20976 records to 13256 (keeping 200 days of data) [2025-09-17T03:14:07.608681] [DEBUG] [LOCAL ] DHX: Primary data saved (13256 records). [2025-09-17T03:14:07.608840] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-17T03:14:07.608927] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHX took 38.4s. Estimated remaining: 4h 14m 29s. Rate: 6.9 symbols/min [2025-09-17T03:14:07.777220] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:07.817991] [DEBUG] [LOCAL ] DIS: Loaded 40138 existing records from primary storage. [2025-09-17T03:14:07.818156] [INFO ] [MAIN ] DIS: Loaded 40138 existing records. [2025-09-17T03:14:07.895814] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-17T03:14:08.005864] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:08.006196] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-17T03:14:08.006269] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-17T03:14:08.007749] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-17T03:14:08.007830] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-17T03:14:08.373545] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:08.569945] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T03:14:08.690199] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-17T03:14:09.490160] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-17T03:14:09.847430] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T03:14:10.116905] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:14:10.290131] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-11. [2025-09-17T03:14:10.300918] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:14:11.090138] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-17T03:14:11.807327] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T03:14:11.810100] [INFO ] [REMOTE ] DIAX: Full fetch complete (16897 records). [2025-09-17T03:14:11.810255] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-17T03:14:11.895348] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-17T03:14:12.180638] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-17T03:14:12.180755] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-17T03:14:12.181143] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-17T03:14:12.181201] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-17T03:14:12.181780] [DEBUG] [LOCAL ] DIAX: Trimmed 16897 records to 12242 (keeping 200 days of data) [2025-09-17T03:14:12.259338] [DEBUG] [LOCAL ] DIAX: Primary data saved (12242 records). [2025-09-17T03:14:12.259532] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-17T03:14:12.259673] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DIAX took 28.7s. Estimated remaining: 4h 14m 9s. Rate: 6.9 symbols/min [2025-09-17T03:14:12.427314] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:12.427488] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-17T03:14:12.427552] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-17T03:14:12.427685] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-17T03:14:12.427735] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-17T03:14:12.427784] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-17T03:14:12.427821] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-17T03:14:12.697156] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-17T03:14:12.787839] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:12.883057] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-11 (2.59 seconds). [2025-09-17T03:14:13.490135] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-17T03:14:13.636776] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T03:14:14.295310] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-17T03:14:14.311359] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T03:14:15.090137] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-11. [2025-09-17T03:14:15.461825] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T03:14:15.890117] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-17T03:14:15.952166] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-17T03:14:16.004855] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:14:16.179191] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-17T03:14:16.690200] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-17T03:14:16.975803] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T03:14:17.490147] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-17T03:14:18.290143] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-17T03:14:19.090143] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-17T03:14:19.265200] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:14:19.465914] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T03:14:19.890190] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-17T03:14:20.610330] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-17T03:14:20.690128] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-17T03:14:21.346289] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T03:14:21.490130] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-17T03:14:22.290135] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-17T03:14:22.635448] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T03:14:22.749034] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:14:22.969161] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:14:23.090119] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-17T03:14:23.890130] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-17T03:14:24.268036] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:14:24.690133] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-17T03:14:25.490116] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-17T03:14:25.797200] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T03:14:25.927424] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T03:14:26.290129] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-17T03:14:27.050239] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-17T03:14:27.090079] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-17T03:14:27.890216] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-17T03:14:28.232665] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T03:14:28.690122] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-17T03:14:29.070862] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T03:14:29.207736] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T03:14:29.395751] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T03:14:29.490128] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-17T03:14:30.290135] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-17T03:14:30.636796] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:14:30.893295] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:14:30.899864] [INFO ] [REMOTE ] DIN: Full fetch complete (54745 records). [2025-09-17T03:14:30.900053] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-17T03:14:31.095290] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-17T03:14:31.282456] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-17T03:14:31.282554] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-17T03:14:31.283208] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-17T03:14:31.283265] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-17T03:14:31.284377] [DEBUG] [LOCAL ] DIN: Trimmed 54745 records to 37412 (keeping 200 days of data) [2025-09-17T03:14:31.510160] [DEBUG] [LOCAL ] DIN: Primary data saved (37412 records). [2025-09-17T03:14:31.510364] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-17T03:14:31.510511] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIN took 34.5s. Estimated remaining: 4h 14m 30s. Rate: 6.9 symbols/min [2025-09-17T03:14:31.685523] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:31.729064] [DEBUG] [LOCAL ] DK: Loaded 36998 existing records from primary storage. [2025-09-17T03:14:31.729263] [INFO ] [MAIN ] DK: Loaded 36998 existing records. [2025-09-17T03:14:31.890786] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-17T03:14:31.913821] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:31.914019] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-17T03:14:31.914094] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-17T03:14:31.915102] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-17T03:14:31.915180] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-17T03:14:32.274380] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:32.343229] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T03:14:32.690126] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-17T03:14:33.490154] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-17T03:14:33.661378] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-17T03:14:33.852478] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T03:14:34.121729] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:14:34.290189] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-17T03:14:34.656990] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:14:34.657789] [INFO ] [REMOTE ] DIVY: Full fetch complete (1724 records). [2025-09-17T03:14:34.657873] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-17T03:14:34.833014] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T03:14:34.833224] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:14:34.833276] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:14:34.833316] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-17T03:14:34.833383] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-17T03:14:34.833429] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-17T03:14:34.833489] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-17T03:14:34.833562] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIVY took 22.6s. Estimated remaining: 4h 14m 6s. Rate: 6.9 symbols/min [2025-09-17T03:14:35.001682] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:35.015938] [DEBUG] [LOCAL ] DKL: Loaded 12673 existing records from primary storage. [2025-09-17T03:14:35.016087] [INFO ] [MAIN ] DKL: Loaded 12673 existing records. [2025-09-17T03:14:35.095264] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-17T03:14:35.201695] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:35.201970] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-17T03:14:35.202030] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-17T03:14:35.202437] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-17T03:14:35.202520] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-17T03:14:35.557121] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:35.890179] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-17T03:14:36.690150] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-11. [2025-09-17T03:14:37.437569] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T03:14:37.490100] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-17T03:14:37.777553] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T03:14:37.929045] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T03:14:38.290133] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-17T03:14:39.090137] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-11. [2025-09-17T03:14:39.674178] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T03:14:39.890099] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-17T03:14:40.065062] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T03:14:40.244103] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T03:14:40.690189] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-17T03:14:41.490161] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-17T03:14:42.248303] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:14:42.255411] [INFO ] [REMOTE ] DINO: Full fetch complete (76461 records). [2025-09-17T03:14:42.255738] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-17T03:14:42.299579] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-17T03:14:42.547632] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-17T03:14:42.720737] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-17T03:14:42.720879] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-17T03:14:42.721830] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-17T03:14:42.721925] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-17T03:14:42.723491] [DEBUG] [LOCAL ] DINO: Trimmed 76461 records to 52976 (keeping 200 days of data) [2025-09-17T03:14:43.055211] [DEBUG] [LOCAL ] DINO: Primary data saved (52976 records). [2025-09-17T03:14:43.055437] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-17T03:14:43.055559] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 41.8s. Estimated remaining: 4h 13m 55s. Rate: 6.9 symbols/min [2025-09-17T03:14:43.100146] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-17T03:14:43.260484] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:43.265582] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:14:43.312312] [DEBUG] [LOCAL ] DKS: Loaded 37152 existing records from primary storage. [2025-09-17T03:14:43.312519] [INFO ] [MAIN ] DKS: Loaded 37152 existing records. [2025-09-17T03:14:43.492319] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:43.492829] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-17T03:14:43.506352] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-17T03:14:43.506864] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T03:14:43.511934] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-17T03:14:43.512694] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-17T03:14:43.900303] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-17T03:14:43.905144] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:44.690136] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-11. [2025-09-17T03:14:45.161273] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T03:14:45.167913] [INFO ] [REMOTE ] DIS: Full fetch complete (77937 records). [2025-09-17T03:14:45.168075] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-17T03:14:45.492632] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-17T03:14:45.598007] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-17T03:14:45.598210] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-17T03:14:45.599416] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-17T03:14:45.599597] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-17T03:14:45.612744] [DEBUG] [LOCAL ] DIS: Trimmed 77937 records to 53788 (keeping 200 days of data) [2025-09-17T03:14:45.629845] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:14:45.998720] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-17T03:14:45.998987] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-17T03:14:45.999142] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 38.4s. Estimated remaining: 4h 13m 31s. Rate: 6.9 symbols/min [2025-09-17T03:14:46.178718] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:46.206154] [DEBUG] [LOCAL ] DLB: Loaded 23929 existing records from primary storage. [2025-09-17T03:14:46.206376] [INFO ] [MAIN ] DLB: Loaded 23929 existing records. [2025-09-17T03:14:46.295373] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-17T03:14:46.430443] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:46.430822] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-17T03:14:46.430889] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-17T03:14:46.431756] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-17T03:14:46.431827] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-17T03:14:46.839200] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:46.857216] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T03:14:46.910785] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T03:14:47.090182] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-11. [2025-09-17T03:14:47.904853] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-17T03:14:47.936027] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:14:48.509744] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:14:48.690199] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-17T03:14:49.051427] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:14:49.490154] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-17T03:14:50.074676] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:14:50.290145] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-17T03:14:50.480507] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:14:51.090242] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-17T03:14:51.873886] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:14:51.890089] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-17T03:14:52.526833] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:14:52.690180] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-17T03:14:53.490206] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-17T03:14:53.544126] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:14:53.653941] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T03:14:54.290228] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-17T03:14:55.090191] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-17T03:14:55.342174] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:14:55.410746] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T03:14:55.890146] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-17T03:14:56.690140] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-17T03:14:56.860766] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T03:14:57.490142] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-17T03:14:57.543948] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T03:14:57.608566] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T03:14:58.290223] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-17T03:14:58.606632] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:14:59.090149] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-17T03:14:59.890098] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-17T03:14:59.959245] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:15:00.011261] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:15:00.690179] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-17T03:15:01.490163] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-17T03:15:01.644135] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T03:15:01.849224] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T03:15:02.290180] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-17T03:15:03.090164] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-17T03:15:03.890197] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-17T03:15:04.781808] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-17T03:15:04.788239] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-17T03:15:05.383450] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T03:15:05.490169] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-17T03:15:05.651701] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T03:15:05.654696] [INFO ] [REMOTE ] DKL: Full fetch complete (29861 records). [2025-09-17T03:15:05.654925] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-17T03:15:05.843433] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T03:15:06.133171] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-17T03:15:06.133630] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-17T03:15:06.135019] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-17T03:15:06.135260] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-17T03:15:06.137165] [DEBUG] [LOCAL ] DKL: Trimmed 29861 records to 19633 (keeping 200 days of data) [2025-09-17T03:15:06.282578] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (4.79 seconds). [2025-09-17T03:15:06.296183] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-17T03:15:06.331067] [DEBUG] [LOCAL ] DKL: Primary data saved (19633 records). [2025-09-17T03:15:06.331276] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-17T03:15:06.331414] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DKL took 31.5s. Estimated remaining: 4h 13m 54s. Rate: 6.9 symbols/min [2025-09-17T03:15:06.520774] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:06.527269] [DEBUG] [LOCAL ] DLNG: Loaded 4310 existing records from primary storage. [2025-09-17T03:15:06.527419] [INFO ] [MAIN ] DLNG: Loaded 4310 existing records. [2025-09-17T03:15:06.717159] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:06.717428] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-17T03:15:06.717516] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-17T03:15:06.717808] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-17T03:15:06.717894] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-17T03:15:07.091260] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-17T03:15:07.095019] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:07.124318] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:15:07.890131] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-17T03:15:08.035489] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T03:15:08.690220] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-11. [2025-09-17T03:15:08.943352] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T03:15:09.168347] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:15:09.183206] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T03:15:09.490146] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-17T03:15:10.290139] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-17T03:15:10.906311] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T03:15:11.090071] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-17T03:15:11.890120] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-17T03:15:12.036075] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T03:15:12.529318] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:15:12.690176] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-17T03:15:13.490144] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-17T03:15:13.520045] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:15:13.529099] [INFO ] [REMOTE ] DK: Full fetch complete (70360 records). [2025-09-17T03:15:13.529314] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-17T03:15:13.936448] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-17T03:15:13.936661] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-17T03:15:13.938019] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-17T03:15:13.938119] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-17T03:15:13.942526] [DEBUG] [LOCAL ] DK: Trimmed 70360 records to 49528 (keeping 200 days of data) [2025-09-17T03:15:14.293018] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-17T03:15:14.297057] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:15:14.315349] [DEBUG] [LOCAL ] DK: Primary data saved (49528 records). [2025-09-17T03:15:14.315615] [INFO ] [MAIN ] DK: Full history saved. [2025-09-17T03:15:14.315833] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DK took 42.8s. Estimated remaining: 4h 13m 43s. Rate: 6.9 symbols/min [2025-09-17T03:15:14.501013] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:14.534694] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:15:14.583520] [DEBUG] [LOCAL ] DLR: Loaded 37822 existing records from primary storage. [2025-09-17T03:15:14.583803] [INFO ] [MAIN ] DLR: Loaded 37822 existing records. [2025-09-17T03:15:14.783037] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:14.783509] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-17T03:15:14.783624] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-17T03:15:14.784880] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-17T03:15:14.784958] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-17T03:15:15.095358] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-17T03:15:15.163130] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:15.890153] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-11. [2025-09-17T03:15:15.967576] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T03:15:15.973331] [INFO ] [REMOTE ] DLB: Full fetch complete (46967 records). [2025-09-17T03:15:15.973478] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-17T03:15:16.367381] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-17T03:15:16.367527] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-17T03:15:16.368226] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-17T03:15:16.368294] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-17T03:15:16.369591] [DEBUG] [LOCAL ] DLB: Trimmed 46967 records to 32255 (keeping 200 days of data) [2025-09-17T03:15:16.578372] [DEBUG] [LOCAL ] DLB: Primary data saved (32255 records). [2025-09-17T03:15:16.578550] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-17T03:15:16.578681] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DLB took 30.6s. Estimated remaining: 4h 13m 17s. Rate: 6.9 symbols/min [2025-09-17T03:15:16.695208] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-17T03:15:16.752008] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:16.774222] [DEBUG] [LOCAL ] DLX: Loaded 21590 existing records from primary storage. [2025-09-17T03:15:16.774381] [INFO ] [MAIN ] DLX: Loaded 21590 existing records. [2025-09-17T03:15:16.972261] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:16.972504] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-17T03:15:16.972563] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-17T03:15:16.973185] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-17T03:15:16.973255] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-17T03:15:17.326460] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:17.490123] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-11. [2025-09-17T03:15:17.848915] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-17T03:15:18.097626] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:15:18.290140] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-17T03:15:18.308265] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:15:18.405478] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-17T03:15:19.090133] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-17T03:15:19.115943] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T03:15:19.890134] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-17T03:15:20.618937] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:15:20.690139] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-17T03:15:20.940660] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:15:21.490153] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-17T03:15:21.831533] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:15:22.033189] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T03:15:22.290136] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-17T03:15:23.047921] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T03:15:23.090089] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-17T03:15:23.776635] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T03:15:23.890133] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-17T03:15:24.690103] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-17T03:15:25.091537] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:15:25.318860] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T03:15:25.490138] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-17T03:15:26.290174] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-17T03:15:27.090176] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-17T03:15:27.218092] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:15:27.890197] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-17T03:15:28.690128] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-17T03:15:28.821372] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T03:15:28.895964] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-17T03:15:29.357545] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T03:15:29.490160] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-17T03:15:29.746988] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T03:15:30.290178] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-17T03:15:30.781047] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T03:15:31.090148] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-17T03:15:31.691398] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T03:15:31.692670] [INFO ] [REMOTE ] DLNG: Full fetch complete (12175 records). [2025-09-17T03:15:31.692766] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-17T03:15:31.896629] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-17T03:15:32.083707] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-17T03:15:32.083913] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-17T03:15:32.084223] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-17T03:15:32.084307] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-17T03:15:32.085101] [DEBUG] [LOCAL ] DLNG: Trimmed 12175 records to 6341 (keeping 200 days of data) [2025-09-17T03:15:32.130092] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T03:15:32.142809] [INFO ] [REMOTE ] DKS: Full fetch complete (71570 records). [2025-09-17T03:15:32.143781] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-17T03:15:32.147194] [DEBUG] [LOCAL ] DLNG: Primary data saved (6341 records). [2025-09-17T03:15:32.147346] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-17T03:15:32.147663] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 25.8s. Estimated remaining: 4h 13m 27s. Rate: 6.9 symbols/min [2025-09-17T03:15:32.500439] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:32.696740] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-17T03:15:32.722208] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-17T03:15:32.727834] [DEBUG] [LOCAL ] DLY: Loaded 13860 existing records from primary storage. [2025-09-17T03:15:32.727892] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-17T03:15:32.728009] [INFO ] [MAIN ] DLY: Loaded 13860 existing records. [2025-09-17T03:15:32.729398] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-17T03:15:32.742692] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-17T03:15:32.830879] [DEBUG] [LOCAL ] DKS: Trimmed 71570 records to 50024 (keeping 200 days of data) [2025-09-17T03:15:32.976387] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:33.002777] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-17T03:15:33.003215] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-17T03:15:33.005926] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-17T03:15:33.006777] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-17T03:15:33.381705] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:33.491380] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-11. [2025-09-17T03:15:33.595915] [DEBUG] [LOCAL ] DKS: Primary data saved (50024 records). [2025-09-17T03:15:33.596103] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-17T03:15:33.596215] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DKS took 50.5s. Estimated remaining: 4h 12m 58s. Rate: 6.9 symbols/min [2025-09-17T03:15:33.766514] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:33.771922] [DEBUG] [LOCAL ] DMA: Loaded 3636 existing records from primary storage. [2025-09-17T03:15:33.772047] [INFO ] [MAIN ] DMA: Loaded 3636 existing records. [2025-09-17T03:15:33.955375] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:33.955810] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-17T03:15:33.955903] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-17T03:15:33.956219] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-17T03:15:33.956295] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-17T03:15:34.271894] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-17T03:15:34.359896] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-17T03:15:34.364329] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:34.384155] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:15:34.578842] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:15:35.090212] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-11. [2025-09-17T03:15:35.550622] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T03:15:35.890184] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-17T03:15:36.124854] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:15:36.690185] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-17T03:15:36.850865] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T03:15:37.281168] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T03:15:37.490133] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-17T03:15:38.290101] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-17T03:15:38.639715] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:15:39.090153] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-17T03:15:39.649822] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:15:39.712561] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T03:15:39.890207] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-17T03:15:40.690138] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-17T03:15:41.490161] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-17T03:15:41.710432] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:15:41.814630] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T03:15:42.083895] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:15:42.290189] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-17T03:15:43.090179] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-17T03:15:43.506924] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T03:15:43.890208] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-17T03:15:44.079374] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T03:15:44.474982] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T03:15:44.690180] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-17T03:15:45.490157] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-17T03:15:45.757245] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T03:15:46.290144] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-17T03:15:47.090150] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-17T03:15:47.282117] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:15:47.597737] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T03:15:47.890111] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-17T03:15:48.167624] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T03:15:48.403504] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T03:15:48.690341] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-17T03:15:49.401678] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T03:15:49.490114] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-17T03:15:50.290200] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-17T03:15:50.501539] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T03:15:51.090152] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-17T03:15:51.890133] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-17T03:15:52.106954] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T03:15:52.153938] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:15:52.359273] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:15:52.690229] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-17T03:15:53.283811] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:15:53.490157] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-17T03:15:54.290157] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-17T03:15:54.641840] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:15:54.645415] [INFO ] [REMOTE ] DLX: Full fetch complete (41016 records). [2025-09-17T03:15:54.645548] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-17T03:15:55.028378] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-17T03:15:55.028505] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-17T03:15:55.029292] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-17T03:15:55.029382] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-17T03:15:55.030571] [DEBUG] [LOCAL ] DLX: Trimmed 41016 records to 29367 (keeping 200 days of data) [2025-09-17T03:15:55.093525] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-17T03:15:55.217597] [DEBUG] [LOCAL ] DLX: Primary data saved (29367 records). [2025-09-17T03:15:55.217836] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-17T03:15:55.217975] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLX took 38.6s. Estimated remaining: 4h 13m 25s. Rate: 6.9 symbols/min [2025-09-17T03:15:55.398026] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:55.407626] [DEBUG] [LOCAL ] DMB: Loaded 7953 existing records from primary storage. [2025-09-17T03:15:55.407786] [INFO ] [MAIN ] DMB: Loaded 7953 existing records. [2025-09-17T03:15:55.586222] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:55.586460] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-17T03:15:55.586520] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-17T03:15:55.586943] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-17T03:15:55.587014] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-17T03:15:55.891121] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-17T03:15:55.892309] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T03:15:55.979416] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:56.605168] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T03:15:56.690145] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-17T03:15:56.945205] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T03:15:57.490146] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-17T03:15:57.617614] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T03:15:57.901704] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T03:15:57.903048] [INFO ] [REMOTE ] DMA: Full fetch complete (6433 records). [2025-09-17T03:15:57.903135] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-17T03:15:58.260089] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-17T03:15:58.260186] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-17T03:15:58.260360] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-17T03:15:58.260405] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-17T03:15:58.260811] [DEBUG] [LOCAL ] DMA: Trimmed 6433 records to 4541 (keeping 200 days of data) [2025-09-17T03:15:58.287431] [DEBUG] [LOCAL ] DMA: Primary data saved (4541 records). [2025-09-17T03:15:58.287510] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-17T03:15:58.287595] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DMA took 24.7s. Estimated remaining: 4h 13m 1s. Rate: 6.9 symbols/min [2025-09-17T03:15:58.297850] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-17T03:15:58.457864] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:58.466580] [DEBUG] [LOCAL ] DMO: Loaded 6948 existing records from primary storage. [2025-09-17T03:15:58.466722] [INFO ] [MAIN ] DMO: Loaded 6948 existing records. [2025-09-17T03:15:58.673289] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:58.673794] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-17T03:15:58.673850] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-17T03:15:58.674263] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-17T03:15:58.674327] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-17T03:15:59.041282] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:59.090118] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-11. [2025-09-17T03:15:59.195554] [DEBUG] [REMOTE ] DMO: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T03:15:59.195967] [WARN ] [REMOTE ] DMO: No data returned for month 2024-11 [2025-09-17T03:15:59.890158] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-17T03:16:00.119558] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T03:16:00.126131] [INFO ] [REMOTE ] DLR: Full fetch complete (74123 records). [2025-09-17T03:16:00.126299] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-17T03:16:00.511229] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-17T03:16:00.511338] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-17T03:16:00.512251] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-17T03:16:00.512314] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-17T03:16:00.513845] [DEBUG] [LOCAL ] DLR: Trimmed 74123 records to 51267 (keeping 200 days of data) [2025-09-17T03:16:00.707790] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-17T03:16:00.845117] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:16:00.851315] [INFO ] [REMOTE ] DLY: Full fetch complete (27800 records). [2025-09-17T03:16:00.852811] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-17T03:16:00.964417] [DEBUG] [LOCAL ] DLR: Primary data saved (51267 records). [2025-09-17T03:16:00.964590] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-17T03:16:00.964705] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DLR took 46.6s. Estimated remaining: 4h 12m 35s. Rate: 6.9 symbols/min [2025-09-17T03:16:01.297903] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:01.418260] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-17T03:16:01.418406] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-17T03:16:01.419040] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-17T03:16:01.419116] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-17T03:16:01.420272] [DEBUG] [LOCAL ] DLY: Trimmed 27800 records to 19079 (keeping 200 days of data) [2025-09-17T03:16:01.525787] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-11. [2025-09-17T03:16:01.550870] [DEBUG] [LOCAL ] DNA: Loaded 35867 existing records from primary storage. [2025-09-17T03:16:01.552343] [INFO ] [MAIN ] DNA: Loaded 35867 existing records. [2025-09-17T03:16:01.744174] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:16:01.796665] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:01.796513] [DEBUG] [LOCAL ] DLY: Primary data saved (19079 records). [2025-09-17T03:16:01.797029] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-17T03:16:01.797291] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-17T03:16:01.797674] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-17T03:16:01.797958] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLY took 29.7s. Estimated remaining: 4h 12m 5s. Rate: 6.9 symbols/min [2025-09-17T03:16:01.803763] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-17T03:16:01.849076] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-17T03:16:02.187584] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:02.290675] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-17T03:16:02.401930] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:02.409314] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T03:16:02.425711] [DEBUG] [LOCAL ] DNOW: Loaded 31921 existing records from primary storage. [2025-09-17T03:16:02.425907] [INFO ] [MAIN ] DNOW: Loaded 31921 existing records. [2025-09-17T03:16:02.605273] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:02.605558] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-17T03:16:02.605620] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-17T03:16:02.606426] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-17T03:16:02.606489] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-17T03:16:02.973197] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:03.090135] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-17T03:16:03.245758] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T03:16:03.734591] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T03:16:03.890127] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-17T03:16:04.690131] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-11. [2025-09-17T03:16:04.761096] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T03:16:05.490131] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-11. [2025-09-17T03:16:06.290147] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-17T03:16:06.323377] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:16:06.930143] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:16:07.063787] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:16:07.090086] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-17T03:16:07.811924] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T03:16:07.890134] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-17T03:16:08.645594] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T03:16:08.690164] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-17T03:16:09.490158] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-17T03:16:09.536027] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T03:16:10.286178] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T03:16:10.290075] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-17T03:16:11.090136] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-17T03:16:11.184878] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T03:16:11.890127] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-17T03:16:12.690137] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-17T03:16:12.854472] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T03:16:13.423058] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:16:13.468566] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T03:16:13.490090] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-17T03:16:14.290179] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-17T03:16:14.364982] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T03:16:15.090142] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-17T03:16:15.828827] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T03:16:15.890134] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-17T03:16:16.690152] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-17T03:16:16.848372] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T03:16:17.017348] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T03:16:17.490163] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-17T03:16:17.592408] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T03:16:18.290153] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-17T03:16:19.090121] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-17T03:16:19.513464] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T03:16:19.890760] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-17T03:16:19.923208] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T03:16:19.922722] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:16:20.690123] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-17T03:16:21.490137] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-17T03:16:21.532540] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:16:21.828165] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T03:16:22.290130] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-17T03:16:23.078408] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:16:23.090076] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-17T03:16:23.135499] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T03:16:23.890158] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-17T03:16:24.594849] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T03:16:24.653155] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T03:16:24.690137] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-17T03:16:25.490135] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-17T03:16:25.563469] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:16:26.290155] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-17T03:16:26.322788] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T03:16:26.324990] [INFO ] [REMOTE ] DMB: Full fetch complete (14879 records). [2025-09-17T03:16:26.325082] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-17T03:16:26.687363] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-17T03:16:26.687480] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-17T03:16:26.687856] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-17T03:16:26.687913] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-17T03:16:26.688476] [DEBUG] [LOCAL ] DMB: Trimmed 14879 records to 10037 (keeping 200 days of data) [2025-09-17T03:16:26.750406] [DEBUG] [LOCAL ] DMB: Primary data saved (10037 records). [2025-09-17T03:16:26.750584] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-17T03:16:26.750701] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMB took 31.5s. Estimated remaining: 4h 12m 41s. Rate: 6.9 symbols/min [2025-09-17T03:16:26.919997] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:26.942683] [DEBUG] [LOCAL ] DNP: Loaded 24576 existing records from primary storage. [2025-09-17T03:16:26.942862] [INFO ] [MAIN ] DNP: Loaded 24576 existing records. [2025-09-17T03:16:27.096976] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-17T03:16:27.127131] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:27.127338] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-17T03:16:27.127401] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-17T03:16:27.128175] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-17T03:16:27.128238] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-17T03:16:27.520513] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:27.707073] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T03:16:27.890378] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:16:27.890143] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-11. [2025-09-17T03:16:27.892867] [INFO ] [REMOTE ] DMO: Full fetch complete (14246 records). [2025-09-17T03:16:27.892958] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-17T03:16:28.080725] [WARN ] [VALIDATOR ] DMO: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T03:16:28.081037] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:16:28.081095] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:16:28.081155] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-17T03:16:28.081219] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-17T03:16:28.081284] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-09-17T03:16:28.081694] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-09-17T03:16:28.081807] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMO took 29.8s. Estimated remaining: 4h 12m 12s. Rate: 6.9 symbols/min [2025-09-17T03:16:28.254450] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:28.292634] [DEBUG] [LOCAL ] DOC: Loaded 39924 existing records from primary storage. [2025-09-17T03:16:28.292834] [INFO ] [MAIN ] DOC: Loaded 39924 existing records. [2025-09-17T03:16:28.479587] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:28.479886] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-17T03:16:28.479948] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-17T03:16:28.480769] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-17T03:16:28.480831] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-17T03:16:28.695345] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-17T03:16:28.841598] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:29.367347] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T03:16:29.490134] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-11. [2025-09-17T03:16:30.290185] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-17T03:16:30.399702] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T03:16:31.090196] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-17T03:16:31.240557] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:16:31.301496] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T03:16:31.890210] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-17T03:16:32.690206] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-17T03:16:33.014348] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T03:16:33.490156] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-17T03:16:33.705470] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:16:34.218558] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T03:16:34.290200] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-17T03:16:35.090190] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-17T03:16:35.280183] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T03:16:35.637390] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:16:35.890135] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-17T03:16:36.690143] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-17T03:16:36.879553] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T03:16:37.408357] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:16:37.490164] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-17T03:16:38.101365] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T03:16:38.290130] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-17T03:16:39.090196] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-17T03:16:39.255517] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:16:39.890145] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-17T03:16:40.043373] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T03:16:40.506070] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T03:16:40.511293] [INFO ] [REMOTE ] DNOW: Full fetch complete (61964 records). [2025-09-17T03:16:40.511486] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-17T03:16:40.695133] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-17T03:16:40.923462] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-17T03:16:40.923568] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-17T03:16:40.924285] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-17T03:16:40.924351] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-17T03:16:40.925622] [DEBUG] [LOCAL ] DNOW: Trimmed 61964 records to 43432 (keeping 200 days of data) [2025-09-17T03:16:41.178089] [DEBUG] [LOCAL ] DNOW: Primary data saved (43432 records). [2025-09-17T03:16:41.178243] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-17T03:16:41.178340] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNOW took 39.4s. Estimated remaining: 4h 12m 15s. Rate: 6.9 symbols/min [2025-09-17T03:16:41.352013] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:41.389860] [DEBUG] [LOCAL ] DOCN: Loaded 37915 existing records from primary storage. [2025-09-17T03:16:41.390046] [INFO ] [MAIN ] DOCN: Loaded 37915 existing records. [2025-09-17T03:16:41.493050] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-17T03:16:41.573416] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:41.573722] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-17T03:16:41.573931] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-17T03:16:41.574680] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-17T03:16:41.574745] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-17T03:16:41.962197] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T03:16:41.965521] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:42.290115] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-17T03:16:42.743534] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T03:16:43.071900] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:16:43.090071] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-17T03:16:43.865242] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:16:43.890102] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-17T03:16:44.574466] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T03:16:44.690172] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-17T03:16:45.490197] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-17T03:16:45.828953] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T03:16:46.290114] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-17T03:16:46.654736] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T03:16:46.688022] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T03:16:47.090176] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-17T03:16:47.890150] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-17T03:16:47.976063] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T03:16:47.982553] [INFO ] [REMOTE ] DNA: Full fetch complete (70800 records). [2025-09-17T03:16:47.982726] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-17T03:16:48.378916] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-17T03:16:48.379087] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-17T03:16:48.379915] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-17T03:16:48.380004] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-17T03:16:48.381588] [DEBUG] [LOCAL ] DNA: Trimmed 70800 records to 48560 (keeping 200 days of data) [2025-09-17T03:16:48.487065] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:16:48.692726] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-17T03:16:48.698450] [DEBUG] [LOCAL ] DNA: Primary data saved (48560 records). [2025-09-17T03:16:48.698633] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-17T03:16:48.698778] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNA took 47.7s. Estimated remaining: 4h 12m 3s. Rate: 6.9 symbols/min [2025-09-17T03:16:49.490192] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-11. [2025-09-17T03:16:49.791142] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T03:16:50.045983] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T03:16:50.290139] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-17T03:16:51.090147] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-17T03:16:51.241302] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:16:51.533413] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T03:16:51.539873] [INFO ] [REMOTE ] DNP: Full fetch complete (49470 records). [2025-09-17T03:16:51.540093] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-17T03:16:51.895203] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-17T03:16:51.971969] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-17T03:16:51.972087] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-17T03:16:51.972785] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-17T03:16:51.972845] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-17T03:16:51.974080] [DEBUG] [LOCAL ] DNP: Trimmed 49470 records to 33548 (keeping 200 days of data) [2025-09-17T03:16:52.180807] [DEBUG] [LOCAL ] DNP: Primary data saved (33548 records). [2025-09-17T03:16:52.180990] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-17T03:16:52.181099] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNP took 25.4s. Estimated remaining: 4h 11m 40s. Rate: 6.9 symbols/min [2025-09-17T03:16:53.148657] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T03:16:53.160750] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-17T03:16:53.236809] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T03:16:53.490197] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-17T03:16:54.997983] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:16:55.007462] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-17T03:16:55.122145] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T03:16:55.133850] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-17T03:16:56.716324] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:16:56.728227] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-17T03:16:56.884131] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:16:56.892085] [INFO ] [REMOTE ] DOC: Full fetch complete (77206 records). [2025-09-17T03:16:56.892322] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-17T03:16:57.286292] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-17T03:16:57.286422] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-17T03:16:57.287363] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-17T03:16:57.287429] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-17T03:16:57.289059] [DEBUG] [LOCAL ] DOC: Trimmed 77206 records to 53537 (keeping 200 days of data) [2025-09-17T03:16:57.635499] [DEBUG] [LOCAL ] DOC: Primary data saved (53537 records). [2025-09-17T03:16:57.635701] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-17T03:16:57.635809] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 29.6s. Estimated remaining: 4h 11m 22s. Rate: 6.9 symbols/min [2025-09-17T03:16:58.518770] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:16:58.529041] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-17T03:17:00.256618] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:17:00.267259] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-17T03:17:02.076483] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T03:17:02.087706] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-17T03:17:03.911458] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T03:17:03.922545] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-17T03:17:05.806834] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T03:17:05.818622] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-17T03:17:07.842527] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T03:17:07.853729] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-17T03:17:09.607325] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:17:09.613600] [INFO ] [REMOTE ] DOCN: Full fetch complete (70661 records). [2025-09-17T03:17:09.613763] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-17T03:17:10.011123] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-17T03:17:10.011253] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-17T03:17:10.012053] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-17T03:17:10.012111] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-17T03:17:10.013455] [DEBUG] [LOCAL ] DOCN: Trimmed 70661 records to 50377 (keeping 200 days of data) [2025-09-17T03:17:10.316284] [DEBUG] [LOCAL ] DOCN: Primary data saved (50377 records). [2025-09-17T03:17:10.316482] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-17T03:17:10.316612] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 29.1s. Estimated remaining: 4h 11m 24s. Rate: 6.9 symbols/min [2025-09-17T03:17:10.842929] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:10.892952] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:11.021413] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:11.022741] [DEBUG] [LOCAL ] DOUG: No existing data file found in primary storage. [2025-09-17T03:17:11.022801] [WARN ] [MAIN ] DOUG: No existing data found, performing full refresh instead. [2025-09-17T03:17:11.022392] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:11.023345] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-17T03:17:11.023551] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-17T03:17:11.023666] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-09-17T03:17:11.023714] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-17T03:17:11.228360] [DEBUG] [LOCAL ] DOLE: Loaded 28584 existing records from primary storage. [2025-09-17T03:17:11.263603] [INFO ] [MAIN ] DOLE: Loaded 28584 existing records. [2025-09-17T03:17:11.435143] [DEBUG] [LOCAL ] DOCS: Loaded 37942 existing records from primary storage. [2025-09-17T03:17:11.456536] [INFO ] [MAIN ] DOCS: Loaded 37942 existing records. [2025-09-17T03:17:11.435273] [DEBUG] [LOCAL ] DOV: Loaded 33591 existing records from primary storage. [2025-09-17T03:17:11.501877] [INFO ] [MAIN ] DOV: Loaded 33591 existing records. [2025-09-17T03:17:11.896099] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:12.014897] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-11. [2025-09-17T03:17:11.991449] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:12.038553] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:12.041783] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:12.041992] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-17T03:17:12.042262] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-17T03:17:12.042292] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-17T03:17:12.042441] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-17T03:17:12.042686] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-17T03:17:12.042481] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-17T03:17:12.043576] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-17T03:17:12.043611] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-17T03:17:12.043655] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-17T03:17:12.043984] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-17T03:17:12.044157] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-17T03:17:12.043853] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-17T03:17:13.029837] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:13.065457] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:13.061362] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-11. [2025-09-17T03:17:13.070924] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-11. [2025-09-17T03:17:13.131498] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:13.132135] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-11. [2025-09-17T03:17:13.490208] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T03:17:13.498353] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-17T03:17:14.623352] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:17:14.631740] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-17T03:17:14.653689] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T03:17:14.661387] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-17T03:17:14.936282] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:17:14.946732] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-17T03:17:14.977609] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:17:14.986927] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-17T03:17:15.802665] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:17:15.809780] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-17T03:17:15.951500] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T03:17:15.959608] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-17T03:17:16.371472] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T03:17:16.381951] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-17T03:17:16.413966] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:17:16.421384] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-17T03:17:17.221628] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T03:17:17.235206] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-17T03:17:17.388422] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:17:17.397824] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-17T03:17:17.428325] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:17:17.436091] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-17T03:17:18.068990] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T03:17:18.079770] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-17T03:17:18.133046] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T03:17:18.140136] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-17T03:17:18.835737] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T03:17:18.846678] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-17T03:17:18.869031] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:17:18.877458] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-17T03:17:19.540156] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:17:19.547754] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-17T03:17:19.596422] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T03:17:19.607031] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-17T03:17:20.167102] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T03:17:20.177127] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-17T03:17:20.306290] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:17:20.314510] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-17T03:17:20.883197] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T03:17:20.891472] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-17T03:17:21.501500] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:17:21.513852] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-17T03:17:21.849750] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T03:17:22.067616] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T03:17:22.113254] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:17:22.290142] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-17T03:17:23.090120] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-17T03:17:23.287731] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:17:23.890136] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-17T03:17:23.942396] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:17:24.537341] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:17:24.690226] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-17T03:17:25.490189] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-17T03:17:25.571357] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T03:17:26.126299] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T03:17:26.290099] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-17T03:17:26.971629] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:17:27.090170] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-17T03:17:27.702382] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T03:17:27.890184] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-17T03:17:28.236679] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T03:17:28.690185] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-17T03:17:29.248611] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:17:29.490159] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-17T03:17:30.120271] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:17:30.290147] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-17T03:17:30.733853] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T03:17:30.738330] [INFO ] [REMOTE ] DOUG: Full fetch complete (51914 records). [2025-09-17T03:17:30.738506] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-17T03:17:31.100047] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-17T03:17:31.127402] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-17T03:17:31.127545] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-17T03:17:31.128478] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-17T03:17:31.128591] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-17T03:17:31.130689] [DEBUG] [LOCAL ] DOUG: Trimmed 51914 records to 34879 (keeping 200 days of data) [2025-09-17T03:17:31.341441] [DEBUG] [LOCAL ] DOUG: Primary data saved (34879 records). [2025-09-17T03:17:31.341699] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-17T03:17:31.341845] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOUG took 21.0s. Estimated remaining: 4h 11m 49s. Rate: 6.9 symbols/min [2025-09-17T03:17:31.516983] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:31.556946] [DEBUG] [LOCAL ] DOW: Loaded 40083 existing records from primary storage. [2025-09-17T03:17:31.557125] [INFO ] [MAIN ] DOW: Loaded 40083 existing records. [2025-09-17T03:17:31.739150] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:31.739395] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-17T03:17:31.739461] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-17T03:17:31.740307] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-17T03:17:31.740376] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-17T03:17:31.895338] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-17T03:17:32.103047] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:32.136235] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T03:17:32.690141] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-17T03:17:32.956151] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:17:33.470309] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:17:33.477744] [INFO ] [REMOTE ] DOLE: Full fetch complete (52821 records). [2025-09-17T03:17:33.477918] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-17T03:17:33.495367] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-17T03:17:33.898277] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-17T03:17:33.898391] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-17T03:17:33.899061] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-17T03:17:33.899122] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-17T03:17:33.900401] [DEBUG] [LOCAL ] DOLE: Trimmed 52821 records to 37771 (keeping 200 days of data) [2025-09-17T03:17:34.141350] [DEBUG] [LOCAL ] DOLE: Primary data saved (37771 records). [2025-09-17T03:17:34.141532] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-17T03:17:34.141672] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOLE took 23.8s. Estimated remaining: 4h 11m 24s. Rate: 6.9 symbols/min [2025-09-17T03:17:34.299141] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-11. [2025-09-17T03:17:34.333169] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:34.348005] [DEBUG] [LOCAL ] DPG: Loaded 9792 existing records from primary storage. [2025-09-17T03:17:34.349238] [INFO ] [MAIN ] DPG: Loaded 9792 existing records. [2025-09-17T03:17:34.549975] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:34.560254] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-17T03:17:34.561057] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-17T03:17:34.562316] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T03:17:34.572081] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-17T03:17:34.572309] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-17T03:17:34.936400] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:35.090164] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-11. [2025-09-17T03:17:35.355364] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:17:35.890209] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-17T03:17:35.930087] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:17:36.039805] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T03:17:36.690137] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-17T03:17:37.490197] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-17T03:17:37.547597] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T03:17:37.705942] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:17:38.290137] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-17T03:17:38.971519] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:17:38.977102] [INFO ] [REMOTE ] DOV: Full fetch complete (64525 records). [2025-09-17T03:17:38.977241] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-17T03:17:39.095209] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-17T03:17:39.366592] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-17T03:17:39.366718] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-17T03:17:39.367438] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-17T03:17:39.367493] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-17T03:17:39.369011] [DEBUG] [LOCAL ] DOV: Trimmed 64525 records to 45883 (keeping 200 days of data) [2025-09-17T03:17:39.684100] [DEBUG] [LOCAL ] DOV: Primary data saved (45883 records). [2025-09-17T03:17:39.684366] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-17T03:17:39.684511] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOV took 29.4s. Estimated remaining: 4h 11m 7s. Rate: 6.9 symbols/min [2025-09-17T03:17:39.859976] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:39.883005] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:17:39.890578] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-17T03:17:39.891855] [INFO ] [REMOTE ] DOCS: Full fetch complete (74225 records). [2025-09-17T03:17:39.891951] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-17T03:17:40.136130] [DEBUG] [LOCAL ] DQ: Loaded 31641 existing records from primary storage. [2025-09-17T03:17:40.161436] [INFO ] [MAIN ] DQ: Loaded 31641 existing records. [2025-09-17T03:17:40.333690] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:17:40.478736] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-17T03:17:40.512480] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-17T03:17:40.517873] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:40.517767] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-17T03:17:40.518114] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-17T03:17:40.518180] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-17T03:17:40.518385] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-17T03:17:40.519288] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-17T03:17:40.519374] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-17T03:17:40.600630] [DEBUG] [LOCAL ] DOCS: Trimmed 74225 records to 51441 (keeping 200 days of data) [2025-09-17T03:17:40.703555] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-17T03:17:40.979174] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:41.186977] [DEBUG] [LOCAL ] DOCS: Primary data saved (51441 records). [2025-09-17T03:17:41.187153] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-17T03:17:41.187252] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 30.9s. Estimated remaining: 4h 10m 38s. Rate: 6.9 symbols/min [2025-09-17T03:17:41.363299] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:41.363493] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-17T03:17:41.363546] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-17T03:17:41.363669] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-17T03:17:41.363718] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-17T03:17:41.363798] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-17T03:17:41.363855] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-17T03:17:41.495272] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-11. [2025-09-17T03:17:41.730552] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T03:17:41.760305] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:41.914892] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T03:17:42.290178] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-11. [2025-09-17T03:17:43.090152] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-17T03:17:43.260456] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:17:43.565353] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T03:17:43.890147] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-17T03:17:43.949482] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T03:17:44.690160] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-17T03:17:45.047208] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T03:17:45.490140] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-17T03:17:46.290196] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-17T03:17:46.438817] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T03:17:46.624913] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T03:17:47.090159] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-17T03:17:47.895888] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-17T03:17:47.913086] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T03:17:47.960320] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T03:17:48.690085] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-17T03:17:48.785326] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:17:49.490189] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-17T03:17:50.290123] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-17T03:17:50.576072] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T03:17:51.012102] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T03:17:51.090166] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-17T03:17:51.574113] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T03:17:51.890160] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-17T03:17:52.665512] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:17:52.690083] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-17T03:17:52.786489] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T03:17:53.490193] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-17T03:17:54.213122] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T03:17:54.290230] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-17T03:17:54.562229] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:17:55.090151] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-17T03:17:55.793982] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:17:55.890085] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-17T03:17:56.659467] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T03:17:56.690172] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-17T03:17:57.328121] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T03:17:57.490153] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-17T03:17:58.290142] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-17T03:17:58.426303] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T03:17:58.663920] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:17:59.090131] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-17T03:17:59.499979] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T03:17:59.857810] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T03:17:59.859772] [INFO ] [REMOTE ] DPG: Full fetch complete (18809 records). [2025-09-17T03:17:59.859857] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-17T03:17:59.895298] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-17T03:18:00.226402] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-17T03:18:00.226502] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-17T03:18:00.226904] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-17T03:18:00.226958] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-17T03:18:00.227528] [DEBUG] [LOCAL ] DPG: Trimmed 18809 records to 13284 (keeping 200 days of data) [2025-09-17T03:18:00.316751] [DEBUG] [LOCAL ] DPG: Primary data saved (13284 records). [2025-09-17T03:18:00.317036] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-17T03:18:00.317187] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 26.2s. Estimated remaining: 4h 10m 58s. Rate: 6.9 symbols/min [2025-09-17T03:18:00.501301] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:00.545869] [DEBUG] [LOCAL ] DRH: Loaded 37403 existing records from primary storage. [2025-09-17T03:18:00.546088] [INFO ] [MAIN ] DRH: Loaded 37403 existing records. [2025-09-17T03:18:00.697699] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-17T03:18:00.742150] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:00.742487] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-17T03:18:00.742554] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-17T03:18:00.743724] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-17T03:18:00.743799] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-17T03:18:01.106101] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:01.434678] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:18:01.490093] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-17T03:18:02.290140] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-11. [2025-09-17T03:18:03.090171] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-17T03:18:03.858099] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-09-17T03:18:03.890077] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-17T03:18:03.984541] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-17T03:18:04.690158] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-17T03:18:04.943496] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-11 (2.65 seconds). [2025-09-17T03:18:05.166900] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T03:18:05.490147] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-17T03:18:06.099009] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T03:18:06.290167] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-17T03:18:06.539328] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-17T03:18:07.031434] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:18:07.090126] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-17T03:18:07.890175] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-17T03:18:07.982041] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:18:08.224757] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T03:18:08.690197] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-17T03:18:09.490124] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-17T03:18:09.664971] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T03:18:10.232108] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T03:18:10.290085] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-17T03:18:10.957559] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:18:10.963533] [INFO ] [REMOTE ] DQ: Full fetch complete (62598 records). [2025-09-17T03:18:10.963684] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-17T03:18:11.104277] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-17T03:18:11.362133] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-17T03:18:11.362248] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-17T03:18:11.363016] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-17T03:18:11.363094] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-17T03:18:11.364355] [DEBUG] [LOCAL ] DQ: Trimmed 62598 records to 43010 (keeping 200 days of data) [2025-09-17T03:18:11.613190] [DEBUG] [LOCAL ] DQ: Primary data saved (43010 records). [2025-09-17T03:18:11.613369] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-17T03:18:11.613488] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DQ took 31.9s. Estimated remaining: 4h 10m 56s. Rate: 6.9 symbols/min [2025-09-17T03:18:11.786165] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:11.824026] [DEBUG] [LOCAL ] DRI: Loaded 35099 existing records from primary storage. [2025-09-17T03:18:11.824215] [INFO ] [MAIN ] DRI: Loaded 35099 existing records. [2025-09-17T03:18:11.897811] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-17T03:18:12.007363] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:12.007582] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-17T03:18:12.007686] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-17T03:18:12.008563] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-17T03:18:12.008629] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-17T03:18:12.362954] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:12.574955] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T03:18:12.610054] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:18:12.690097] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-17T03:18:13.490112] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-11. [2025-09-17T03:18:13.551870] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:18:14.290161] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-17T03:18:14.445705] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T03:18:14.685823] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T03:18:15.090122] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-17T03:18:15.890134] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-17T03:18:16.291753] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:18:16.690166] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-17T03:18:17.001174] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T03:18:17.490142] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-17T03:18:17.656982] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T03:18:17.662704] [INFO ] [REMOTE ] DRD: Full fetch complete (47719 records). [2025-09-17T03:18:17.662834] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-17T03:18:18.047528] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-17T03:18:18.047636] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-17T03:18:18.048242] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-17T03:18:18.048297] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-17T03:18:18.049427] [DEBUG] [LOCAL ] DRD: Trimmed 47719 records to 36102 (keeping 200 days of data) [2025-09-17T03:18:18.269537] [DEBUG] [LOCAL ] DRD: Primary data saved (36102 records). [2025-09-17T03:18:18.269711] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-17T03:18:18.269827] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DRD took 37.1s. Estimated remaining: 4h 10m 41s. Rate: 6.9 symbols/min [2025-09-17T03:18:18.301609] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-17T03:18:18.442739] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:18.451514] [DEBUG] [LOCAL ] DRLL: Loaded 6504 existing records from primary storage. [2025-09-17T03:18:18.451710] [INFO ] [MAIN ] DRLL: Loaded 6504 existing records. [2025-09-17T03:18:18.683294] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:18.683564] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-17T03:18:18.683623] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-17T03:18:18.683963] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-17T03:18:18.684021] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-17T03:18:19.042093] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:19.060454] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-17T03:18:19.067517] [INFO ] [REMOTE ] DOW: Full fetch complete (77661 records). [2025-09-17T03:18:19.067771] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-17T03:18:19.101596] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-11. [2025-09-17T03:18:19.472825] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-17T03:18:19.472956] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-17T03:18:19.473838] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-17T03:18:19.473900] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-17T03:18:19.475581] [DEBUG] [LOCAL ] DOW: Trimmed 77661 records to 53733 (keeping 200 days of data) [2025-09-17T03:18:19.831614] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-17T03:18:19.854892] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:18:19.867844] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-17T03:18:19.868045] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-17T03:18:19.868154] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DOW took 48.5s. Estimated remaining: 4h 10m 14s. Rate: 6.9 symbols/min [2025-09-17T03:18:19.898692] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-17T03:18:20.044413] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:20.064234] [DEBUG] [LOCAL ] DSL: Loaded 20214 existing records from primary storage. [2025-09-17T03:18:20.064389] [INFO ] [MAIN ] DSL: Loaded 20214 existing records. [2025-09-17T03:18:20.241823] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:20.242072] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-17T03:18:20.242131] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-17T03:18:20.242686] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-17T03:18:20.242743] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-17T03:18:20.603153] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:20.636478] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-17T03:18:20.690084] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-17T03:18:21.259725] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:18:21.490123] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-11. [2025-09-17T03:18:21.731997] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:18:22.290147] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-17T03:18:22.904367] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:18:23.090122] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-17T03:18:23.707508] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T03:18:23.890132] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-17T03:18:24.108377] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T03:18:24.690138] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-17T03:18:25.495668] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-17T03:18:25.516634] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:18:25.528103] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T03:18:26.290123] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-17T03:18:27.090167] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-17T03:18:27.276265] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:18:27.702359] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:18:27.890160] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-17T03:18:28.700980] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-17T03:18:28.703888] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:18:29.490196] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-17T03:18:29.604466] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T03:18:29.730299] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T03:18:30.109887] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T03:18:30.290162] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-17T03:18:31.090161] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-17T03:18:31.164465] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T03:18:31.890140] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-17T03:18:32.690141] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-17T03:18:32.720078] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T03:18:32.907775] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T03:18:33.490163] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-17T03:18:34.011253] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:18:34.290145] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-17T03:18:34.352175] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T03:18:35.090177] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-17T03:18:35.650142] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T03:18:35.794843] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T03:18:35.890136] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-17T03:18:36.690165] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-17T03:18:37.490272] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-17T03:18:37.632308] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:18:38.290291] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-17T03:18:38.294726] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:18:38.556784] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:18:39.090157] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-17T03:18:39.283194] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T03:18:39.890179] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-17T03:18:40.577602] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T03:18:40.579293] [INFO ] [REMOTE ] DRLL: Full fetch complete (16485 records). [2025-09-17T03:18:40.579380] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-17T03:18:40.693676] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-17T03:18:40.918920] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T03:18:41.017061] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-17T03:18:41.017180] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-17T03:18:41.017565] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-17T03:18:41.017621] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-17T03:18:41.018379] [DEBUG] [LOCAL ] DRLL: Trimmed 16485 records to 10058 (keeping 200 days of data) [2025-09-17T03:18:41.083924] [DEBUG] [LOCAL ] DRLL: Primary data saved (10058 records). [2025-09-17T03:18:41.084110] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-17T03:18:41.084216] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRLL took 22.8s. Estimated remaining: 4h 10m 38s. Rate: 6.9 symbols/min [2025-09-17T03:18:41.268168] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:41.279901] [DEBUG] [LOCAL ] DSM: Loaded 10175 existing records from primary storage. [2025-09-17T03:18:41.280092] [INFO ] [MAIN ] DSM: Loaded 10175 existing records. [2025-09-17T03:18:41.467505] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:41.467768] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-17T03:18:41.467821] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-17T03:18:41.468211] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-17T03:18:41.468273] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-17T03:18:41.499439] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-17T03:18:41.845387] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:41.898355] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:18:42.290164] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-17T03:18:43.090201] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-11. [2025-09-17T03:18:43.258943] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:18:43.451845] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T03:18:43.890159] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-17T03:18:44.048563] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T03:18:44.690139] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-17T03:18:45.346524] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:18:45.490164] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-17T03:18:46.127079] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:18:46.132750] [INFO ] [REMOTE ] DRI: Full fetch complete (69223 records). [2025-09-17T03:18:46.132883] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-17T03:18:46.310742] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-17T03:18:46.528602] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-17T03:18:46.528742] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-17T03:18:46.529513] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-17T03:18:46.529575] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-17T03:18:46.530996] [DEBUG] [LOCAL ] DRI: Trimmed 69223 records to 47769 (keeping 200 days of data) [2025-09-17T03:18:46.643974] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:18:46.846002] [DEBUG] [LOCAL ] DRI: Primary data saved (47769 records). [2025-09-17T03:18:46.846166] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-17T03:18:46.846266] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DRI took 35.2s. Estimated remaining: 4h 10m 21s. Rate: 6.9 symbols/min [2025-09-17T03:18:47.013946] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:47.014168] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-09-17T03:18:47.014219] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-09-17T03:18:47.014328] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-17T03:18:47.014378] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-17T03:18:47.014425] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-17T03:18:47.014470] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-17T03:18:47.095286] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-17T03:18:47.369751] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:47.729445] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:18:47.890155] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-11. [2025-09-17T03:18:48.108395] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:18:48.183720] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T03:18:48.690156] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-17T03:18:49.490137] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-17T03:18:49.881993] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:18:49.885599] [INFO ] [REMOTE ] DSL: Full fetch complete (41308 records). [2025-09-17T03:18:49.885716] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-17T03:18:50.277170] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-17T03:18:50.277316] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-17T03:18:50.278026] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-17T03:18:50.278106] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-17T03:18:50.279275] [DEBUG] [LOCAL ] DSL: Trimmed 41308 records to 28139 (keeping 200 days of data) [2025-09-17T03:18:50.334031] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-17T03:18:50.458558] [DEBUG] [LOCAL ] DSL: Primary data saved (28139 records). [2025-09-17T03:18:50.458752] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-17T03:18:50.458862] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DSL took 30.6s. Estimated remaining: 4h 9m 59s. Rate: 6.9 symbols/min [2025-09-17T03:18:50.631376] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:50.648212] [DEBUG] [LOCAL ] DSU: Loaded 15673 existing records from primary storage. [2025-09-17T03:18:50.648368] [INFO ] [MAIN ] DSU: Loaded 15673 existing records. [2025-09-17T03:18:50.827369] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:50.827613] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-17T03:18:50.827691] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-17T03:18:50.828310] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-17T03:18:50.828374] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-17T03:18:51.098607] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-17T03:18:51.189834] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:51.205448] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T03:18:51.212232] [INFO ] [REMOTE ] DRH: Full fetch complete (71663 records). [2025-09-17T03:18:51.212388] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-17T03:18:51.557670] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T03:18:51.613299] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-17T03:18:51.614863] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-17T03:18:51.615807] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-17T03:18:51.615884] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-17T03:18:51.630092] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T03:18:51.635978] [DEBUG] [LOCAL ] DRH: Trimmed 71663 records to 50464 (keeping 200 days of data) [2025-09-17T03:18:51.898155] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-17T03:18:51.936931] [DEBUG] [LOCAL ] DRH: Primary data saved (50464 records). [2025-09-17T03:18:51.937085] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-17T03:18:51.937218] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DRH took 51.6s. Estimated remaining: 4h 9m 31s. Rate: 6.9 symbols/min [2025-09-17T03:18:52.108670] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:52.126499] [DEBUG] [LOCAL ] DSX: Loaded 17834 existing records from primary storage. [2025-09-17T03:18:52.126717] [INFO ] [MAIN ] DSX: Loaded 17834 existing records. [2025-09-17T03:18:52.236987] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T03:18:52.315082] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:52.315330] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-17T03:18:52.315390] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-17T03:18:52.315949] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-17T03:18:52.316012] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-17T03:18:52.666832] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:52.690082] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-11. [2025-09-17T03:18:53.490131] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-17T03:18:54.165606] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T03:18:54.290129] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-17T03:18:54.668686] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:18:55.090135] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-17T03:18:55.544675] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T03:18:55.798046] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T03:18:55.890101] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-11. [2025-09-17T03:18:56.690122] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-17T03:18:56.922628] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:18:57.490159] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-17T03:18:57.742447] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T03:18:58.059918] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T03:18:58.290135] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-17T03:18:59.090187] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-17T03:18:59.145419] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:18:59.663727] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T03:18:59.890151] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-17T03:19:00.280877] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T03:19:00.690136] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-17T03:19:01.056376] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T03:19:01.490175] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-17T03:19:02.290181] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-17T03:19:02.655071] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T03:19:02.706398] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T03:19:03.090133] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-17T03:19:03.890118] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-17T03:19:04.162080] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:19:04.690288] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-17T03:19:05.102618] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T03:19:05.490139] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-17T03:19:05.924901] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T03:19:05.955525] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:19:06.290178] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-17T03:19:07.090128] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-17T03:19:07.118939] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T03:19:07.890199] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-17T03:19:08.113737] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:19:08.268566] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T03:19:08.269476] [INFO ] [REMOTE ] DSMC: Full fetch complete (2837 records). [2025-09-17T03:19:08.269561] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-17T03:19:08.630259] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-17T03:19:08.630361] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-17T03:19:08.630481] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-17T03:19:08.630539] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-17T03:19:08.630937] [DEBUG] [LOCAL ] DSMC: Trimmed 2837 records to 1993 (keeping 200 days of data) [2025-09-17T03:19:08.643654] [DEBUG] [LOCAL ] DSMC: Primary data saved (1993 records). [2025-09-17T03:19:08.643729] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-17T03:19:08.643804] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DSMC took 21.8s. Estimated remaining: 4h 9m 44s. Rate: 6.9 symbols/min [2025-09-17T03:19:08.696543] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-17T03:19:08.815203] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:08.854789] [DEBUG] [LOCAL ] DT: Loaded 39430 existing records from primary storage. [2025-09-17T03:19:08.854952] [INFO ] [MAIN ] DT: Loaded 39430 existing records. [2025-09-17T03:19:09.035972] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:09.036256] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-17T03:19:09.036314] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-17T03:19:09.037212] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-17T03:19:09.037274] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-17T03:19:09.391598] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:09.490101] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-11. [2025-09-17T03:19:09.930439] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T03:19:10.290122] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-17T03:19:11.090159] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-17T03:19:11.251556] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T03:19:11.309574] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:19:11.890124] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-17T03:19:12.213992] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:19:12.690138] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-17T03:19:13.494262] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-17T03:19:13.497093] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:19:13.633837] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T03:19:14.290163] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-17T03:19:14.662441] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:19:15.090201] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-17T03:19:15.099680] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:19:15.102507] [INFO ] [REMOTE ] DSM: Full fetch complete (24725 records). [2025-09-17T03:19:15.102600] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-17T03:19:15.468992] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-17T03:19:15.469121] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-17T03:19:15.469731] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-17T03:19:15.469799] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-17T03:19:15.470606] [DEBUG] [LOCAL ] DSM: Trimmed 24725 records to 15831 (keeping 200 days of data) [2025-09-17T03:19:15.562866] [DEBUG] [LOCAL ] DSM: Primary data saved (15831 records). [2025-09-17T03:19:15.563029] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-17T03:19:15.563128] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSM took 34.5s. Estimated remaining: 4h 9m 30s. Rate: 6.9 symbols/min [2025-09-17T03:19:15.730998] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:15.736632] [DEBUG] [LOCAL ] DTB: Loaded 3766 existing records from primary storage. [2025-09-17T03:19:15.736916] [INFO ] [MAIN ] DTB: Loaded 3766 existing records. [2025-09-17T03:19:15.894378] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-17T03:19:15.916147] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:15.916623] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-17T03:19:15.916705] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-17T03:19:15.917119] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-17T03:19:15.917185] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-17T03:19:16.274657] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:16.690131] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-17T03:19:16.878306] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T03:19:16.981054] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T03:19:17.490103] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-17T03:19:17.908173] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T03:19:18.290110] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-17T03:19:18.576378] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T03:19:19.090185] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-17T03:19:19.890128] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-17T03:19:20.084765] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T03:19:20.314346] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T03:19:20.690141] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-17T03:19:20.762391] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T03:19:21.490095] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-17T03:19:21.771131] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T03:19:22.290144] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-17T03:19:23.090100] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-11. [2025-09-17T03:19:23.125975] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:19:23.151691] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T03:19:23.698992] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:19:23.890170] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-17T03:19:24.690141] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-17T03:19:25.160912] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T03:19:25.490153] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-17T03:19:25.686843] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:19:25.689891] [INFO ] [REMOTE ] DSU: Full fetch complete (31766 records). [2025-09-17T03:19:25.690020] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-17T03:19:26.065051] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-17T03:19:26.065156] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-17T03:19:26.065632] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-17T03:19:26.065703] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-17T03:19:26.066446] [DEBUG] [LOCAL ] DSU: Trimmed 31766 records to 21420 (keeping 200 days of data) [2025-09-17T03:19:26.201085] [DEBUG] [LOCAL ] DSU: Primary data saved (21420 records). [2025-09-17T03:19:26.201253] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-17T03:19:26.201361] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSU took 35.7s. Estimated remaining: 4h 9m 26s. Rate: 6.9 symbols/min [2025-09-17T03:19:26.298753] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-17T03:19:26.372050] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:26.407159] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T03:19:26.423916] [DEBUG] [LOCAL ] DTE: Loaded 35490 existing records from primary storage. [2025-09-17T03:19:26.424082] [INFO ] [MAIN ] DTE: Loaded 35490 existing records. [2025-09-17T03:19:26.601225] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:26.601467] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-17T03:19:26.601532] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-17T03:19:26.602561] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-17T03:19:26.602626] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-17T03:19:26.966374] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:27.052792] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T03:19:27.090095] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-17T03:19:27.667508] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T03:19:27.890141] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-17T03:19:28.690193] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-17T03:19:29.315277] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:19:29.490133] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-17T03:19:29.617230] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:19:30.079298] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T03:19:30.290191] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-11. [2025-09-17T03:19:31.090215] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-17T03:19:31.890163] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-17T03:19:32.059943] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:19:32.690096] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-17T03:19:32.869974] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:19:33.015276] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T03:19:33.018675] [INFO ] [REMOTE ] DSX: Full fetch complete (37941 records). [2025-09-17T03:19:33.018771] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-17T03:19:33.391560] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-17T03:19:33.391689] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-17T03:19:33.392235] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-17T03:19:33.392291] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-17T03:19:33.393283] [DEBUG] [LOCAL ] DSX: Trimmed 37941 records to 24732 (keeping 200 days of data) [2025-09-17T03:19:33.490367] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-17T03:19:33.540061] [DEBUG] [LOCAL ] DSX: Primary data saved (24732 records). [2025-09-17T03:19:33.540213] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-17T03:19:33.540312] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DSX took 41.6s. Estimated remaining: 4h 9m 14s. Rate: 6.9 symbols/min [2025-09-17T03:19:33.743616] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:33.743875] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-17T03:19:33.743925] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-17T03:19:33.744025] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-17T03:19:33.744084] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-17T03:19:33.744133] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-17T03:19:33.744174] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-17T03:19:34.105568] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:34.290096] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-11. [2025-09-17T03:19:34.327313] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:19:34.680362] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T03:19:35.096967] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-17T03:19:35.116448] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:19:35.697776] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T03:19:35.890157] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-17T03:19:36.498943] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T03:19:36.690165] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-17T03:19:37.317889] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T03:19:37.490150] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-17T03:19:38.290122] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-17T03:19:39.090149] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-17T03:19:39.278927] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:19:39.678841] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:19:39.890149] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-17T03:19:40.029549] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T03:19:40.531179] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T03:19:40.690131] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-17T03:19:41.382030] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T03:19:41.490155] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-17T03:19:42.129387] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:19:42.130829] [INFO ] [REMOTE ] DTB: Full fetch complete (6728 records). [2025-09-17T03:19:42.130926] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-17T03:19:42.290392] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-17T03:19:42.506901] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-17T03:19:42.507016] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-17T03:19:42.507221] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-17T03:19:42.507285] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-17T03:19:42.508011] [DEBUG] [LOCAL ] DTB: Trimmed 6728 records to 4660 (keeping 200 days of data) [2025-09-17T03:19:42.543772] [DEBUG] [LOCAL ] DTB: Primary data saved (4660 records). [2025-09-17T03:19:42.543932] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-17T03:19:42.544100] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DTB took 27.0s. Estimated remaining: 4h 9m 6s. Rate: 6.9 symbols/min [2025-09-17T03:19:42.714022] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:42.714267] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-09-17T03:19:42.714319] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-09-17T03:19:42.714428] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-17T03:19:42.714498] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-17T03:19:42.714551] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-17T03:19:42.714622] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-17T03:19:43.085757] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:43.090072] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-11. [2025-09-17T03:19:43.697807] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:19:43.890113] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-17T03:19:44.144017] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T03:19:44.183737] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T03:19:44.690194] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-17T03:19:45.490132] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-17T03:19:45.534838] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T03:19:46.290130] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-17T03:19:46.922901] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T03:19:47.090165] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-17T03:19:47.354960] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:19:47.890235] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-17T03:19:48.246207] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-17T03:19:48.690138] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-17T03:19:48.988621] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T03:19:49.318934] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:19:49.490192] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-17T03:19:50.225102] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:19:50.290121] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-17T03:19:50.909990] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:19:51.090157] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-17T03:19:51.702842] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T03:19:51.890139] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-17T03:19:52.500291] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T03:19:52.690151] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-17T03:19:53.298731] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T03:19:53.490115] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-17T03:19:53.953515] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:19:54.290136] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-17T03:19:54.804371] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T03:19:55.090143] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-17T03:19:55.890195] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-17T03:19:56.690177] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-17T03:19:56.869446] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:19:57.353878] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T03:19:57.490193] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-17T03:19:57.648542] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T03:19:57.655613] [INFO ] [REMOTE ] DT: Full fetch complete (76461 records). [2025-09-17T03:19:57.655848] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-17T03:19:58.078782] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-17T03:19:58.078898] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-17T03:19:58.079757] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-17T03:19:58.079838] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-17T03:19:58.081667] [DEBUG] [LOCAL ] DT: Trimmed 76461 records to 52955 (keeping 200 days of data) [2025-09-17T03:19:58.301416] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-17T03:19:58.426038] [DEBUG] [LOCAL ] DT: Primary data saved (52955 records). [2025-09-17T03:19:58.426225] [INFO ] [MAIN ] DT: Full history saved. [2025-09-17T03:19:58.426345] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DT took 49.8s. Estimated remaining: 4h 9m 16s. Rate: 6.9 symbols/min [2025-09-17T03:19:58.597933] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:58.634948] [DEBUG] [LOCAL ] DTM: Loaded 32101 existing records from primary storage. [2025-09-17T03:19:58.635126] [INFO ] [MAIN ] DTM: Loaded 32101 existing records. [2025-09-17T03:19:58.741331] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T03:19:58.751712] [INFO ] [REMOTE ] DTG: Full fetch complete (9006 records). [2025-09-17T03:19:58.786894] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-17T03:19:58.925367] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:58.936213] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-17T03:19:58.947289] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-17T03:19:59.013403] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-17T03:19:59.064165] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-17T03:19:59.091204] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-17T03:19:59.362781] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-17T03:19:59.398210] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-17T03:19:59.481536] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-17T03:19:59.510762] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-17T03:19:59.554102] [DEBUG] [LOCAL ] DTG: Trimmed 9006 records to 5874 (keeping 200 days of data) [2025-09-17T03:19:59.602274] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:59.673476] [DEBUG] [LOCAL ] DTG: Primary data saved (5874 records). [2025-09-17T03:19:59.662913] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:19:59.674276] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-17T03:19:59.677349] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T03:19:59.677513] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTG took 17.1s. Estimated remaining: 4h 8m 48s. Rate: 6.9 symbols/min [2025-09-17T03:19:59.860549] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:59.869225] [DEBUG] [LOCAL ] DTW: Loaded 3569 existing records from primary storage. [2025-09-17T03:19:59.869365] [INFO ] [MAIN ] DTW: Loaded 3569 existing records. [2025-09-17T03:19:59.898346] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-17T03:20:00.050002] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:00.050242] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-17T03:20:00.050302] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-17T03:20:00.050561] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-17T03:20:00.050619] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-17T03:20:00.374502] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T03:20:00.412837] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:00.690142] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-11. [2025-09-17T03:20:01.339539] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T03:20:01.490149] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-17T03:20:02.290169] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-17T03:20:02.334076] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T03:20:02.692931] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T03:20:03.090187] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-17T03:20:03.890184] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-17T03:20:04.270116] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T03:20:04.690118] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-17T03:20:04.798250] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T03:20:05.354413] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T03:20:05.490184] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-17T03:20:05.888381] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T03:20:05.889246] [INFO ] [REMOTE ] DTF: Full fetch complete (2212 records). [2025-09-17T03:20:05.889332] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-17T03:20:05.889732] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:20:05.889804] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:20:05.889859] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:20:05.889907] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-17T03:20:05.889974] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-17T03:20:05.890028] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-17T03:20:05.890102] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-17T03:20:05.890196] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTF took 32.3s. Estimated remaining: 4h 8m 33s. Rate: 6.9 symbols/min [2025-09-17T03:20:06.061713] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:06.113995] [DEBUG] [LOCAL ] DUK: Loaded 39839 existing records from primary storage. [2025-09-17T03:20:06.114185] [INFO ] [MAIN ] DUK: Loaded 39839 existing records. [2025-09-17T03:20:06.293935] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-11. [2025-09-17T03:20:06.302284] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:06.303770] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-17T03:20:06.303921] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-17T03:20:06.305163] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-17T03:20:06.305248] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-17T03:20:06.681110] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:07.090169] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-17T03:20:07.754280] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T03:20:07.890136] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-17T03:20:07.984856] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T03:20:08.690167] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-11. [2025-09-17T03:20:09.490126] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-17T03:20:09.728484] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:20:10.290123] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-17T03:20:10.505373] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T03:20:10.962042] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T03:20:11.058247] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:20:11.090092] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-17T03:20:11.890135] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-17T03:20:12.524423] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T03:20:12.690152] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-17T03:20:12.736778] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:20:13.490173] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-17T03:20:14.117064] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T03:20:14.290123] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-17T03:20:14.407390] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:20:15.090159] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-17T03:20:15.890171] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-17T03:20:15.924427] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T03:20:16.486570] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:20:16.690151] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-17T03:20:16.941483] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:20:17.313934] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T03:20:17.490136] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-17T03:20:18.290121] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-17T03:20:18.864175] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T03:20:18.870249] [INFO ] [REMOTE ] DTE: Full fetch complete (69191 records). [2025-09-17T03:20:18.870392] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-17T03:20:18.974298] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T03:20:19.098676] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-17T03:20:19.264953] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-17T03:20:19.265087] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-17T03:20:19.265895] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-17T03:20:19.265975] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-17T03:20:19.267794] [DEBUG] [LOCAL ] DTE: Trimmed 69191 records to 48037 (keeping 200 days of data) [2025-09-17T03:20:19.577440] [DEBUG] [LOCAL ] DTE: Primary data saved (48037 records). [2025-09-17T03:20:19.577599] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-17T03:20:19.577718] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTE took 53.4s. Estimated remaining: 4h 8m 37s. Rate: 6.9 symbols/min [2025-09-17T03:20:19.746028] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:19.753089] [DEBUG] [LOCAL ] DUKB: Loaded 4679 existing records from primary storage. [2025-09-17T03:20:19.753221] [INFO ] [MAIN ] DUKB: Loaded 4679 existing records. [2025-09-17T03:20:19.895204] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-17T03:20:19.930049] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:19.930264] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-17T03:20:19.930317] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-17T03:20:19.930631] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-17T03:20:19.930739] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-17T03:20:20.285208] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:20.690133] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-17T03:20:21.044202] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T03:20:21.088421] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T03:20:21.089913] [INFO ] [REMOTE ] DTW: Full fetch complete (7906 records). [2025-09-17T03:20:21.090007] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-17T03:20:21.469720] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-17T03:20:21.469852] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-17T03:20:21.470103] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-17T03:20:21.470160] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-17T03:20:21.471001] [DEBUG] [LOCAL ] DTW: Trimmed 7906 records to 4921 (keeping 200 days of data) [2025-09-17T03:20:21.494320] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-17T03:20:21.504118] [DEBUG] [LOCAL ] DTW: Primary data saved (4921 records). [2025-09-17T03:20:21.504297] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-17T03:20:21.504401] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTW took 21.8s. Estimated remaining: 4h 8m 10s. Rate: 6.9 symbols/min [2025-09-17T03:20:21.675944] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:21.722504] [DEBUG] [LOCAL ] DV: Loaded 37966 existing records from primary storage. [2025-09-17T03:20:21.722696] [INFO ] [MAIN ] DV: Loaded 37966 existing records. [2025-09-17T03:20:21.903179] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:21.903527] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-17T03:20:21.903634] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-17T03:20:21.904546] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-17T03:20:21.904635] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-17T03:20:22.114107] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T03:20:22.309570] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-11. [2025-09-17T03:20:22.316130] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:22.705544] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T03:20:23.090202] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-17T03:20:23.283307] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T03:20:23.890214] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-17T03:20:24.690130] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-11. [2025-09-17T03:20:24.932833] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:20:25.490168] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-17T03:20:25.837275] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T03:20:26.290184] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-17T03:20:26.366222] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T03:20:27.081249] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T03:20:27.090091] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-17T03:20:27.890150] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-17T03:20:28.362344] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T03:20:28.663894] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:20:28.690076] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-17T03:20:29.097104] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T03:20:29.490144] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-17T03:20:29.957070] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:20:30.290165] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-17T03:20:31.067598] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T03:20:31.090087] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-17T03:20:31.326877] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T03:20:31.832465] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T03:20:31.890180] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-17T03:20:32.690188] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-17T03:20:33.461385] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:20:33.490083] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-17T03:20:34.299478] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-17T03:20:34.317984] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T03:20:34.934489] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T03:20:35.077917] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:20:35.090065] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-17T03:20:35.890137] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-17T03:20:36.537944] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:20:36.543216] [INFO ] [REMOTE ] DTM: Full fetch complete (64714 records). [2025-09-17T03:20:36.543360] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-17T03:20:36.695565] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-17T03:20:36.942432] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-17T03:20:36.942564] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-17T03:20:36.943396] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-17T03:20:36.943472] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-17T03:20:36.946089] [DEBUG] [LOCAL ] DTM: Trimmed 64714 records to 44706 (keeping 200 days of data) [2025-09-17T03:20:37.234271] [DEBUG] [LOCAL ] DTM: Primary data saved (44706 records). [2025-09-17T03:20:37.234436] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-17T03:20:37.234528] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 38.8s. Estimated remaining: 4h 8m 20s. Rate: 6.9 symbols/min [2025-09-17T03:20:37.400490] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:37.431806] [DEBUG] [LOCAL ] DVA: Loaded 30522 existing records from primary storage. [2025-09-17T03:20:37.431973] [INFO ] [MAIN ] DVA: Loaded 30522 existing records. [2025-09-17T03:20:37.499759] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-17T03:20:37.609966] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:37.610239] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-17T03:20:37.610315] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-17T03:20:37.611111] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-17T03:20:37.611182] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-17T03:20:37.962756] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:37.995351] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T03:20:38.231632] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:20:38.290096] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-17T03:20:38.565186] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T03:20:38.717406] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T03:20:39.090142] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-17T03:20:39.713897] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T03:20:39.890141] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-11. [2025-09-17T03:20:40.690139] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-17T03:20:41.423500] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T03:20:41.451552] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T03:20:41.490178] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-17T03:20:42.166670] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T03:20:42.290173] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-17T03:20:42.899994] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T03:20:43.090180] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-17T03:20:43.890207] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-17T03:20:44.433590] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:20:44.434852] [INFO ] [REMOTE ] DUKB: Full fetch complete (9642 records). [2025-09-17T03:20:44.434935] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-17T03:20:44.695331] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-17T03:20:44.795572] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-17T03:20:44.795696] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-17T03:20:44.796007] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-17T03:20:44.796079] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-17T03:20:44.796579] [DEBUG] [LOCAL ] DUKB: Trimmed 9642 records to 6446 (keeping 200 days of data) [2025-09-17T03:20:44.836737] [DEBUG] [LOCAL ] DUKB: Primary data saved (6446 records). [2025-09-17T03:20:44.837074] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-17T03:20:44.837259] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DUKB took 25.3s. Estimated remaining: 4h 8m 8s. Rate: 6.9 symbols/min [2025-09-17T03:20:45.009381] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:45.050861] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T03:20:45.094215] [DEBUG] [LOCAL ] DVN: Loaded 40049 existing records from primary storage. [2025-09-17T03:20:45.094432] [INFO ] [MAIN ] DVN: Loaded 40049 existing records. [2025-09-17T03:20:45.271673] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:45.271943] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-17T03:20:45.272015] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-17T03:20:45.273043] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-17T03:20:45.273107] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-17T03:20:45.495336] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-17T03:20:45.629880] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:46.290151] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-11. [2025-09-17T03:20:46.781154] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T03:20:47.090147] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-17T03:20:47.132117] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:20:47.890129] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-17T03:20:47.940459] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T03:20:48.690180] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-17T03:20:48.965211] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T03:20:49.490198] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-17T03:20:49.621670] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:20:50.145380] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T03:20:50.290194] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-17T03:20:51.090148] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-17T03:20:51.293403] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T03:20:51.300111] [INFO ] [REMOTE ] DUK: Full fetch complete (77264 records). [2025-09-17T03:20:51.300317] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-17T03:20:51.740816] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-17T03:20:51.741006] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-17T03:20:51.741968] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-17T03:20:51.742055] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-17T03:20:51.743911] [DEBUG] [LOCAL ] DUK: Trimmed 77264 records to 53479 (keeping 200 days of data) [2025-09-17T03:20:51.877959] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:20:51.890536] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-17T03:20:52.121361] [DEBUG] [LOCAL ] DUK: Primary data saved (53479 records). [2025-09-17T03:20:52.121525] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-17T03:20:52.121622] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DUK took 46.2s. Estimated remaining: 4h 7m 56s. Rate: 6.9 symbols/min [2025-09-17T03:20:52.293094] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:52.331506] [DEBUG] [LOCAL ] DX: Loaded 39065 existing records from primary storage. [2025-09-17T03:20:52.331695] [INFO ] [MAIN ] DX: Loaded 39065 existing records. [2025-09-17T03:20:52.512889] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:52.513142] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-17T03:20:52.513202] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-17T03:20:52.514063] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-17T03:20:52.514127] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-17T03:20:52.697659] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-17T03:20:52.874089] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:53.490359] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-17T03:20:53.490423] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-11. [2025-09-17T03:20:53.597021] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T03:20:54.290185] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-17T03:20:54.469078] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:20:55.090163] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-17T03:20:55.266185] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T03:20:55.890175] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-17T03:20:56.059762] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:20:56.695730] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-17T03:20:56.708197] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T03:20:57.490182] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-17T03:20:57.950973] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T03:20:58.290196] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-17T03:20:58.515800] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:20:58.705568] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T03:20:59.090173] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-17T03:20:59.890159] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-17T03:21:00.052521] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:21:00.690178] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-17T03:21:00.844809] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T03:21:01.490128] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-17T03:21:02.130300] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T03:21:02.290153] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-17T03:21:02.430884] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T03:21:02.437427] [INFO ] [REMOTE ] DV: Full fetch complete (72929 records). [2025-09-17T03:21:02.437580] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-17T03:21:02.855273] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-17T03:21:02.855508] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-17T03:21:02.856523] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-17T03:21:02.856615] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-17T03:21:02.858398] [DEBUG] [LOCAL ] DV: Trimmed 72929 records to 51294 (keeping 200 days of data) [2025-09-17T03:21:03.091250] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-17T03:21:03.181982] [DEBUG] [LOCAL ] DV: Primary data saved (51294 records). [2025-09-17T03:21:03.182149] [INFO ] [MAIN ] DV: Full history saved. [2025-09-17T03:21:03.182244] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DV took 41.7s. Estimated remaining: 4h 7m 53s. Rate: 6.9 symbols/min [2025-09-17T03:21:03.357417] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:03.400395] [DEBUG] [LOCAL ] DXC: Loaded 37119 existing records from primary storage. [2025-09-17T03:21:03.400581] [INFO ] [MAIN ] DXC: Loaded 37119 existing records. [2025-09-17T03:21:03.588405] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:03.588704] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-17T03:21:03.588767] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-17T03:21:03.589526] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-17T03:21:03.589587] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-17T03:21:03.942615] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:03.942998] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-11. [2025-09-17T03:21:04.244841] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-17T03:21:04.399332] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T03:21:04.690181] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-17T03:21:05.459349] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-17T03:21:05.490118] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-17T03:21:05.940468] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T03:21:06.271905] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:21:06.290085] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-17T03:21:07.090185] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-17T03:21:07.698991] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-17T03:21:07.890190] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-17T03:21:08.020957] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T03:21:08.156542] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T03:21:08.690158] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-17T03:21:09.490140] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-17T03:21:10.051480] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T03:21:10.275500] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T03:21:10.290078] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-17T03:21:11.090193] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-17T03:21:11.398209] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T03:21:11.894911] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-17T03:21:11.900340] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T03:21:12.690147] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-17T03:21:13.130713] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T03:21:13.476083] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:21:13.490081] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-17T03:21:14.290156] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-17T03:21:14.346618] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T03:21:15.090112] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-17T03:21:15.488757] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T03:21:15.890196] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-17T03:21:16.456531] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:21:16.504220] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T03:21:16.690132] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-17T03:21:17.250755] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:21:17.256152] [INFO ] [REMOTE ] DVA: Full fetch complete (59556 records). [2025-09-17T03:21:17.256355] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-17T03:21:17.496670] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-17T03:21:17.649399] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-17T03:21:17.649552] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-17T03:21:17.650364] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-17T03:21:17.650452] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-17T03:21:17.651860] [DEBUG] [LOCAL ] DVA: Trimmed 59556 records to 41816 (keeping 200 days of data) [2025-09-17T03:21:17.908704] [DEBUG] [LOCAL ] DVA: Primary data saved (41816 records). [2025-09-17T03:21:17.908871] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-17T03:21:17.908966] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DVA took 40.7s. Estimated remaining: 4h 7m 59s. Rate: 6.9 symbols/min [2025-09-17T03:21:18.077558] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:18.104510] [DEBUG] [LOCAL ] DXYZ: Loaded 26694 existing records from primary storage. [2025-09-17T03:21:18.104713] [INFO ] [MAIN ] DXYZ: Loaded 26694 existing records. [2025-09-17T03:21:18.280134] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:18.280368] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-17T03:21:18.280426] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-17T03:21:18.281145] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-17T03:21:18.281208] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-17T03:21:18.297971] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-17T03:21:18.641110] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:18.669213] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:21:19.090121] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-17T03:21:19.890136] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-11. [2025-09-17T03:21:20.122095] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-17T03:21:20.382014] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T03:21:20.690136] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-17T03:21:20.767707] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T03:21:21.490140] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-17T03:21:22.262423] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-11 (2.37 seconds). [2025-09-17T03:21:22.290112] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-17T03:21:22.679287] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T03:21:23.090128] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-17T03:21:23.281301] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:21:23.890144] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-17T03:21:24.690136] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-17T03:21:24.788040] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-17T03:21:25.070286] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T03:21:25.442474] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T03:21:25.449215] [INFO ] [REMOTE ] DVN: Full fetch complete (77673 records). [2025-09-17T03:21:25.449409] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-17T03:21:25.495252] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-17T03:21:25.864479] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-17T03:21:25.864633] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-17T03:21:25.865863] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-17T03:21:25.865972] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-17T03:21:25.867784] [DEBUG] [LOCAL ] DVN: Trimmed 77673 records to 53699 (keeping 200 days of data) [2025-09-17T03:21:26.227579] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-17T03:21:26.227773] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-17T03:21:26.227872] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVN took 41.4s. Estimated remaining: 4h 7m 50s. Rate: 6.9 symbols/min [2025-09-17T03:21:26.293460] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-17T03:21:26.404564] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:26.438967] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T03:21:26.466267] [DEBUG] [LOCAL ] DY: Loaded 21107 existing records from primary storage. [2025-09-17T03:21:26.466464] [INFO ] [MAIN ] DY: Loaded 21107 existing records. [2025-09-17T03:21:26.653510] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:26.653804] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-17T03:21:26.653866] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-17T03:21:26.654418] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-17T03:21:26.654480] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-17T03:21:27.018943] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:27.090129] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-17T03:21:27.869934] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T03:21:27.890079] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-17T03:21:28.062155] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T03:21:28.068758] [INFO ] [REMOTE ] DX: Full fetch complete (75034 records). [2025-09-17T03:21:28.068931] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-17T03:21:28.462603] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-17T03:21:28.462845] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-17T03:21:28.463701] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-17T03:21:28.463768] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-17T03:21:28.481755] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:21:28.487746] [DEBUG] [LOCAL ] DX: Trimmed 75034 records to 52464 (keeping 200 days of data) [2025-09-17T03:21:28.488901] [INFO ] [REMOTE ] DXC: Full fetch complete (68029 records). [2025-09-17T03:21:28.489377] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-17T03:21:28.692871] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-11. [2025-09-17T03:21:29.149781] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-17T03:21:29.153619] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-17T03:21:29.154630] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-17T03:21:29.159623] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-17T03:21:29.207776] [DEBUG] [LOCAL ] DXC: Trimmed 68029 records to 49444 (keeping 200 days of data) [2025-09-17T03:21:29.344994] [DEBUG] [LOCAL ] DX: Primary data saved (52464 records). [2025-09-17T03:21:29.346150] [INFO ] [MAIN ] DX: Full history saved. [2025-09-17T03:21:29.346805] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DX took 37.2s. Estimated remaining: 4h 7m 26s. Rate: 6.9 symbols/min [2025-09-17T03:21:29.538047] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:29.541754] [DEBUG] [LOCAL ] E: No existing data file found in primary storage. [2025-09-17T03:21:29.543041] [WARN ] [MAIN ] E: No existing data found, performing full refresh instead. [2025-09-17T03:21:29.545001] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-17T03:21:29.546025] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-17T03:21:29.547794] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-09-17T03:21:29.548847] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-17T03:21:30.004483] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:30.006578] [INFO ] [REMOTE ] E: Fetching primary data for 2024-11. [2025-09-17T03:21:30.075460] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T03:21:30.116792] [DEBUG] [LOCAL ] DXC: Primary data saved (49444 records). [2025-09-17T03:21:30.116929] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-17T03:21:30.117010] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DXC took 26.9s. Estimated remaining: 4h 6m 58s. Rate: 6.9 symbols/min [2025-09-17T03:21:30.290450] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:30.290604] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-17T03:21:30.291259] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-09-17T03:21:30.292431] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-09-17T03:21:30.292578] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-17T03:21:30.292765] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-17T03:21:30.292897] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-17T03:21:30.293151] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-17T03:21:30.467369] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:21:30.685177] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:31.090108] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-17T03:21:31.450707] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:21:31.890167] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-17T03:21:32.267550] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T03:21:32.348029] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T03:21:32.690146] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-11. [2025-09-17T03:21:33.378183] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T03:21:33.490089] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-17T03:21:34.290138] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-17T03:21:34.393544] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:21:34.915492] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:21:35.090179] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-17T03:21:35.890168] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-17T03:21:36.189763] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:21:36.344013] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T03:21:36.690132] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-17T03:21:37.321040] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:21:37.490204] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-17T03:21:38.290192] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-17T03:21:38.643257] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T03:21:39.090241] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-17T03:21:39.139495] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T03:21:39.752944] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T03:21:39.890132] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-17T03:21:40.690115] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-17T03:21:41.036521] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T03:21:41.129870] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:21:41.490147] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-17T03:21:42.124974] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:21:42.290113] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-17T03:21:43.090132] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-17T03:21:43.541565] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T03:21:43.785505] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:21:43.890120] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-17T03:21:44.637335] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T03:21:44.690146] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-17T03:21:45.285333] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:21:45.490135] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-17T03:21:46.290122] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-17T03:21:46.660312] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T03:21:46.743061] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T03:21:47.090168] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-17T03:21:47.895274] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-17T03:21:47.915795] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T03:21:48.522682] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T03:21:48.690203] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-17T03:21:49.380726] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T03:21:49.490184] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-17T03:21:49.948051] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T03:21:50.290135] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-17T03:21:50.823322] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:21:51.090153] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-17T03:21:51.361942] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T03:21:51.890111] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-17T03:21:52.315990] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T03:21:52.690133] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-17T03:21:53.370547] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:21:53.378072] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58530 records). [2025-09-17T03:21:53.378270] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-17T03:21:53.495226] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-17T03:21:53.759531] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-17T03:21:53.759690] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-17T03:21:53.760457] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-17T03:21:53.760535] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-17T03:21:53.761871] [DEBUG] [LOCAL ] DXYZ: Trimmed 58530 records to 36774 (keeping 200 days of data) [2025-09-17T03:21:53.977130] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T03:21:53.982144] [INFO ] [REMOTE ] E: Full fetch complete (48595 records). [2025-09-17T03:21:53.983120] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-17T03:21:54.112396] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36774 records). [2025-09-17T03:21:54.153002] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-17T03:21:54.194893] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DXYZ took 36.3s. Estimated remaining: 4h 7m 28s. Rate: 6.9 symbols/min [2025-09-17T03:21:54.293839] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-17T03:21:54.565983] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:54.566118] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-17T03:21:54.566702] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-17T03:21:54.567358] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-17T03:21:54.567480] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-17T03:21:54.569421] [DEBUG] [LOCAL ] E: Trimmed 48595 records to 33761 (keeping 200 days of data) [2025-09-17T03:21:54.571669] [DEBUG] [LOCAL ] EAI: Loaded 2911 existing records from primary storage. [2025-09-17T03:21:54.572052] [INFO ] [MAIN ] EAI: Loaded 2911 existing records. [2025-09-17T03:21:54.847337] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:54.853980] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-17T03:21:54.855865] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-17T03:21:54.857490] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-17T03:21:54.857583] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-17T03:21:54.951114] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:21:55.099516] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-17T03:21:55.289895] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:55.335172] [DEBUG] [LOCAL ] E: Primary data saved (33761 records). [2025-09-17T03:21:55.335291] [INFO ] [MAIN ] E: Full history saved. [2025-09-17T03:21:55.335370] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. E took 26.0s. Estimated remaining: 4h 6m 60s. Rate: 6.9 symbols/min [2025-09-17T03:21:55.502691] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:55.502843] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-09-17T03:21:55.502896] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-09-17T03:21:55.502998] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-17T03:21:55.503047] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-17T03:21:55.503099] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-17T03:21:55.503142] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-17T03:21:55.852055] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:55.890070] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-11. [2025-09-17T03:21:56.109811] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T03:21:56.516614] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:21:56.690092] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-17T03:21:57.360575] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:21:57.490141] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-17T03:21:57.829697] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T03:21:57.833360] [INFO ] [REMOTE ] DY: Full fetch complete (44807 records). [2025-09-17T03:21:57.833457] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-17T03:21:58.204325] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-17T03:21:58.204422] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-17T03:21:58.204982] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-17T03:21:58.205040] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-17T03:21:58.206013] [DEBUG] [LOCAL ] DY: Trimmed 44807 records to 30199 (keeping 200 days of data) [2025-09-17T03:21:58.295274] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-17T03:21:58.396742] [DEBUG] [LOCAL ] DY: Primary data saved (30199 records). [2025-09-17T03:21:58.396946] [INFO ] [MAIN ] DY: Full history saved. [2025-09-17T03:21:58.397065] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DY took 32.2s. Estimated remaining: 4h 6m 37s. Rate: 6.9 symbols/min [2025-09-17T03:21:58.568037] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:58.568194] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-09-17T03:21:58.568242] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-09-17T03:21:58.568347] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-17T03:21:58.568394] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-17T03:21:58.568441] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-17T03:21:58.568478] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-17T03:21:58.950884] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:58.972129] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:21:59.090134] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-11. [2025-09-17T03:21:59.890135] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-17T03:22:00.054402] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T03:22:00.690147] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-17T03:22:00.788730] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:22:01.398350] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:22:01.490122] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-17T03:22:02.290183] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-11. [2025-09-17T03:22:02.403091] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T03:22:02.873344] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T03:22:02.994462] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T03:22:03.090144] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-17T03:22:03.644020] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T03:22:03.890137] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-17T03:22:04.690198] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-17T03:22:05.490158] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-17T03:22:05.573634] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T03:22:06.096695] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:22:06.290116] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-17T03:22:06.397260] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T03:22:07.090160] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-17T03:22:07.687727] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:22:07.890139] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-17T03:22:08.080707] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:22:08.528282] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T03:22:08.690164] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-17T03:22:09.490149] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-17T03:22:10.273880] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T03:22:10.290101] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-17T03:22:11.090162] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-17T03:22:11.158236] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:22:11.776139] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:22:11.890102] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-17T03:22:12.105433] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:22:12.492965] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T03:22:12.690112] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-17T03:22:13.490134] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-17T03:22:14.290139] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-17T03:22:14.564889] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T03:22:14.709569] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T03:22:14.713881] [INFO ] [REMOTE ] EAF: Full fetch complete (65455 records). [2025-09-17T03:22:14.714018] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-17T03:22:15.099468] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-17T03:22:15.096128] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-17T03:22:15.099604] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-17T03:22:15.101347] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-17T03:22:15.101577] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-17T03:22:15.103356] [DEBUG] [LOCAL ] EAF: Trimmed 65455 records to 44408 (keeping 200 days of data) [2025-09-17T03:22:15.358509] [DEBUG] [LOCAL ] EAF: Primary data saved (44408 records). [2025-09-17T03:22:15.358673] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-17T03:22:15.358770] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. EAF took 45.2s. Estimated remaining: 4h 6m 49s. Rate: 6.9 symbols/min [2025-09-17T03:22:15.535085] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:15.566325] [DEBUG] [LOCAL ] EB: Loaded 27190 existing records from primary storage. [2025-09-17T03:22:15.566516] [INFO ] [MAIN ] EB: Loaded 27190 existing records. [2025-09-17T03:22:15.747480] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:15.748463] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-17T03:22:15.748616] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-17T03:22:15.749424] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-17T03:22:15.768375] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-17T03:22:15.815301] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:22:15.894844] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-17T03:22:16.139366] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:16.323245] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:22:16.690134] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-17T03:22:16.937060] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T03:22:17.292141] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:22:17.490084] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-17T03:22:18.087130] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T03:22:18.290148] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-11. [2025-09-17T03:22:19.090128] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-17T03:22:19.839748] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:22:19.890153] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-17T03:22:20.231182] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T03:22:20.690129] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-17T03:22:21.475241] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T03:22:21.490089] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-17T03:22:21.872341] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:22:22.290143] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-17T03:22:22.783862] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T03:22:22.785127] [INFO ] [REMOTE ] EAI: Full fetch complete (6219 records). [2025-09-17T03:22:22.785213] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-17T03:22:23.093767] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-17T03:22:23.158552] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-17T03:22:23.158728] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-17T03:22:23.159058] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-17T03:22:23.159190] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-17T03:22:23.159815] [DEBUG] [LOCAL ] EAI: Trimmed 6219 records to 4019 (keeping 200 days of data) [2025-09-17T03:22:23.187080] [DEBUG] [LOCAL ] EAI: Primary data saved (4019 records). [2025-09-17T03:22:23.187240] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-17T03:22:23.187487] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAI took 28.9s. Estimated remaining: 4h 6m 38s. Rate: 6.9 symbols/min [2025-09-17T03:22:23.313846] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T03:22:23.404079] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:23.421698] [DEBUG] [LOCAL ] EBF: Loaded 13951 existing records from primary storage. [2025-09-17T03:22:23.421863] [INFO ] [MAIN ] EBF: Loaded 13951 existing records. [2025-09-17T03:22:23.599770] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:23.600051] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-17T03:22:23.600121] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-17T03:22:23.600530] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-17T03:22:23.600587] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-17T03:22:23.895254] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-17T03:22:23.968599] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:24.362396] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:22:24.690126] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-11. [2025-09-17T03:22:25.404781] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:22:25.490124] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-17T03:22:25.768528] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T03:22:26.290188] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-17T03:22:26.677311] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T03:22:27.090161] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-17T03:22:27.332716] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:22:27.890219] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-17T03:22:28.607182] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T03:22:28.690093] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-17T03:22:29.490147] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-17T03:22:29.813879] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T03:22:30.275846] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:22:30.290076] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-17T03:22:30.491369] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T03:22:31.090164] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-17T03:22:31.693918] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:22:31.890114] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-17T03:22:32.690155] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-17T03:22:32.839835] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T03:22:32.896503] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T03:22:33.481799] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:22:33.485568] [INFO ] [REMOTE ] EARN: Full fetch complete (47111 records). [2025-09-17T03:22:33.485733] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-17T03:22:33.497466] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-17T03:22:33.868275] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-17T03:22:33.868406] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-17T03:22:33.869121] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-17T03:22:33.869215] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-17T03:22:33.870392] [DEBUG] [LOCAL ] EARN: Trimmed 47111 records to 30932 (keeping 200 days of data) [2025-09-17T03:22:34.059496] [DEBUG] [LOCAL ] EARN: Primary data saved (30932 records). [2025-09-17T03:22:34.059740] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-17T03:22:34.059873] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EARN took 38.7s. Estimated remaining: 4h 6m 34s. Rate: 6.9 symbols/min [2025-09-17T03:22:34.230788] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:34.268880] [DEBUG] [LOCAL ] EBR: Loaded 31640 existing records from primary storage. [2025-09-17T03:22:34.269134] [INFO ] [MAIN ] EBR: Loaded 31640 existing records. [2025-09-17T03:22:34.303478] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-17T03:22:34.473261] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:34.473609] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-17T03:22:34.473724] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-17T03:22:34.474608] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-17T03:22:34.474760] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-17T03:22:34.885223] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:35.090146] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-11. [2025-09-17T03:22:35.392138] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T03:22:35.895800] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-17T03:22:35.906061] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T03:22:36.337597] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T03:22:36.690131] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-17T03:22:37.490111] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-17T03:22:37.642535] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T03:22:37.778297] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T03:22:38.290167] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-17T03:22:38.935398] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T03:22:39.090163] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-17T03:22:39.890533] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T03:22:39.890614] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-17T03:22:40.648094] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:22:40.656257] [INFO ] [REMOTE ] EAT: Full fetch complete (71417 records). [2025-09-17T03:22:40.656427] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-17T03:22:40.700128] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-17T03:22:41.045372] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-17T03:22:41.045488] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-17T03:22:41.046310] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-17T03:22:41.046379] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-17T03:22:41.047931] [DEBUG] [LOCAL ] EAT: Trimmed 71417 records to 49816 (keeping 200 days of data) [2025-09-17T03:22:41.289604] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:22:41.301010] [INFO ] [REMOTE ] EB: Full fetch complete (57222 records). [2025-09-17T03:22:41.304786] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-17T03:22:41.514247] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-17T03:22:41.795058] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-17T03:22:41.795146] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-17T03:22:41.795922] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-17T03:22:41.780835] [DEBUG] [LOCAL ] EAT: Primary data saved (49816 records). [2025-09-17T03:22:41.796127] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-17T03:22:41.796025] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-17T03:22:41.796325] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAT took 43.4s. Estimated remaining: 4h 6m 23s. Rate: 6.9 symbols/min [2025-09-17T03:22:41.798269] [DEBUG] [LOCAL ] EB: Trimmed 57222 records to 38243 (keeping 200 days of data) [2025-09-17T03:22:41.896118] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T03:22:42.041190] [DEBUG] [LOCAL ] EB: Primary data saved (38243 records). [2025-09-17T03:22:42.041376] [INFO ] [MAIN ] EB: Full history saved. [2025-09-17T03:22:42.041475] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EB took 26.7s. Estimated remaining: 4h 5m 53s. Rate: 6.9 symbols/min [2025-09-17T03:22:42.290142] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-17T03:22:43.198852] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:22:43.209079] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-17T03:22:43.418486] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:22:43.890188] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-17T03:22:44.744121] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:22:44.751884] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-17T03:22:45.001356] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T03:22:45.490138] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-17T03:22:46.379737] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:22:46.389515] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-17T03:22:46.636849] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T03:22:47.090137] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-17T03:22:47.997129] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T03:22:48.007069] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-17T03:22:48.249088] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T03:22:48.690187] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-17T03:22:49.488129] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:22:49.492889] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-17T03:22:49.519329] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:22:50.154405] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:22:50.159444] [INFO ] [REMOTE ] EBF: Full fetch complete (27222 records). [2025-09-17T03:22:50.159635] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-17T03:22:50.295229] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-17T03:22:50.546551] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-17T03:22:50.546678] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-17T03:22:50.547200] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-17T03:22:50.547270] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-17T03:22:50.548022] [DEBUG] [LOCAL ] EBF: Trimmed 27222 records to 19671 (keeping 200 days of data) [2025-09-17T03:22:50.675680] [DEBUG] [LOCAL ] EBF: Primary data saved (19671 records). [2025-09-17T03:22:50.675867] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-17T03:22:50.675992] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EBF took 27.5s. Estimated remaining: 4h 5m 44s. Rate: 6.9 symbols/min [2025-09-17T03:22:51.896525] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T03:22:51.905182] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-17T03:22:53.483344] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:22:53.492943] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-17T03:22:54.796773] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T03:22:54.806490] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-17T03:22:56.252613] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:22:56.258008] [INFO ] [REMOTE ] EBR: Full fetch complete (62675 records). [2025-09-17T03:22:56.258138] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-17T03:22:56.655069] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-17T03:22:56.655184] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-17T03:22:56.655999] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-17T03:22:56.656074] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-17T03:22:56.657440] [DEBUG] [LOCAL ] EBR: Trimmed 62675 records to 43127 (keeping 200 days of data) [2025-09-17T03:22:56.921436] [DEBUG] [LOCAL ] EBR: Primary data saved (43127 records). [2025-09-17T03:22:56.921599] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-17T03:22:56.921725] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EBR took 22.9s. Estimated remaining: 4h 5m 29s. Rate: 6.9 symbols/min [2025-09-17T03:22:57.602820] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.605747] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.626559] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.628909] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.685158] [DEBUG] [LOCAL ] ECAT: Loaded 21933 existing records from primary storage. [2025-09-17T03:22:57.685532] [INFO ] [MAIN ] ECAT: Loaded 21933 existing records. [2025-09-17T03:22:57.756847] [DEBUG] [LOCAL ] ECC: Loaded 31843 existing records from primary storage. [2025-09-17T03:22:57.782240] [INFO ] [MAIN ] ECC: Loaded 31843 existing records. [2025-09-17T03:22:57.805631] [DEBUG] [LOCAL ] EBS: Loaded 35107 existing records from primary storage. [2025-09-17T03:22:57.854898] [INFO ] [MAIN ] EBS: Loaded 35107 existing records. [2025-09-17T03:22:57.820721] [DEBUG] [LOCAL ] EC: Loaded 36426 existing records from primary storage. [2025-09-17T03:22:57.903781] [INFO ] [MAIN ] EC: Loaded 36426 existing records. [2025-09-17T03:22:58.296924] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.305375] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.439418] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.460577] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-17T03:22:58.461329] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.420325] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.464753] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.464840] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-17T03:22:58.464396] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-17T03:22:58.464527] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.465134] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.465194] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-17T03:22:58.465569] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-17T03:22:58.465675] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-17T03:22:58.477198] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-17T03:22:58.465710] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-17T03:22:58.477453] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-17T03:22:58.477396] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-17T03:22:58.470945] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-17T03:22:58.507627] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-17T03:22:59.856389] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.925453] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-11. [2025-09-17T03:22:59.925159] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.914765] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.946687] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-11. [2025-09-17T03:22:59.947159] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-11. [2025-09-17T03:22:59.984556] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.984960] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-11. [2025-09-17T03:23:01.073686] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T03:23:01.078581] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-17T03:23:01.550954] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:23:01.559321] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-17T03:23:02.336212] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T03:23:02.341899] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-17T03:23:03.128187] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:23:03.137520] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-17T03:23:07.051588] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-11 (7.10 seconds). [2025-09-17T03:23:07.080886] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-17T03:23:07.083156] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (3.95 seconds). [2025-09-17T03:23:07.091126] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-17T03:23:07.747130] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (5.41 seconds). [2025-09-17T03:23:07.754012] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-17T03:23:08.006904] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-11 (8.02 seconds). [2025-09-17T03:23:08.016956] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-17T03:23:08.160764] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T03:23:08.168361] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-17T03:23:08.759928] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:23:08.770237] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-17T03:23:08.985416] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T03:23:08.991657] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-17T03:23:09.615142] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:23:09.624843] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-17T03:23:09.869497] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:23:09.879824] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-17T03:23:10.369271] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:23:10.376349] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-17T03:23:10.402409] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T03:23:10.412054] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-17T03:23:11.419994] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:23:11.430169] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-17T03:23:11.723967] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T03:23:11.734520] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-17T03:23:11.752684] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:23:11.759608] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-17T03:23:11.824945] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:23:11.835890] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-17T03:23:12.994464] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:23:13.001181] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-17T03:23:13.208079] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:23:13.217166] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-17T03:23:13.448600] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:23:13.490081] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-17T03:23:13.568172] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:23:14.115847] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T03:23:14.290156] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-17T03:23:14.644435] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:23:15.090160] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-17T03:23:15.136317] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T03:23:15.305841] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T03:23:15.890180] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-17T03:23:16.533170] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T03:23:16.690128] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-17T03:23:17.471346] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:23:17.490087] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-17T03:23:17.722701] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T03:23:18.290157] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-17T03:23:19.090094] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-17T03:23:19.176144] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T03:23:19.890195] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-17T03:23:20.237211] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T03:23:20.474263] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:23:20.690208] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-17T03:23:21.125186] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:23:21.131561] [INFO ] [REMOTE ] ECAT: Full fetch complete (42090 records). [2025-09-17T03:23:21.131765] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-17T03:23:21.495287] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-17T03:23:21.510749] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-17T03:23:21.510833] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-17T03:23:21.511455] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-17T03:23:21.511510] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-17T03:23:21.512550] [DEBUG] [LOCAL ] ECAT: Trimmed 42090 records to 29887 (keeping 200 days of data) [2025-09-17T03:23:21.699142] [DEBUG] [LOCAL ] ECAT: Primary data saved (29887 records). [2025-09-17T03:23:21.699330] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-17T03:23:21.699427] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. ECAT took 24.8s. Estimated remaining: 4h 6m 0s. Rate: 6.9 symbols/min [2025-09-17T03:23:21.869247] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:21.869444] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-17T03:23:21.869493] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-17T03:23:21.869604] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-17T03:23:21.869673] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-17T03:23:21.869726] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-17T03:23:21.869764] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-17T03:23:22.226895] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:22.290153] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-11. [2025-09-17T03:23:22.557140] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T03:23:22.651082] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T03:23:23.052380] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:23:23.058750] [INFO ] [REMOTE ] ECC: Full fetch complete (60971 records). [2025-09-17T03:23:23.058992] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-17T03:23:23.095228] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-17T03:23:23.480782] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-17T03:23:23.480955] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-17T03:23:23.482075] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-17T03:23:23.482142] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-17T03:23:23.484103] [DEBUG] [LOCAL ] ECC: Trimmed 60971 records to 43407 (keeping 200 days of data) [2025-09-17T03:23:23.769445] [DEBUG] [LOCAL ] ECC: Primary data saved (43407 records). [2025-09-17T03:23:23.769725] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-17T03:23:23.769894] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. ECC took 26.8s. Estimated remaining: 4h 5m 35s. Rate: 6.9 symbols/min [2025-09-17T03:23:23.895281] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-17T03:23:23.978768] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:23.982413] [DEBUG] [LOCAL ] ECCU: Loaded 1691 existing records from primary storage. [2025-09-17T03:23:23.982586] [INFO ] [MAIN ] ECCU: Loaded 1691 existing records. [2025-09-17T03:23:24.181606] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:23:24.181958] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-17T03:23:24.182051] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-17T03:23:24.182320] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-09-17T03:23:24.182394] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-17T03:23:24.412578] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T03:23:24.576186] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:24.690183] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-17T03:23:24.934082] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:23:24.977592] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T03:23:25.490159] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-17T03:23:26.290202] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-17T03:23:26.643608] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T03:23:27.098091] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-17T03:23:27.101214] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:23:27.466560] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T03:23:27.890201] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-17T03:23:28.262030] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T03:23:28.690170] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-17T03:23:29.191891] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T03:23:29.490207] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-17T03:23:29.841749] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:23:30.290163] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-17T03:23:31.090167] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-17T03:23:31.434028] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T03:23:31.890113] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-17T03:23:32.019387] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T03:23:32.690235] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-11. [2025-09-17T03:23:32.903873] [DEBUG] [REMOTE ] ECCU: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:23:32.904218] [WARN ] [REMOTE ] ECCU: No data returned for month 2024-11 [2025-09-17T03:23:33.490184] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-17T03:23:33.767015] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T03:23:33.779982] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-17T03:23:34.290152] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-17T03:23:35.090190] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-17T03:23:35.518581] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T03:23:35.890178] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-17T03:23:36.002512] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T03:23:36.690170] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-17T03:23:37.277617] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:23:37.490143] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-17T03:23:37.665077] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T03:23:37.838565] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T03:23:37.839414] [INFO ] [REMOTE ] ECCC: Full fetch complete (1286 records). [2025-09-17T03:23:37.839502] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-17T03:23:38.044792] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T03:23:38.044996] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:23:38.045049] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:23:38.045094] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-17T03:23:38.045170] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-17T03:23:38.045220] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-17T03:23:38.045292] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-17T03:23:38.045372] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. ECCC took 16.3s. Estimated remaining: 4h 5m 40s. Rate: 6.9 symbols/min [2025-09-17T03:23:38.222138] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:38.222372] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-17T03:23:38.222424] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-17T03:23:38.222547] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-17T03:23:38.222602] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-17T03:23:38.222674] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-17T03:23:38.222726] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-17T03:23:38.295334] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-17T03:23:38.602352] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:38.897237] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:23:39.090162] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-17T03:23:39.758221] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T03:23:39.890179] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-17T03:23:40.690138] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-17T03:23:41.254041] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T03:23:41.420859] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:23:41.427628] [INFO ] [REMOTE ] EC: Full fetch complete (71867 records). [2025-09-17T03:23:41.427891] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-17T03:23:41.495235] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-11. [2025-09-17T03:23:41.846324] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-17T03:23:41.846491] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-17T03:23:41.847295] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-17T03:23:41.847355] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-17T03:23:41.848787] [DEBUG] [LOCAL ] EC: Trimmed 71867 records to 49499 (keeping 200 days of data) [2025-09-17T03:23:41.917300] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T03:23:42.145543] [DEBUG] [LOCAL ] EC: Primary data saved (49499 records). [2025-09-17T03:23:42.145719] [INFO ] [MAIN ] EC: Full history saved. [2025-09-17T03:23:42.145818] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EC took 45.2s. Estimated remaining: 4h 5m 20s. Rate: 6.9 symbols/min [2025-09-17T03:23:42.297808] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-17T03:23:42.317412] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:42.318289] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-17T03:23:42.318345] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-17T03:23:42.318456] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-17T03:23:42.318506] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-17T03:23:42.318557] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-17T03:23:42.318595] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-17T03:23:42.692155] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:42.737425] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T03:23:43.090227] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-11. [2025-09-17T03:23:43.445087] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T03:23:43.890188] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-17T03:23:44.349769] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:23:44.690198] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-17T03:23:45.156739] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:23:45.490233] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-17T03:23:45.886477] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-17T03:23:46.290173] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-17T03:23:46.642457] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T03:23:47.090159] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-17T03:23:47.497448] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T03:23:47.890139] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-17T03:23:48.393701] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T03:23:48.690195] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-17T03:23:49.042134] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T03:23:49.490146] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-17T03:23:49.931811] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T03:23:50.290132] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-17T03:23:51.090155] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-17T03:23:51.545992] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T03:23:51.785222] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T03:23:51.790994] [INFO ] [REMOTE ] EBS: Full fetch complete (67266 records). [2025-09-17T03:23:51.791143] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-17T03:23:51.895391] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-17T03:23:52.207093] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-17T03:23:52.207280] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-17T03:23:52.208267] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-17T03:23:52.208363] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-17T03:23:52.210244] [DEBUG] [LOCAL ] EBS: Trimmed 67266 records to 47015 (keeping 200 days of data) [2025-09-17T03:23:52.310058] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T03:23:52.323745] [INFO ] [REMOTE ] ECCU: Full fetch complete (4370 records). [2025-09-17T03:23:52.330419] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-17T03:23:52.573211] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-17T03:23:52.582173] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:23:52.608958] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:23:52.609937] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-17T03:23:52.610631] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-17T03:23:52.611582] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-17T03:23:52.612948] [DEBUG] [LOCAL ] ECCU: Deleted derivative data file. [2025-09-17T03:23:52.613401] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCU took 28.8s. Estimated remaining: 4h 5m 15s. Rate: 6.9 symbols/min [2025-09-17T03:23:52.691303] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-17T03:23:52.819964] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:52.851792] [DEBUG] [LOCAL ] ECG: Loaded 24286 existing records from primary storage. [2025-09-17T03:23:52.852768] [INFO ] [MAIN ] ECG: Loaded 24286 existing records. [2025-09-17T03:23:53.081541] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:23:53.084368] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-17T03:23:53.084757] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-17T03:23:53.086911] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-17T03:23:53.087330] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-17T03:23:53.088565] [DEBUG] [LOCAL ] EBS: Primary data saved (47015 records). [2025-09-17T03:23:53.146146] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-17T03:23:53.181211] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. EBS took 56.3s. Estimated remaining: 4h 4m 47s. Rate: 6.9 symbols/min [2025-09-17T03:23:53.170750] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T03:23:53.492173] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-17T03:23:53.556356] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:53.648636] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:53.673793] [DEBUG] [LOCAL ] ECL: Loaded 34316 existing records from primary storage. [2025-09-17T03:23:53.673962] [INFO ] [MAIN ] ECL: Loaded 34316 existing records. [2025-09-17T03:23:53.852056] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:23:53.852299] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-17T03:23:53.852357] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-17T03:23:53.853255] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-17T03:23:53.853319] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-17T03:23:53.953708] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:23:54.213735] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:54.290124] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-11. [2025-09-17T03:23:55.090133] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-17T03:23:55.437883] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:23:55.890139] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-17T03:23:55.958832] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T03:23:56.322714] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T03:23:56.690183] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-11. [2025-09-17T03:23:57.490133] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-17T03:23:58.245708] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T03:23:58.290133] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-17T03:23:58.752125] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T03:23:59.090161] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-17T03:23:59.435759] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-17T03:23:59.759940] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:23:59.890097] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-17T03:24:00.690145] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-17T03:24:01.030341] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T03:24:01.283077] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:24:01.490127] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-17T03:24:01.873145] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T03:24:02.290140] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-17T03:24:03.090161] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-17T03:24:03.890132] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-17T03:24:04.545135] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T03:24:04.690093] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-17T03:24:05.067247] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T03:24:05.116160] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-17T03:24:05.176418] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T03:24:05.490147] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-17T03:24:06.290142] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-17T03:24:06.632064] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T03:24:07.090172] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-17T03:24:07.208582] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T03:24:07.443494] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T03:24:07.890138] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-17T03:24:08.690145] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-17T03:24:09.078578] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:24:09.079498] [INFO ] [REMOTE ] ECCX: Full fetch complete (1499 records). [2025-09-17T03:24:09.079628] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-17T03:24:09.270521] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T03:24:09.270919] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:24:09.270972] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:24:09.271017] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-17T03:24:09.271097] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-17T03:24:09.271169] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-17T03:24:09.271258] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-17T03:24:09.271344] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECCX took 27.1s. Estimated remaining: 4h 4m 56s. Rate: 6.9 symbols/min [2025-09-17T03:24:09.471359] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:09.494968] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-17T03:24:09.504897] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T03:24:09.519702] [DEBUG] [LOCAL ] ECO: Loaded 13314 existing records from primary storage. [2025-09-17T03:24:09.519879] [INFO ] [MAIN ] ECO: Loaded 13314 existing records. [2025-09-17T03:24:09.721232] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:09.721497] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-17T03:24:09.721565] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-17T03:24:09.722203] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-17T03:24:09.722268] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-17T03:24:10.178043] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:10.290148] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-17T03:24:11.090167] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-11. [2025-09-17T03:24:11.419546] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T03:24:11.457359] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:24:11.890157] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-17T03:24:12.339065] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T03:24:12.690213] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-17T03:24:13.490214] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-17T03:24:13.761314] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T03:24:13.925161] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T03:24:14.084335] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T03:24:14.290174] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-17T03:24:15.090162] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-17T03:24:15.890147] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-17T03:24:16.094172] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:24:16.240665] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T03:24:16.241460] [INFO ] [REMOTE ] ECCW: Full fetch complete (1408 records). [2025-09-17T03:24:16.241544] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-17T03:24:16.429957] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-17T03:24:16.430242] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:24:16.430312] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:24:16.430361] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-17T03:24:16.430432] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-17T03:24:16.430480] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-17T03:24:16.430534] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-17T03:24:16.430615] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCW took 38.4s. Estimated remaining: 4h 4m 43s. Rate: 6.9 symbols/min [2025-09-17T03:24:16.615560] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:16.642448] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T03:24:16.681333] [DEBUG] [LOCAL ] ECVT: Loaded 32031 existing records from primary storage. [2025-09-17T03:24:16.681507] [INFO ] [MAIN ] ECVT: Loaded 32031 existing records. [2025-09-17T03:24:16.695215] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-17T03:24:16.892067] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:16.892344] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-17T03:24:16.892407] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-17T03:24:16.893186] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-17T03:24:16.893261] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-17T03:24:17.272225] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:17.490133] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-17T03:24:18.043599] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T03:24:18.290137] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-17T03:24:18.762322] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:24:19.055880] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:24:19.090140] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-17T03:24:19.890124] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-11. [2025-09-17T03:24:20.447354] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:24:20.690136] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-17T03:24:21.490150] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-17T03:24:22.216697] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-11 (2.33 seconds). [2025-09-17T03:24:22.290151] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-17T03:24:22.546784] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:24:23.090134] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-17T03:24:23.333075] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:24:23.382931] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T03:24:23.890137] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-17T03:24:24.225505] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:24:24.690127] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-17T03:24:25.490143] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-17T03:24:25.529914] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T03:24:26.023949] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T03:24:26.290121] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-17T03:24:26.928788] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:24:27.090175] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-17T03:24:27.661898] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:24:27.890176] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-17T03:24:28.237500] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:24:28.241599] [INFO ] [REMOTE ] ECG: Full fetch complete (51764 records). [2025-09-17T03:24:28.241809] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-17T03:24:28.658667] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-17T03:24:28.658803] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-17T03:24:28.659850] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-17T03:24:28.659941] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-17T03:24:28.661174] [DEBUG] [LOCAL ] ECG: Trimmed 51764 records to 34791 (keeping 200 days of data) [2025-09-17T03:24:28.712165] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-17T03:24:28.869183] [DEBUG] [LOCAL ] ECG: Primary data saved (34791 records). [2025-09-17T03:24:28.869358] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-17T03:24:28.869472] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECG took 36.3s. Estimated remaining: 4h 4m 44s. Rate: 6.9 symbols/min [2025-09-17T03:24:29.039542] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:29.081218] [DEBUG] [LOCAL ] ED: Loaded 39343 existing records from primary storage. [2025-09-17T03:24:29.081460] [INFO ] [MAIN ] ED: Loaded 39343 existing records. [2025-09-17T03:24:29.272060] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:29.272350] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-17T03:24:29.272409] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-17T03:24:29.273415] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-17T03:24:29.273478] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-17T03:24:29.500464] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-17T03:24:29.660929] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:29.686683] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T03:24:29.803625] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T03:24:30.290151] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-11. [2025-09-17T03:24:31.090352] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-17T03:24:31.145396] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T03:24:31.152356] [INFO ] [REMOTE ] ECL: Full fetch complete (67252 records). [2025-09-17T03:24:31.152533] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-17T03:24:31.549838] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-17T03:24:31.549954] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-17T03:24:31.550740] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-17T03:24:31.550800] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-17T03:24:31.552126] [DEBUG] [LOCAL ] ECL: Trimmed 67252 records to 46722 (keeping 200 days of data) [2025-09-17T03:24:31.865732] [DEBUG] [LOCAL ] ECL: Primary data saved (46722 records). [2025-09-17T03:24:31.865923] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-17T03:24:31.866041] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECL took 38.7s. Estimated remaining: 4h 4m 21s. Rate: 6.9 symbols/min [2025-09-17T03:24:31.899149] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-17T03:24:32.061783] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:32.116279] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T03:24:32.137959] [DEBUG] [LOCAL ] EDD: Loaded 20209 existing records from primary storage. [2025-09-17T03:24:32.138130] [INFO ] [MAIN ] EDD: Loaded 20209 existing records. [2025-09-17T03:24:32.317278] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:32.326983] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-17T03:24:32.327818] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T03:24:32.327864] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-17T03:24:32.332367] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-17T03:24:32.332437] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-17T03:24:32.705797] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-17T03:24:32.712634] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:33.490139] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-11. [2025-09-17T03:24:33.557342] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T03:24:33.855402] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T03:24:34.290167] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-17T03:24:34.624871] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T03:24:35.090156] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-17T03:24:35.890178] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-17T03:24:36.114807] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:24:36.397381] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T03:24:36.575601] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T03:24:36.690130] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-17T03:24:37.490175] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-17T03:24:37.874108] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:24:38.290143] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-17T03:24:38.978501] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:24:39.090136] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-17T03:24:39.417011] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T03:24:39.890112] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-17T03:24:40.189845] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:24:40.690165] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-17T03:24:41.490158] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-17T03:24:41.712461] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:24:41.875965] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:24:42.290129] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-17T03:24:42.430093] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:24:42.432717] [INFO ] [REMOTE ] ECO: Full fetch complete (29635 records). [2025-09-17T03:24:42.432844] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-17T03:24:42.803936] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-17T03:24:42.804041] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-17T03:24:42.804555] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-17T03:24:42.804624] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-17T03:24:42.805494] [DEBUG] [LOCAL ] ECO: Trimmed 29635 records to 18701 (keeping 200 days of data) [2025-09-17T03:24:42.920577] [DEBUG] [LOCAL ] ECO: Primary data saved (18701 records). [2025-09-17T03:24:42.920903] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-17T03:24:42.921020] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECO took 33.6s. Estimated remaining: 4h 4m 18s. Rate: 6.9 symbols/min [2025-09-17T03:24:43.099104] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-17T03:24:43.101867] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:43.113665] [DEBUG] [LOCAL ] EDF: Loaded 9544 existing records from primary storage. [2025-09-17T03:24:43.113824] [INFO ] [MAIN ] EDF: Loaded 9544 existing records. [2025-09-17T03:24:43.291687] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:43.291950] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-17T03:24:43.292025] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-17T03:24:43.292413] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-17T03:24:43.292483] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-17T03:24:43.648106] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:43.662363] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:24:43.890114] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-17T03:24:44.690104] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-11. [2025-09-17T03:24:44.796777] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:24:45.087223] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:24:45.490159] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-17T03:24:45.525356] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T03:24:46.290166] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-17T03:24:47.051263] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:24:47.090172] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-17T03:24:47.359264] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:24:47.890146] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-17T03:24:48.690141] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-17T03:24:49.020319] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:24:49.442340] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T03:24:49.492863] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-17T03:24:49.496333] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:24:50.290140] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-17T03:24:50.891529] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:24:51.090152] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-17T03:24:51.890132] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-17T03:24:52.191943] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:24:52.314219] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:24:52.480837] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:24:52.690129] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-17T03:24:53.490160] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-17T03:24:54.290199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-17T03:24:54.567372] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T03:24:54.591397] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T03:24:54.595365] [INFO ] [REMOTE ] EDD: Full fetch complete (38935 records). [2025-09-17T03:24:54.595459] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-17T03:24:54.988901] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-17T03:24:54.989095] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-17T03:24:54.989706] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-17T03:24:54.989810] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-17T03:24:55.001810] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T03:24:55.001928] [DEBUG] [LOCAL ] EDD: Trimmed 38935 records to 27136 (keeping 200 days of data) [2025-09-17T03:24:55.096188] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-17T03:24:55.174198] [DEBUG] [LOCAL ] EDD: Primary data saved (27136 records). [2025-09-17T03:24:55.174363] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-17T03:24:55.174497] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. EDD took 23.3s. Estimated remaining: 4h 4m 18s. Rate: 6.9 symbols/min [2025-09-17T03:24:55.344503] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:55.358682] [DEBUG] [LOCAL ] EDN: Loaded 13047 existing records from primary storage. [2025-09-17T03:24:55.358835] [INFO ] [MAIN ] EDN: Loaded 13047 existing records. [2025-09-17T03:24:55.536345] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:55.536618] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-17T03:24:55.536701] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-17T03:24:55.537145] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-17T03:24:55.537205] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-17T03:24:55.892260] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-17T03:24:55.896354] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:56.690191] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-17T03:24:56.744549] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T03:24:56.933713] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:24:57.490207] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-17T03:24:58.224531] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T03:24:58.290154] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-17T03:24:58.488540] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T03:24:59.090161] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-17T03:24:59.754330] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T03:24:59.760981] [INFO ] [REMOTE ] ECVT: Full fetch complete (59685 records). [2025-09-17T03:24:59.761280] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-17T03:24:59.895348] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-11. [2025-09-17T03:25:00.140492] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T03:25:00.178884] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-17T03:25:00.179321] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-17T03:25:00.180268] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-17T03:25:00.180340] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-17T03:25:00.181602] [DEBUG] [LOCAL ] ECVT: Trimmed 59685 records to 43110 (keeping 200 days of data) [2025-09-17T03:25:00.442336] [DEBUG] [LOCAL ] ECVT: Primary data saved (43110 records). [2025-09-17T03:25:00.442540] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-17T03:25:00.442698] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. ECVT took 44.0s. Estimated remaining: 4h 4m 1s. Rate: 6.9 symbols/min [2025-09-17T03:25:00.615240] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:00.648560] [DEBUG] [LOCAL ] EDU: Loaded 32909 existing records from primary storage. [2025-09-17T03:25:00.648745] [INFO ] [MAIN ] EDU: Loaded 32909 existing records. [2025-09-17T03:25:00.702439] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-17T03:25:00.827168] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:00.827399] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-17T03:25:00.827465] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-17T03:25:00.828203] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-17T03:25:00.828273] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-17T03:25:01.178977] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:01.251231] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:25:01.343605] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T03:25:01.490112] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-11. [2025-09-17T03:25:02.290149] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-17T03:25:03.090144] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-17T03:25:03.169751] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T03:25:03.250419] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T03:25:03.890187] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-17T03:25:04.455994] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:25:04.690275] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-17T03:25:05.490199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-17T03:25:05.800515] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T03:25:06.255574] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:25:06.290192] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-17T03:25:06.382299] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T03:25:07.090130] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-17T03:25:07.857711] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T03:25:07.859825] [INFO ] [REMOTE ] EDF: Full fetch complete (20899 records). [2025-09-17T03:25:07.859947] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-17T03:25:07.895235] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-17T03:25:08.250743] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-17T03:25:08.250931] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-17T03:25:08.251383] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-17T03:25:08.251516] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-17T03:25:08.252270] [DEBUG] [LOCAL ] EDF: Trimmed 20899 records to 13446 (keeping 200 days of data) [2025-09-17T03:25:08.352402] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T03:25:08.385484] [DEBUG] [LOCAL ] EDF: Primary data saved (13446 records). [2025-09-17T03:25:08.385679] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-17T03:25:08.385817] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. EDF took 25.5s. Estimated remaining: 4h 3m 50s. Rate: 6.9 symbols/min [2025-09-17T03:25:08.558268] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:08.582410] [DEBUG] [LOCAL ] EE: Loaded 24150 existing records from primary storage. [2025-09-17T03:25:08.582610] [INFO ] [MAIN ] EE: Loaded 24150 existing records. [2025-09-17T03:25:08.695256] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-17T03:25:08.764388] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:08.764684] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-17T03:25:08.764760] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-17T03:25:08.765361] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-17T03:25:08.765426] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-17T03:25:09.177343] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:09.490162] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-17T03:25:09.618960] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T03:25:10.290176] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-17T03:25:10.563696] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T03:25:10.571043] [INFO ] [REMOTE ] ED: Full fetch complete (76198 records). [2025-09-17T03:25:10.571216] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-17T03:25:10.970134] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-17T03:25:10.970359] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-17T03:25:10.971319] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-17T03:25:10.971533] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-17T03:25:10.973350] [DEBUG] [LOCAL ] ED: Trimmed 76198 records to 52817 (keeping 200 days of data) [2025-09-17T03:25:11.059519] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T03:25:11.092865] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-11. [2025-09-17T03:25:11.344416] [DEBUG] [LOCAL ] ED: Primary data saved (52817 records). [2025-09-17T03:25:11.344628] [INFO ] [MAIN ] ED: Full history saved. [2025-09-17T03:25:11.344753] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. ED took 42.5s. Estimated remaining: 4h 3m 27s. Rate: 6.9 symbols/min [2025-09-17T03:25:11.519320] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:11.523413] [DEBUG] [LOCAL ] EEA: Loaded 1988 existing records from primary storage. [2025-09-17T03:25:11.523542] [INFO ] [MAIN ] EEA: Loaded 1988 existing records. [2025-09-17T03:25:11.713367] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:11.713725] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-17T03:25:11.713792] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-17T03:25:11.714075] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-17T03:25:11.714140] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-17T03:25:11.896216] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-17T03:25:12.074589] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:12.102869] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T03:25:12.365010] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:25:12.690140] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-11. [2025-09-17T03:25:12.793454] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T03:25:13.136566] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T03:25:13.490140] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-17T03:25:14.290123] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-17T03:25:14.573216] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T03:25:15.090145] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-17T03:25:15.611474] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T03:25:15.630000] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T03:25:15.890140] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-17T03:25:16.690155] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-17T03:25:17.004737] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T03:25:17.190775] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:25:17.490151] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-17T03:25:17.865764] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T03:25:18.290127] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-17T03:25:19.090120] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-17T03:25:19.468582] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:25:19.890138] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-17T03:25:20.484937] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T03:25:20.690165] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-17T03:25:20.814681] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T03:25:21.024274] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-17T03:25:21.490138] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-17T03:25:21.977371] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T03:25:22.290138] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-17T03:25:23.090087] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-17T03:25:23.438305] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:25:23.438736] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:25:23.890180] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-17T03:25:24.690148] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-17T03:25:25.490099] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-17T03:25:25.593574] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T03:25:25.899596] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-17T03:25:26.051373] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T03:25:26.290131] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-17T03:25:27.090134] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-17T03:25:27.310943] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:25:27.890188] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-17T03:25:28.339663] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T03:25:28.400033] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T03:25:28.690128] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-17T03:25:29.490220] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-17T03:25:30.290200] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-17T03:25:30.365706] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T03:25:30.495244] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T03:25:30.595312] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T03:25:30.596190] [INFO ] [REMOTE ] EEA: Full fetch complete (3985 records). [2025-09-17T03:25:30.596320] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-17T03:25:30.963444] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-17T03:25:30.963564] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-17T03:25:30.963770] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-17T03:25:30.963844] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-17T03:25:30.964281] [DEBUG] [LOCAL ] EEA: Trimmed 3985 records to 2847 (keeping 200 days of data) [2025-09-17T03:25:30.981569] [DEBUG] [LOCAL ] EEA: Primary data saved (2847 records). [2025-09-17T03:25:30.981695] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-17T03:25:30.981808] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EEA took 19.6s. Estimated remaining: 4h 3m 45s. Rate: 6.9 symbols/min [2025-09-17T03:25:31.095213] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-17T03:25:31.153196] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:31.162608] [DEBUG] [LOCAL ] EEX: Loaded 7285 existing records from primary storage. [2025-09-17T03:25:31.162868] [INFO ] [MAIN ] EEX: Loaded 7285 existing records. [2025-09-17T03:25:31.347942] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:31.348229] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-17T03:25:31.348305] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-17T03:25:31.348672] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-17T03:25:31.348745] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-17T03:25:31.717026] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:31.890137] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-11. [2025-09-17T03:25:32.125415] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T03:25:32.501575] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:25:32.690168] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-17T03:25:33.490164] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-17T03:25:33.741961] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T03:25:34.290151] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-17T03:25:34.914507] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T03:25:35.090109] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-17T03:25:35.282540] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T03:25:35.890134] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-17T03:25:36.284165] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T03:25:36.690151] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-17T03:25:37.490197] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-17T03:25:37.628087] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:25:37.703297] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T03:25:38.087419] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:25:38.290137] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-17T03:25:39.090142] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-17T03:25:39.370207] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T03:25:39.890162] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-17T03:25:40.566252] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:25:40.690102] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-17T03:25:41.393505] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:25:41.490175] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-17T03:25:41.834186] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T03:25:42.290118] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-17T03:25:42.878860] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:25:42.884353] [INFO ] [REMOTE ] EDU: Full fetch complete (66507 records). [2025-09-17T03:25:42.884494] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-17T03:25:43.111725] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-17T03:25:43.216138] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T03:25:43.273095] [INFO ] [REMOTE ] EE: Full fetch complete (43349 records). [2025-09-17T03:25:43.293010] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-17T03:25:43.292899] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-17T03:25:43.293203] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-17T03:25:43.294069] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-17T03:25:43.337411] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-17T03:25:43.401289] [DEBUG] [LOCAL ] EDU: Trimmed 66507 records to 45350 (keeping 200 days of data) [2025-09-17T03:25:43.764245] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-17T03:25:43.766333] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-17T03:25:43.767528] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-17T03:25:43.768444] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-17T03:25:43.772352] [DEBUG] [LOCAL ] EE: Trimmed 43349 records to 32616 (keeping 200 days of data) [2025-09-17T03:25:43.890944] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-17T03:25:44.135958] [DEBUG] [LOCAL ] EDU: Primary data saved (45350 records). [2025-09-17T03:25:44.137104] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-17T03:25:44.137948] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EDU took 43.7s. Estimated remaining: 4h 3m 47s. Rate: 6.9 symbols/min [2025-09-17T03:25:44.241341] [DEBUG] [LOCAL ] EE: Primary data saved (32616 records). [2025-09-17T03:25:44.247009] [INFO ] [MAIN ] EE: Full history saved. [2025-09-17T03:25:44.257396] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EE took 35.9s. Estimated remaining: 4h 3m 17s. Rate: 6.9 symbols/min [2025-09-17T03:25:44.359164] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:44.465010] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T03:25:44.499145] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:44.519390] [DEBUG] [LOCAL ] EFR: Loaded 10364 existing records from primary storage. [2025-09-17T03:25:44.519541] [INFO ] [MAIN ] EFR: Loaded 10364 existing records. [2025-09-17T03:25:44.629828] [DEBUG] [LOCAL ] EFC: Loaded 34040 existing records from primary storage. [2025-09-17T03:25:44.645703] [INFO ] [MAIN ] EFC: Loaded 34040 existing records. [2025-09-17T03:25:44.700696] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-17T03:25:44.789585] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:44.811754] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-17T03:25:44.811870] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-17T03:25:44.817503] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-17T03:25:44.838412] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-17T03:25:44.957693] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:44.989221] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-17T03:25:44.989329] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-17T03:25:44.995215] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-17T03:25:45.010756] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-17T03:25:45.266996] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T03:25:45.321854] [INFO ] [REMOTE ] EDN: Full fetch complete (30377 records). [2025-09-17T03:25:45.454998] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:45.411117] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-17T03:25:45.497441] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-11. [2025-09-17T03:25:45.699254] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:45.743093] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T03:25:45.999532] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-17T03:25:45.999660] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-17T03:25:46.000197] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-17T03:25:46.000251] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-17T03:25:46.001005] [DEBUG] [LOCAL ] EDN: Trimmed 30377 records to 17603 (keeping 200 days of data) [2025-09-17T03:25:46.104870] [DEBUG] [LOCAL ] EDN: Primary data saved (17603 records). [2025-09-17T03:25:46.105020] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-17T03:25:46.105112] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EDN took 50.9s. Estimated remaining: 4h 2m 52s. Rate: 6.9 symbols/min [2025-09-17T03:25:46.272522] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:46.285020] [DEBUG] [LOCAL ] EFT: Loaded 9155 existing records from primary storage. [2025-09-17T03:25:46.285166] [INFO ] [MAIN ] EFT: Loaded 9155 existing records. [2025-09-17T03:25:46.296231] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-17T03:25:46.465106] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:46.471065] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-17T03:25:46.471513] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-17T03:25:46.471741] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T03:25:46.474317] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-17T03:25:46.474383] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-17T03:25:46.824440] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:47.090142] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-11. [2025-09-17T03:25:47.239780] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T03:25:47.890188] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-17T03:25:47.932405] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T03:25:48.690140] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-17T03:25:48.713436] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:25:49.490166] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-17T03:25:49.503736] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:25:50.290161] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-11. [2025-09-17T03:25:50.400635] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T03:25:51.090151] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-17T03:25:51.890198] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-17T03:25:51.957069] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T03:25:52.007775] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T03:25:52.665018] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T03:25:52.690071] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-17T03:25:53.490160] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-17T03:25:53.497755] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:25:54.290136] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-17T03:25:55.090127] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-17T03:25:55.149402] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:25:55.268813] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T03:25:55.734370] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:25:55.735948] [INFO ] [REMOTE ] EEX: Full fetch complete (20157 records). [2025-09-17T03:25:55.736040] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-17T03:25:55.890951] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-17T03:25:56.096429] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-17T03:25:56.096539] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-17T03:25:56.096969] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-17T03:25:56.097070] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-17T03:25:56.097689] [DEBUG] [LOCAL ] EEX: Trimmed 20157 records to 12348 (keeping 200 days of data) [2025-09-17T03:25:56.170708] [DEBUG] [LOCAL ] EEX: Primary data saved (12348 records). [2025-09-17T03:25:56.170874] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-17T03:25:56.170967] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EEX took 25.2s. Estimated remaining: 4h 2m 46s. Rate: 6.9 symbols/min [2025-09-17T03:25:56.344442] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:56.375823] [DEBUG] [LOCAL ] EFX: Loaded 32959 existing records from primary storage. [2025-09-17T03:25:56.375994] [INFO ] [MAIN ] EFX: Loaded 32959 existing records. [2025-09-17T03:25:56.554437] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:56.554728] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-17T03:25:56.554791] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-17T03:25:56.555623] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-17T03:25:56.555712] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-17T03:25:56.665489] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:25:56.702202] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-17T03:25:56.914806] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:57.490116] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-11. [2025-09-17T03:25:57.613919] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T03:25:58.290149] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-17T03:25:59.090115] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-17T03:25:59.222111] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:25:59.314448] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T03:25:59.830592] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:25:59.890156] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-17T03:26:00.695486] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-17T03:26:00.699441] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T03:26:01.490184] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-17T03:26:02.290145] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-17T03:26:02.361736] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:26:03.090150] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-17T03:26:03.110672] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T03:26:03.162450] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:26:03.890179] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-17T03:26:03.993171] [DEBUG] [REMOTE ] EFX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T03:26:03.993543] [WARN ] [REMOTE ] EFX: No data returned for month 2025-01 [2025-09-17T03:26:04.598290] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:26:04.690144] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-17T03:26:05.490150] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-17T03:26:06.290144] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-17T03:26:06.386773] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:26:06.410936] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:26:07.090205] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-17T03:26:07.890201] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-17T03:26:07.920819] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:26:08.038103] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T03:26:08.690174] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-17T03:26:08.849721] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T03:26:09.429357] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T03:26:09.490141] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-17T03:26:10.290169] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-17T03:26:10.447615] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T03:26:11.090179] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-17T03:26:11.140237] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T03:26:11.142540] [INFO ] [REMOTE ] EFR: Full fetch complete (18378 records). [2025-09-17T03:26:11.142629] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-17T03:26:11.515385] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-17T03:26:11.515481] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-17T03:26:11.515888] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-17T03:26:11.515938] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-17T03:26:11.516544] [DEBUG] [LOCAL ] EFR: Trimmed 18378 records to 14030 (keeping 200 days of data) [2025-09-17T03:26:11.601628] [DEBUG] [LOCAL ] EFR: Primary data saved (14030 records). [2025-09-17T03:26:11.601801] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-17T03:26:11.601899] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EFR took 27.3s. Estimated remaining: 4h 2m 54s. Rate: 6.9 symbols/min [2025-09-17T03:26:11.770976] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:11.790813] [DEBUG] [LOCAL ] EFXT: Loaded 21228 existing records from primary storage. [2025-09-17T03:26:11.790966] [INFO ] [MAIN ] EFXT: Loaded 21228 existing records. [2025-09-17T03:26:11.893396] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-17T03:26:11.975552] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:11.975829] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-17T03:26:11.975906] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-17T03:26:11.976493] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-17T03:26:11.976564] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-17T03:26:12.333045] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:12.690093] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-11. [2025-09-17T03:26:12.793538] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T03:26:12.969804] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T03:26:13.490130] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-17T03:26:13.947977] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T03:26:14.290171] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-17T03:26:15.090177] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-17T03:26:15.257529] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:26:15.275542] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:26:15.890202] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-17T03:26:16.051014] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T03:26:16.698072] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-17T03:26:16.700538] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:26:17.490199] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-17T03:26:17.905355] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T03:26:18.290139] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-17T03:26:19.090151] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-17T03:26:19.414692] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T03:26:19.890130] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-17T03:26:20.018173] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:26:20.080885] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T03:26:20.690129] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-17T03:26:21.465025] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T03:26:21.467063] [INFO ] [REMOTE ] EFT: Full fetch complete (17407 records). [2025-09-17T03:26:21.467159] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-17T03:26:21.497904] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-17T03:26:21.868819] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:26:21.898949] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-17T03:26:21.899340] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-17T03:26:21.900206] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-17T03:26:21.900469] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-17T03:26:21.901686] [DEBUG] [LOCAL ] EFT: Trimmed 17407 records to 12466 (keeping 200 days of data) [2025-09-17T03:26:21.981515] [DEBUG] [LOCAL ] EFT: Primary data saved (12466 records). [2025-09-17T03:26:21.981699] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-17T03:26:21.981802] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFT took 35.9s. Estimated remaining: 4h 2m 49s. Rate: 6.9 symbols/min [2025-09-17T03:26:22.152895] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:22.173565] [DEBUG] [LOCAL ] EG: Loaded 21087 existing records from primary storage. [2025-09-17T03:26:22.173743] [INFO ] [MAIN ] EG: Loaded 21087 existing records. [2025-09-17T03:26:22.295268] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-17T03:26:22.362599] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:22.362892] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-17T03:26:22.362957] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-17T03:26:22.363600] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-17T03:26:22.363685] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-17T03:26:22.754085] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:22.881220] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:26:23.090131] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-17T03:26:23.890135] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-17T03:26:24.038330] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T03:26:24.518289] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:26:24.690141] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-17T03:26:25.495813] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-11. [2025-09-17T03:26:25.504334] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:26:25.557004] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T03:26:26.290130] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-17T03:26:26.940466] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:26:27.090120] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-17T03:26:27.497133] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T03:26:27.890174] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-17T03:26:28.521156] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:26:28.690127] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-17T03:26:29.490131] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-17T03:26:29.677122] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:26:30.290198] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-17T03:26:30.399143] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:26:30.996734] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:26:31.090103] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-17T03:26:31.813388] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:26:31.890099] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-17T03:26:32.679413] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:26:32.690083] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-17T03:26:33.490114] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-17T03:26:33.522478] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:26:33.528501] [INFO ] [REMOTE ] EFC: Full fetch complete (65879 records). [2025-09-17T03:26:33.528680] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-17T03:26:33.922727] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-17T03:26:33.922960] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-17T03:26:33.924066] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-17T03:26:33.924203] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-17T03:26:33.940458] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T03:26:33.946548] [DEBUG] [LOCAL ] EFC: Trimmed 65879 records to 46276 (keeping 200 days of data) [2025-09-17T03:26:34.231046] [DEBUG] [LOCAL ] EFC: Primary data saved (46276 records). [2025-09-17T03:26:34.231261] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-17T03:26:34.231391] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFC took 50.1s. Estimated remaining: 4h 2m 48s. Rate: 6.9 symbols/min [2025-09-17T03:26:34.295429] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-17T03:26:34.401999] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:34.438102] [DEBUG] [LOCAL ] EGO: Loaded 38230 existing records from primary storage. [2025-09-17T03:26:34.438284] [INFO ] [MAIN ] EGO: Loaded 38230 existing records. [2025-09-17T03:26:34.613484] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:34.613778] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-17T03:26:34.613850] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-17T03:26:34.614789] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-17T03:26:34.614863] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-17T03:26:34.971712] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:34.994942] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T03:26:35.000473] [INFO ] [REMOTE ] EFX: Full fetch complete (58204 records). [2025-09-17T03:26:35.000595] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-17T03:26:35.098790] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-17T03:26:35.193741] [WARN ] [VALIDATOR ] EFX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T03:26:35.194330] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:26:35.194382] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:26:35.194432] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-17T03:26:35.194494] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-09-17T03:26:35.194538] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-09-17T03:26:35.194892] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-09-17T03:26:35.194994] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFX took 39.0s. Estimated remaining: 4h 2m 21s. Rate: 6.9 symbols/min [2025-09-17T03:26:35.365373] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:35.387284] [DEBUG] [LOCAL ] EGP: Loaded 22312 existing records from primary storage. [2025-09-17T03:26:35.387429] [INFO ] [MAIN ] EGP: Loaded 22312 existing records. [2025-09-17T03:26:35.570761] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:35.571005] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-17T03:26:35.571064] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-17T03:26:35.571586] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-17T03:26:35.571668] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-17T03:26:35.890220] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-11. [2025-09-17T03:26:35.929859] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:35.950546] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:26:36.458905] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:26:36.690153] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-17T03:26:37.490138] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-11. [2025-09-17T03:26:37.620152] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:26:37.844258] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:26:37.848402] [INFO ] [REMOTE ] EFXT: Full fetch complete (44090 records). [2025-09-17T03:26:37.848507] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-17T03:26:38.232468] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-17T03:26:38.232615] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-17T03:26:38.233474] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-17T03:26:38.233583] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-17T03:26:38.234884] [DEBUG] [LOCAL ] EFXT: Trimmed 44090 records to 29735 (keeping 200 days of data) [2025-09-17T03:26:38.293550] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-17T03:26:38.417823] [DEBUG] [LOCAL ] EFXT: Primary data saved (29735 records). [2025-09-17T03:26:38.418001] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-17T03:26:38.418109] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFXT took 26.8s. Estimated remaining: 4h 1m 60s. Rate: 6.9 symbols/min [2025-09-17T03:26:38.594345] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:38.630759] [DEBUG] [LOCAL ] EGY: Loaded 30724 existing records from primary storage. [2025-09-17T03:26:38.630929] [INFO ] [MAIN ] EGY: Loaded 30724 existing records. [2025-09-17T03:26:38.810741] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:38.811038] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-17T03:26:38.811253] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-17T03:26:38.812007] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-17T03:26:38.812075] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-17T03:26:38.932686] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:26:39.095236] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-17T03:26:39.194387] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:39.890146] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-11. [2025-09-17T03:26:40.028203] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T03:26:40.362278] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:26:40.690148] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-17T03:26:41.246856] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:26:41.490165] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-17T03:26:42.302372] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-17T03:26:42.305224] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:26:42.886136] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:26:43.090158] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-17T03:26:43.744866] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:26:43.890158] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-17T03:26:44.690152] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-17T03:26:44.768080] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T03:26:45.490212] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-17T03:26:45.563773] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:26:46.100857] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:26:46.290153] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-17T03:26:47.065723] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:26:47.090090] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-17T03:26:47.803329] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:26:47.890177] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-17T03:26:48.690243] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-17T03:26:48.891662] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:26:48.942358] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:26:49.490147] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-17T03:26:50.251567] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T03:26:50.290108] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-17T03:26:50.908446] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T03:26:51.090141] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-17T03:26:51.890128] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-17T03:26:52.094859] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:26:52.570408] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:26:52.690191] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-17T03:26:53.234762] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:26:53.490170] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-17T03:26:54.290131] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-17T03:26:54.481029] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:26:54.710923] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:26:55.090129] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-17T03:26:55.716767] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T03:26:55.890096] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-17T03:26:56.206687] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T03:26:56.210305] [INFO ] [REMOTE ] EG: Full fetch complete (44010 records). [2025-09-17T03:26:56.210452] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-17T03:26:56.603746] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-17T03:26:56.603896] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-17T03:26:56.605060] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-17T03:26:56.605153] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-17T03:26:56.606447] [DEBUG] [LOCAL ] EG: Trimmed 44010 records to 29036 (keeping 200 days of data) [2025-09-17T03:26:56.699496] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-17T03:26:56.797281] [DEBUG] [LOCAL ] EG: Primary data saved (29036 records). [2025-09-17T03:26:56.797464] [INFO ] [MAIN ] EG: Full history saved. [2025-09-17T03:26:56.797565] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EG took 34.8s. Estimated remaining: 4h 2m 14s. Rate: 6.9 symbols/min [2025-09-17T03:26:56.967174] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:56.988174] [DEBUG] [LOCAL ] EHAB: Loaded 22697 existing records from primary storage. [2025-09-17T03:26:56.988331] [INFO ] [MAIN ] EHAB: Loaded 22697 existing records. [2025-09-17T03:26:57.166464] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:57.166749] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-17T03:26:57.166810] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-17T03:26:57.167275] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-17T03:26:57.167333] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-17T03:26:57.502985] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-17T03:26:57.544322] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:57.580100] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:26:58.290141] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-11. [2025-09-17T03:26:58.361325] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T03:26:59.090214] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-17T03:26:59.254620] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T03:26:59.703783] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:26:59.890083] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-17T03:27:00.697496] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-17T03:27:00.714196] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T03:27:01.179572] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:27:01.490134] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-17T03:27:02.097193] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:27:02.290150] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-17T03:27:03.090149] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-17T03:27:03.890100] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-17T03:27:04.309062] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-17T03:27:04.678830] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-17T03:27:04.690068] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-17T03:27:04.803163] [DEBUG] [REMOTE ] EGP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T03:27:04.803481] [WARN ] [REMOTE ] EGP: No data returned for month 2025-07 [2025-09-17T03:27:05.193224] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T03:27:05.372797] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-17T03:27:05.490091] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-17T03:27:06.290143] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-17T03:27:07.008073] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T03:27:07.090143] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-17T03:27:07.187884] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:27:07.890163] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-17T03:27:08.653428] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:27:08.660030] [INFO ] [REMOTE ] EGO: Full fetch complete (72973 records). [2025-09-17T03:27:08.660211] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-17T03:27:08.695265] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-17T03:27:08.881287] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T03:27:08.998695] [INFO ] [REMOTE ] EGP: Full fetch complete (39781 records). [2025-09-17T03:27:09.009397] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-17T03:27:09.243619] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-17T03:27:09.270485] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-17T03:27:09.280713] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-17T03:27:09.282473] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-17T03:27:09.311967] [WARN ] [VALIDATOR ] EGP: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T03:27:09.312667] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:27:09.312900] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:27:09.312970] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-17T03:27:09.313237] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-17T03:27:09.313142] [DEBUG] [LOCAL ] EGO: Trimmed 72973 records to 51384 (keeping 200 days of data) [2025-09-17T03:27:09.313475] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-09-17T03:27:09.314174] [DEBUG] [LOCAL ] EGP: Deleted derivative data file. [2025-09-17T03:27:09.314368] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EGP took 34.1s. Estimated remaining: 4h 2m 14s. Rate: 6.9 symbols/min [2025-09-17T03:27:09.494753] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-17T03:27:09.654683] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:09.704195] [DEBUG] [LOCAL ] EHC: Loaded 30997 existing records from primary storage. [2025-09-17T03:27:09.706167] [INFO ] [MAIN ] EHC: Loaded 30997 existing records. [2025-09-17T03:27:10.017233] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:27:10.132915] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:10.155218] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-17T03:27:10.155410] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-17T03:27:10.156512] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-17T03:27:10.156622] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-17T03:27:10.290517] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-17T03:27:10.752432] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:10.760056] [DEBUG] [LOCAL ] EGO: Primary data saved (51384 records). [2025-09-17T03:27:10.760205] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-17T03:27:10.760304] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EGO took 36.5s. Estimated remaining: 4h 1m 48s. Rate: 6.9 symbols/min [2025-09-17T03:27:10.932532] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:10.941385] [DEBUG] [LOCAL ] EHI: Loaded 7902 existing records from primary storage. [2025-09-17T03:27:10.941497] [INFO ] [MAIN ] EHI: Loaded 7902 existing records. [2025-09-17T03:27:11.095144] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-11. [2025-09-17T03:27:11.123549] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:11.124120] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-17T03:27:11.124231] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-17T03:27:11.124624] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-17T03:27:11.124718] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-17T03:27:11.523742] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:11.525267] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T03:27:11.652939] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T03:27:11.890178] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-17T03:27:12.414802] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:27:12.690153] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-11. [2025-09-17T03:27:13.149238] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T03:27:13.490214] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-17T03:27:13.620549] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T03:27:14.290308] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-17T03:27:14.718617] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:27:15.090162] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-17T03:27:15.890189] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-17T03:27:15.940319] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:27:16.690163] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-17T03:27:17.490131] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-17T03:27:17.670592] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:27:17.960141] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-17T03:27:18.290127] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-17T03:27:18.344527] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:27:18.503710] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T03:27:18.509012] [INFO ] [REMOTE ] EGY: Full fetch complete (61751 records). [2025-09-17T03:27:18.509159] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-17T03:27:18.914099] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-17T03:27:18.914236] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-17T03:27:18.925058] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-17T03:27:18.925851] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T03:27:18.926073] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-17T03:27:18.932713] [DEBUG] [LOCAL ] EGY: Trimmed 61751 records to 42423 (keeping 200 days of data) [2025-09-17T03:27:19.104781] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-17T03:27:19.188391] [DEBUG] [LOCAL ] EGY: Primary data saved (42423 records). [2025-09-17T03:27:19.188546] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-17T03:27:19.188667] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGY took 40.8s. Estimated remaining: 4h 1m 38s. Rate: 6.9 symbols/min [2025-09-17T03:27:19.368148] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:19.386455] [DEBUG] [LOCAL ] EIC: Loaded 17796 existing records from primary storage. [2025-09-17T03:27:19.386611] [INFO ] [MAIN ] EIC: Loaded 17796 existing records. [2025-09-17T03:27:19.575818] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:19.576073] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-17T03:27:19.576131] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-17T03:27:19.576598] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-17T03:27:19.576681] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-17T03:27:19.905057] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-17T03:27:19.948069] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:20.059234] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T03:27:20.690187] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-11. [2025-09-17T03:27:21.178844] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:27:21.490110] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-17T03:27:21.685168] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T03:27:22.290142] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-17T03:27:22.879767] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T03:27:23.090149] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-17T03:27:23.744822] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:27:23.890124] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-17T03:27:23.956613] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T03:27:24.690128] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-17T03:27:25.452630] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:27:25.490129] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-17T03:27:25.520594] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:27:26.290134] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-17T03:27:27.090199] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-17T03:27:27.207069] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T03:27:27.459201] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T03:27:27.890156] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-17T03:27:27.924990] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T03:27:28.690185] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-17T03:27:29.215920] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:27:29.490181] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-17T03:27:29.804728] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T03:27:30.290152] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-17T03:27:30.847799] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T03:27:31.090196] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-17T03:27:31.888433] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T03:27:31.896262] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-17T03:27:32.065918] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T03:27:32.690188] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-17T03:27:33.121035] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T03:27:33.490149] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-17T03:27:33.917232] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T03:27:34.290331] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-17T03:27:34.293537] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T03:27:35.090232] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-17T03:27:35.594123] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T03:27:35.890131] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-17T03:27:36.694872] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-17T03:27:36.700436] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:27:36.724387] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T03:27:37.490111] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-17T03:27:37.865081] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:27:38.290146] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-17T03:27:38.987549] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:27:39.090213] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-17T03:27:39.680670] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T03:27:39.891106] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-17T03:27:39.894006] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:27:40.690125] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-17T03:27:40.814444] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:27:40.819179] [INFO ] [REMOTE ] EHAB: Full fetch complete (41734 records). [2025-09-17T03:27:40.819291] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-17T03:27:41.200710] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-17T03:27:41.200827] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-17T03:27:41.201467] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-17T03:27:41.201530] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-17T03:27:41.202518] [DEBUG] [LOCAL ] EHAB: Trimmed 41734 records to 30206 (keeping 200 days of data) [2025-09-17T03:27:41.380844] [DEBUG] [LOCAL ] EHAB: Primary data saved (30206 records). [2025-09-17T03:27:41.380997] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-17T03:27:41.381117] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EHAB took 44.6s. Estimated remaining: 4h 2m 1s. Rate: 6.9 symbols/min [2025-09-17T03:27:41.495357] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-17T03:27:41.561744] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:41.561962] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-17T03:27:41.562011] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-17T03:27:41.562127] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-17T03:27:41.562185] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-17T03:27:41.562236] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-17T03:27:41.562288] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-17T03:27:41.946764] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:41.961210] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:27:42.290145] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-11. [2025-09-17T03:27:42.681736] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T03:27:42.934587] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:27:42.939439] [INFO ] [REMOTE ] EHC: Full fetch complete (58899 records). [2025-09-17T03:27:42.939566] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-17T03:27:43.095344] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-17T03:27:43.346559] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-17T03:27:43.346688] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-17T03:27:43.347709] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-17T03:27:43.347769] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-17T03:27:43.349098] [DEBUG] [LOCAL ] EHC: Trimmed 58899 records to 41727 (keeping 200 days of data) [2025-09-17T03:27:43.625254] [DEBUG] [LOCAL ] EHC: Primary data saved (41727 records). [2025-09-17T03:27:43.625416] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-17T03:27:43.625509] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHC took 34.3s. Estimated remaining: 4h 1m 37s. Rate: 6.9 symbols/min [2025-09-17T03:27:43.800180] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:43.800405] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-17T03:27:43.800459] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-17T03:27:43.800575] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-17T03:27:43.800678] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-17T03:27:43.800732] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-17T03:27:43.800778] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-17T03:27:43.899185] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-17T03:27:44.161586] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:44.169433] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T03:27:44.172248] [INFO ] [REMOTE ] EIC: Full fetch complete (35881 records). [2025-09-17T03:27:44.172353] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-17T03:27:44.279102] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T03:27:44.560372] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-17T03:27:44.560485] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-17T03:27:44.561111] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-17T03:27:44.561177] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-17T03:27:44.562444] [DEBUG] [LOCAL ] EIC: Trimmed 35881 records to 24807 (keeping 200 days of data) [2025-09-17T03:27:44.690161] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-17T03:27:44.727061] [DEBUG] [LOCAL ] EIC: Primary data saved (24807 records). [2025-09-17T03:27:44.727202] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-17T03:27:44.727300] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EIC took 25.5s. Estimated remaining: 4h 1m 11s. Rate: 6.9 symbols/min [2025-09-17T03:27:44.903588] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:44.903864] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-17T03:27:44.903916] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-17T03:27:44.904031] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-17T03:27:44.904082] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-17T03:27:44.904127] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-17T03:27:44.904164] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-17T03:27:45.281981] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:45.366482] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T03:27:45.368380] [INFO ] [REMOTE ] EHI: Full fetch complete (16487 records). [2025-09-17T03:27:45.368485] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-17T03:27:45.495219] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-11. [2025-09-17T03:27:45.752410] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-17T03:27:45.752524] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-17T03:27:45.753108] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-17T03:27:45.753176] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-17T03:27:45.753766] [DEBUG] [LOCAL ] EHI: Trimmed 16487 records to 10156 (keeping 200 days of data) [2025-09-17T03:27:45.818952] [DEBUG] [LOCAL ] EHI: Primary data saved (10156 records). [2025-09-17T03:27:45.819124] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-17T03:27:45.819236] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EHI took 35.1s. Estimated remaining: 4h 0m 44s. Rate: 6.9 symbols/min [2025-09-17T03:27:46.001802] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:46.020375] [DEBUG] [LOCAL ] EIG: Loaded 15610 existing records from primary storage. [2025-09-17T03:27:46.020527] [INFO ] [MAIN ] EIG: Loaded 15610 existing records. [2025-09-17T03:27:46.123041] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T03:27:46.204997] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:46.205308] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-17T03:27:46.205389] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-17T03:27:46.205939] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-17T03:27:46.206012] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-17T03:27:46.295323] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-17T03:27:46.567572] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:46.789134] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T03:27:47.090147] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-11. [2025-09-17T03:27:47.565766] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T03:27:47.890144] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-11. [2025-09-17T03:27:48.690135] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-17T03:27:48.707789] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:27:49.316330] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T03:27:49.490130] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-17T03:27:49.932047] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T03:27:50.290149] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-17T03:27:50.927859] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T03:27:51.090144] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-17T03:27:51.550202] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T03:27:51.890130] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-17T03:27:52.690206] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-17T03:27:52.859750] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T03:27:53.135420] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T03:27:53.490180] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-17T03:27:53.955961] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:27:54.290137] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-17T03:27:54.779698] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T03:27:55.090168] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-17T03:27:55.435066] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T03:27:55.890181] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-17T03:27:56.324148] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T03:27:56.690096] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-17T03:27:57.315768] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:27:57.490136] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-17T03:27:58.102894] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T03:27:58.290171] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-17T03:27:58.643520] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T03:27:59.090162] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-17T03:27:59.857294] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T03:27:59.890079] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-17T03:28:00.549604] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:28:00.690200] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-17T03:28:01.132373] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T03:28:01.490190] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-17T03:28:02.066632] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T03:28:02.290382] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-17T03:28:02.961544] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T03:28:03.090238] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-17T03:28:03.601395] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T03:28:03.890147] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-17T03:28:04.609321] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T03:28:04.690186] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-17T03:28:05.490197] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-17T03:28:05.707294] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T03:28:05.861551] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:28:05.862449] [INFO ] [REMOTE ] EICB: Full fetch complete (2644 records). [2025-09-17T03:28:05.862532] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-17T03:28:06.048637] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T03:28:06.048872] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:28:06.048918] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:28:06.048967] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-17T03:28:06.049037] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-17T03:28:06.049089] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-17T03:28:06.049154] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-17T03:28:06.049225] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EICB took 22.4s. Estimated remaining: 4h 1m 2s. Rate: 6.9 symbols/min [2025-09-17T03:28:06.226723] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:06.268116] [DEBUG] [LOCAL ] EIX: Loaded 39795 existing records from primary storage. [2025-09-17T03:28:06.268297] [INFO ] [MAIN ] EIX: Loaded 39795 existing records. [2025-09-17T03:28:06.299194] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-17T03:28:06.451298] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:06.451611] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-17T03:28:06.451689] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-17T03:28:06.452630] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-17T03:28:06.452721] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-17T03:28:06.783699] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T03:28:06.810827] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:07.090129] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-17T03:28:07.467019] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T03:28:07.890126] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-17T03:28:08.690163] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-17T03:28:08.992951] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:28:09.033190] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T03:28:09.490144] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-17T03:28:10.290118] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-17T03:28:10.510404] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:28:10.655506] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-17T03:28:11.090147] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-17T03:28:11.864002] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:28:11.890127] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-17T03:28:12.516409] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T03:28:12.518110] [INFO ] [REMOTE ] EICC: Full fetch complete (7705 records). [2025-09-17T03:28:12.518203] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-17T03:28:12.701821] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-17T03:28:12.879579] [DEBUG] [VALIDATOR ] EICC: All expected trading days are present. [2025-09-17T03:28:12.879695] [DEBUG] [VALIDATOR ] EICC: Primary data validation passed. [2025-09-17T03:28:12.879906] [INFO ] [MAIN ] EICC: Fetched primary data is valid. [2025-09-17T03:28:12.879956] [DEBUG] [LOCAL ] EICC: Saving primary data. [2025-09-17T03:28:12.880379] [DEBUG] [LOCAL ] EICC: Trimmed 7705 records to 5979 (keeping 200 days of data) [2025-09-17T03:28:12.921287] [DEBUG] [LOCAL ] EICC: Primary data saved (5979 records). [2025-09-17T03:28:12.921453] [INFO ] [MAIN ] EICC: Full history saved. [2025-09-17T03:28:12.921546] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EICC took 28.2s. Estimated remaining: 4h 0m 49s. Rate: 6.9 symbols/min [2025-09-17T03:28:13.091734] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:13.140931] [DEBUG] [LOCAL ] EL: Loaded 39892 existing records from primary storage. [2025-09-17T03:28:13.141097] [INFO ] [MAIN ] EL: Loaded 39892 existing records. [2025-09-17T03:28:13.244237] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T03:28:13.326513] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:13.326837] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-17T03:28:13.326922] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-17T03:28:13.327864] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-17T03:28:13.327931] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-17T03:28:13.490536] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-17T03:28:13.693801] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:13.876614] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:28:13.877395] [INFO ] [REMOTE ] EICA: Full fetch complete (1294 records). [2025-09-17T03:28:13.877481] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-17T03:28:13.877867] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:28:13.877941] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:28:13.877987] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:28:13.878028] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-17T03:28:13.878091] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-17T03:28:13.878139] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-17T03:28:13.878201] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-17T03:28:13.878267] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICA took 32.5s. Estimated remaining: 4h 0m 22s. Rate: 6.9 symbols/min [2025-09-17T03:28:14.046735] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:14.090845] [DEBUG] [LOCAL ] ELAN: Loaded 39704 existing records from primary storage. [2025-09-17T03:28:14.091018] [INFO ] [MAIN ] ELAN: Loaded 39704 existing records. [2025-09-17T03:28:14.266739] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:14.266978] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-17T03:28:14.267037] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-17T03:28:14.267869] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-17T03:28:14.267932] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-17T03:28:14.296896] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-11. [2025-09-17T03:28:14.648080] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:15.090196] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-11. [2025-09-17T03:28:15.890177] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-11. [2025-09-17T03:28:16.634039] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T03:28:16.690078] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-17T03:28:16.747399] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:28:17.490103] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-17T03:28:17.640991] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:28:18.290140] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-17T03:28:18.793934] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T03:28:19.024521] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:28:19.049080] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T03:28:19.090081] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-17T03:28:19.890106] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-17T03:28:20.270565] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T03:28:20.690131] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-17T03:28:21.490180] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-17T03:28:21.716109] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T03:28:21.813297] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T03:28:22.290142] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-17T03:28:23.090132] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-17T03:28:23.288441] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:28:23.523349] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T03:28:23.890183] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-17T03:28:24.494404] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:28:24.690131] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-17T03:28:25.490127] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-17T03:28:25.942427] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-17T03:28:26.026382] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T03:28:26.290124] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-17T03:28:27.090185] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-17T03:28:27.556822] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T03:28:27.716222] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T03:28:27.890157] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-17T03:28:28.534346] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:28:28.690149] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-17T03:28:29.435750] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T03:28:29.490079] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-17T03:28:29.912201] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:28:30.290177] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-17T03:28:31.090095] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-17T03:28:31.685842] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T03:28:31.774328] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T03:28:31.890145] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-17T03:28:32.690200] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-17T03:28:32.985977] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:28:33.490185] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-17T03:28:33.552676] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T03:28:34.290143] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-17T03:28:34.928911] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T03:28:35.010075] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:28:35.090152] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-17T03:28:35.642246] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T03:28:35.890200] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-17T03:28:36.690134] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-17T03:28:36.959181] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T03:28:37.380004] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T03:28:37.382913] [INFO ] [REMOTE ] EIG: Full fetch complete (26614 records). [2025-09-17T03:28:37.383009] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-17T03:28:37.495233] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-17T03:28:37.759972] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-17T03:28:37.760210] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-17T03:28:37.760804] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-17T03:28:37.760887] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-17T03:28:37.762162] [DEBUG] [LOCAL ] EIG: Trimmed 26614 records to 20226 (keeping 200 days of data) [2025-09-17T03:28:37.891287] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:28:37.933687] [DEBUG] [LOCAL ] EIG: Primary data saved (20226 records). [2025-09-17T03:28:37.933846] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-17T03:28:37.933952] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EIG took 52.1s. Estimated remaining: 4h 0m 49s. Rate: 6.9 symbols/min [2025-09-17T03:28:38.290171] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-17T03:28:39.090150] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-17T03:28:39.672589] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T03:28:39.767154] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:28:39.890102] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-17T03:28:40.690203] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-17T03:28:40.877052] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T03:28:41.490196] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-17T03:28:41.951911] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T03:28:42.290134] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-17T03:28:42.771320] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T03:28:43.090170] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-17T03:28:43.108747] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T03:28:43.115624] [INFO ] [REMOTE ] ELAN: Full fetch complete (76679 records). [2025-09-17T03:28:43.115825] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-17T03:28:43.538433] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-17T03:28:43.538564] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-17T03:28:43.539429] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-17T03:28:43.539507] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-17T03:28:43.541024] [DEBUG] [LOCAL ] ELAN: Trimmed 76679 records to 53179 (keeping 200 days of data) [2025-09-17T03:28:43.859518] [DEBUG] [LOCAL ] ELAN: Primary data saved (53179 records). [2025-09-17T03:28:43.859760] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-17T03:28:43.859887] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. ELAN took 30.0s. Estimated remaining: 4h 0m 34s. Rate: 6.9 symbols/min [2025-09-17T03:28:43.921913] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:28:43.933321] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-17T03:28:44.851730] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:28:44.863520] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-17T03:28:45.191388] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T03:28:45.198041] [INFO ] [REMOTE ] EIX: Full fetch complete (76738 records). [2025-09-17T03:28:45.198205] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-17T03:28:45.587998] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-17T03:28:45.588115] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-17T03:28:45.589035] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-17T03:28:45.589113] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-17T03:28:45.590601] [DEBUG] [LOCAL ] EIX: Trimmed 76738 records to 53361 (keeping 200 days of data) [2025-09-17T03:28:45.913965] [DEBUG] [LOCAL ] EIX: Primary data saved (53361 records). [2025-09-17T03:28:45.914145] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-17T03:28:45.914266] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 39.9s. Estimated remaining: 4h 0m 10s. Rate: 6.9 symbols/min [2025-09-17T03:28:46.794338] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T03:28:46.800823] [INFO ] [REMOTE ] EL: Full fetch complete (77329 records). [2025-09-17T03:28:46.800991] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-17T03:28:47.192846] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-17T03:28:47.192963] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-17T03:28:47.193858] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-17T03:28:47.193937] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-17T03:28:47.195498] [DEBUG] [LOCAL ] EL: Trimmed 77329 records to 53472 (keeping 200 days of data) [2025-09-17T03:28:47.533397] [DEBUG] [LOCAL ] EL: Primary data saved (53472 records). [2025-09-17T03:28:47.533668] [INFO ] [MAIN ] EL: Full history saved. [2025-09-17T03:28:47.533775] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. EL took 34.6s. Estimated remaining: 3h 59m 45s. Rate: 6.9 symbols/min [2025-09-17T03:28:48.054451] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.136938] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-09-17T03:28:48.173900] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.190813] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-09-17T03:28:48.199821] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-17T03:28:48.225673] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.246254] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-17T03:28:48.249145] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.250030] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-09-17T03:28:48.250184] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-17T03:28:48.329298] [DEBUG] [LOCAL ] ELC: Loaded 2672 existing records from primary storage. [2025-09-17T03:28:48.362313] [INFO ] [MAIN ] ELC: Loaded 2672 existing records. [2025-09-17T03:28:48.618001] [DEBUG] [LOCAL ] ELME: Loaded 29238 existing records from primary storage. [2025-09-17T03:28:48.688273] [INFO ] [MAIN ] ELME: Loaded 29238 existing records. [2025-09-17T03:28:48.740505] [DEBUG] [LOCAL ] ELF: Loaded 38878 existing records from primary storage. [2025-09-17T03:28:48.813629] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:48.810719] [INFO ] [MAIN ] ELF: Loaded 38878 existing records. [2025-09-17T03:28:48.913248] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-17T03:28:49.020910] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:49.018043] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-17T03:28:49.063687] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-11. [2025-09-17T03:28:49.087090] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-17T03:28:49.145500] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-17T03:28:49.201275] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:49.310148] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:49.333775] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-17T03:28:49.337786] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-17T03:28:49.337991] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-17T03:28:49.338141] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-17T03:28:49.354030] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-17T03:28:49.389379] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-17T03:28:49.359162] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-17T03:28:49.439940] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-17T03:28:50.038989] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:50.095993] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-11. [2025-09-17T03:28:50.294539] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:50.341016] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-11. [2025-09-17T03:28:50.346334] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:50.346718] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-11. [2025-09-17T03:28:50.534898] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:28:50.540573] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-17T03:28:50.738488] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T03:28:50.739916] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-17T03:28:51.333958] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T03:28:51.335755] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-17T03:28:51.748588] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:28:51.756151] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-17T03:28:51.809007] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:28:51.809454] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T03:28:51.890078] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-17T03:28:52.359019] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T03:28:52.690093] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-17T03:28:52.854158] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T03:28:53.090946] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T03:28:53.285840] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:28:53.490124] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-17T03:28:54.290226] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-17T03:28:54.623503] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T03:28:55.090198] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-17T03:28:55.890223] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-17T03:28:56.226131] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:28:56.285867] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:28:56.468202] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T03:28:56.690103] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-17T03:28:57.490131] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-17T03:28:58.196021] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:28:58.198229] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T03:28:58.290126] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-17T03:28:59.090159] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-17T03:28:59.660733] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:28:59.872630] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:28:59.890084] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-17T03:29:00.460672] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T03:29:00.690126] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-17T03:29:01.141834] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T03:29:01.490140] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-17T03:29:02.290125] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-17T03:29:03.090094] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-17T03:29:03.517745] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T03:29:03.569850] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T03:29:03.659151] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T03:29:03.890137] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-17T03:29:04.238540] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T03:29:04.239781] [INFO ] [REMOTE ] ELC: Full fetch complete (5217 records). [2025-09-17T03:29:04.239886] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-17T03:29:04.613633] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-17T03:29:04.613774] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-17T03:29:04.614042] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-17T03:29:04.614127] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-17T03:29:04.614609] [DEBUG] [LOCAL ] ELC: Trimmed 5217 records to 3552 (keeping 200 days of data) [2025-09-17T03:29:04.638548] [DEBUG] [LOCAL ] ELC: Primary data saved (3552 records). [2025-09-17T03:29:04.638695] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-17T03:29:04.638814] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 17.1s. Estimated remaining: 3h 59m 55s. Rate: 6.9 symbols/min [2025-09-17T03:29:04.700484] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-17T03:29:04.811021] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:04.811229] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-17T03:29:04.811281] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-17T03:29:04.811461] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-17T03:29:04.811516] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-17T03:29:04.811560] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-17T03:29:04.811605] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-17T03:29:05.166704] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:05.490169] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-11. [2025-09-17T03:29:05.597627] [DEBUG] [REMOTE ] ELPC: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T03:29:05.598006] [WARN ] [REMOTE ] ELPC: No data returned for month 2024-11 [2025-09-17T03:29:06.295894] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-17T03:29:06.312360] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T03:29:07.090160] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-17T03:29:07.890178] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-17T03:29:08.395392] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T03:29:08.638738] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-17T03:29:08.690144] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-17T03:29:09.027257] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T03:29:09.490166] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-17T03:29:10.290130] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-17T03:29:10.755883] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T03:29:10.870594] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T03:29:11.090187] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-17T03:29:11.683948] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T03:29:11.890136] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-17T03:29:12.307118] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T03:29:12.690148] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-17T03:29:13.490188] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-17T03:29:14.032288] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:29:14.090138] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T03:29:14.290163] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-17T03:29:14.975622] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:29:15.090149] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-17T03:29:15.556622] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:29:15.890156] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-17T03:29:16.346093] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T03:29:16.690149] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-17T03:29:16.996897] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T03:29:17.490136] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-17T03:29:17.911221] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:29:18.290144] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-17T03:29:18.431786] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:29:18.434747] [INFO ] [REMOTE ] ELP: Full fetch complete (37834 records). [2025-09-17T03:29:18.434839] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-17T03:29:18.808693] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-17T03:29:18.808803] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-17T03:29:18.809323] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-17T03:29:18.809391] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-17T03:29:18.810354] [DEBUG] [LOCAL ] ELP: Trimmed 37834 records to 26074 (keeping 200 days of data) [2025-09-17T03:29:18.965216] [DEBUG] [LOCAL ] ELP: Primary data saved (26074 records). [2025-09-17T03:29:18.965385] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-17T03:29:18.965471] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELP took 31.4s. Estimated remaining: 3h 59m 59s. Rate: 6.9 symbols/min [2025-09-17T03:29:19.105634] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-17T03:29:19.137469] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:19.177850] [DEBUG] [LOCAL ] ELS: Loaded 36880 existing records from primary storage. [2025-09-17T03:29:19.178043] [INFO ] [MAIN ] ELS: Loaded 36880 existing records. [2025-09-17T03:29:19.357507] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:19.357809] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-17T03:29:19.357886] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-17T03:29:19.358749] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-17T03:29:19.358824] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-17T03:29:19.652299] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T03:29:19.732593] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:19.890136] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-11. [2025-09-17T03:29:20.296532] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:29:20.690141] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-17T03:29:21.495603] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-17T03:29:21.501373] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:29:22.075248] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:29:22.080912] [INFO ] [REMOTE ] ELME: Full fetch complete (55505 records). [2025-09-17T03:29:22.081078] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-17T03:29:22.295306] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-17T03:29:22.479377] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-17T03:29:22.479500] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-17T03:29:22.480391] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-17T03:29:22.480481] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-17T03:29:22.481920] [DEBUG] [LOCAL ] ELME: Trimmed 55505 records to 39208 (keeping 200 days of data) [2025-09-17T03:29:22.741983] [DEBUG] [LOCAL ] ELME: Primary data saved (39208 records). [2025-09-17T03:29:22.742164] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-17T03:29:22.742258] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELME took 35.2s. Estimated remaining: 3h 59m 39s. Rate: 6.9 symbols/min [2025-09-17T03:29:22.835886] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T03:29:22.922233] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:22.958836] [DEBUG] [LOCAL ] ELV: Loaded 37831 existing records from primary storage. [2025-09-17T03:29:22.959006] [INFO ] [MAIN ] ELV: Loaded 37831 existing records. [2025-09-17T03:29:23.099607] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-17T03:29:23.140503] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:23.141122] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-17T03:29:23.141316] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-17T03:29:23.142228] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-17T03:29:23.142296] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-17T03:29:23.520293] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:23.562874] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T03:29:23.890195] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-17T03:29:24.690185] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-17T03:29:24.858596] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T03:29:25.038521] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T03:29:25.490149] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-11. [2025-09-17T03:29:26.063911] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-17T03:29:26.290151] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-17T03:29:26.660892] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T03:29:27.090238] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-17T03:29:27.147964] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:29:27.464804] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T03:29:27.890150] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-17T03:29:28.690144] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-17T03:29:29.490206] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-17T03:29:29.747863] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T03:29:29.839277] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:29:30.290211] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-17T03:29:30.341182] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:29:31.090171] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-17T03:29:31.890177] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-17T03:29:32.122760] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T03:29:32.130532] [INFO ] [REMOTE ] ELF: Full fetch complete (75261 records). [2025-09-17T03:29:32.130886] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-17T03:29:32.289778] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T03:29:32.544856] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-17T03:29:32.545067] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-17T03:29:32.546042] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-17T03:29:32.546196] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-17T03:29:32.585714] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T03:29:32.585998] [DEBUG] [LOCAL ] ELF: Trimmed 75261 records to 52338 (keeping 200 days of data) [2025-09-17T03:29:32.715819] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-17T03:29:32.934499] [DEBUG] [LOCAL ] ELF: Primary data saved (52338 records). [2025-09-17T03:29:32.934723] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-17T03:29:32.934828] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELF took 45.4s. Estimated remaining: 3h 59m 34s. Rate: 6.9 symbols/min [2025-09-17T03:29:33.110741] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:33.110978] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-17T03:29:33.111034] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-17T03:29:33.111149] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-17T03:29:33.111196] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-17T03:29:33.111249] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-17T03:29:33.111291] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-17T03:29:33.476727] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:33.490107] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-11. [2025-09-17T03:29:33.708683] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:33.709045] [WARN ] [REMOTE ] EMA: No data returned for month 2024-11 [2025-09-17T03:29:34.290179] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-17T03:29:34.568104] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T03:29:34.574581] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:29:35.090182] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-17T03:29:35.890158] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-17T03:29:36.154196] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-17T03:29:36.155074] [INFO ] [REMOTE ] ELPC: Full fetch complete (1490 records). [2025-09-17T03:29:36.155170] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-17T03:29:36.155614] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:29:36.155731] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:29:36.155804] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:29:36.155870] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-17T03:29:36.155968] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-17T03:29:36.156035] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-17T03:29:36.156136] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-17T03:29:36.156227] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELPC took 31.5s. Estimated remaining: 3h 59m 12s. Rate: 6.9 symbols/min [2025-09-17T03:29:36.332186] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:36.349039] [DEBUG] [LOCAL ] EMD: Loaded 15174 existing records from primary storage. [2025-09-17T03:29:36.349228] [INFO ] [MAIN ] EMD: Loaded 15174 existing records. [2025-09-17T03:29:36.544608] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:36.544900] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-17T03:29:36.544958] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-17T03:29:36.545446] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-17T03:29:36.545524] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-17T03:29:36.695348] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-17T03:29:36.918198] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:36.997937] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T03:29:37.010766] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:37.012515] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-17T03:29:37.490193] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-11. [2025-09-17T03:29:38.290139] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-17T03:29:38.705811] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T03:29:39.090151] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-17T03:29:39.890148] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-17T03:29:40.154717] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:29:40.216664] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T03:29:40.690136] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-17T03:29:40.913452] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:40.913822] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-17T03:29:41.290452] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T03:29:41.490189] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-17T03:29:41.698574] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:41.698984] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-17T03:29:42.290201] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-17T03:29:42.502630] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:42.503002] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-17T03:29:43.090157] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-17T03:29:43.890110] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-17T03:29:44.099065] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:44.099399] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-17T03:29:44.188743] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:29:44.690135] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-17T03:29:45.490137] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-17T03:29:46.290141] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-17T03:29:46.548420] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:29:46.776945] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T03:29:47.090155] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-17T03:29:47.890161] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-17T03:29:48.087248] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:29:48.690171] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-17T03:29:49.028315] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T03:29:49.029737] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:29:49.060876] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T03:29:49.490175] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-17T03:29:50.290120] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-17T03:29:50.617468] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:29:51.090131] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-17T03:29:51.252110] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:29:51.890169] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-17T03:29:52.690182] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-17T03:29:52.942510] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T03:29:53.490370] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-17T03:29:53.495938] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:29:53.838571] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T03:29:54.290142] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-17T03:29:54.325099] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T03:29:55.090155] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-17T03:29:55.890235] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-17T03:29:56.029034] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:29:56.050468] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T03:29:56.690185] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-17T03:29:57.490179] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-17T03:29:57.539276] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T03:29:57.541747] [INFO ] [REMOTE ] EMA: Full fetch complete (7287 records). [2025-09-17T03:29:57.541868] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-17T03:29:57.737613] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-17T03:29:57.738030] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:29:57.738115] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:29:57.738346] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-17T03:29:57.738687] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-17T03:29:57.738867] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-17T03:29:57.738963] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-17T03:29:57.739162] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 24.8s. Estimated remaining: 3h 59m 33s. Rate: 6.9 symbols/min [2025-09-17T03:29:57.871160] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T03:29:57.952286] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:57.974289] [DEBUG] [LOCAL ] EME: Loaded 22441 existing records from primary storage. [2025-09-17T03:29:57.974478] [INFO ] [MAIN ] EME: Loaded 22441 existing records. [2025-09-17T03:29:58.164355] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:58.164661] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-17T03:29:58.164726] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-17T03:29:58.165430] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-17T03:29:58.165490] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-17T03:29:58.306401] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-17T03:29:58.533908] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:58.899034] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T03:29:59.090153] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-17T03:29:59.497934] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T03:29:59.890210] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-11. [2025-09-17T03:30:00.684175] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:30:00.690146] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-17T03:30:00.691461] [INFO ] [REMOTE ] ELS: Full fetch complete (70075 records). [2025-09-17T03:30:00.691572] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-17T03:30:01.093809] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-17T03:30:01.093985] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-17T03:30:01.095601] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-17T03:30:01.095769] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-17T03:30:01.098051] [DEBUG] [LOCAL ] ELS: Trimmed 70075 records to 49335 (keeping 200 days of data) [2025-09-17T03:30:01.441913] [DEBUG] [LOCAL ] ELS: Primary data saved (49335 records). [2025-09-17T03:30:01.442126] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-17T03:30:01.442236] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELS took 42.5s. Estimated remaining: 3h 59m 13s. Rate: 6.9 symbols/min [2025-09-17T03:30:01.502983] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-17T03:30:01.624815] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:01.625191] [DEBUG] [LOCAL ] EMF: No existing data file found in primary storage. [2025-09-17T03:30:01.640387] [WARN ] [MAIN ] EMF: No existing data found, performing full refresh instead. [2025-09-17T03:30:01.642740] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-17T03:30:01.643709] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:30:01.643769] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-17T03:30:01.651504] [DEBUG] [LOCAL ] EMF: No primary data file found to delete. [2025-09-17T03:30:01.651662] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-17T03:30:02.054040] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:02.071371] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T03:30:02.290173] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-17T03:30:03.090182] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-17T03:30:03.890183] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-11. [2025-09-17T03:30:05.548449] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-09-17T03:30:05.553785] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-17T03:30:05.752108] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T03:30:05.755502] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-17T03:30:06.549883] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (5.05 seconds). [2025-09-17T03:30:06.563669] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-17T03:30:06.597540] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (3.51 seconds). [2025-09-17T03:30:07.090203] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-17T03:30:07.122241] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:30:07.393973] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T03:30:07.397314] [INFO ] [REMOTE ] EMD: Full fetch complete (32175 records). [2025-09-17T03:30:07.397501] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-17T03:30:07.892395] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-17T03:30:07.915797] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-17T03:30:07.916079] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-17T03:30:07.916954] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-17T03:30:07.917037] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-17T03:30:07.918515] [DEBUG] [LOCAL ] EMD: Trimmed 32175 records to 21538 (keeping 200 days of data) [2025-09-17T03:30:08.056481] [DEBUG] [LOCAL ] EMD: Primary data saved (21538 records). [2025-09-17T03:30:08.056631] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-17T03:30:08.056768] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. EMD took 31.9s. Estimated remaining: 3h 58m 59s. Rate: 6.9 symbols/min [2025-09-17T03:30:08.224454] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:08.262338] [DEBUG] [LOCAL ] EMN: Loaded 37814 existing records from primary storage. [2025-09-17T03:30:08.262509] [INFO ] [MAIN ] EMN: Loaded 37814 existing records. [2025-09-17T03:30:08.443082] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:08.443418] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-17T03:30:08.443516] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-17T03:30:08.444909] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-17T03:30:08.445213] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-17T03:30:08.787294] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:30:08.838687] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-17T03:30:08.869190] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T03:30:08.873623] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:08.910160] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:30:09.430578] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:30:09.490139] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-17T03:30:09.999602] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T03:30:10.290163] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-17T03:30:10.981321] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:30:11.090141] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-17T03:30:11.890163] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-17T03:30:12.372221] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T03:30:12.690180] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-11. [2025-09-17T03:30:12.947615] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T03:30:12.954890] [INFO ] [REMOTE ] ELV: Full fetch complete (73052 records). [2025-09-17T03:30:12.955094] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-17T03:30:13.357597] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-17T03:30:13.357736] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-17T03:30:13.358533] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-17T03:30:13.358620] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-17T03:30:13.360436] [DEBUG] [LOCAL ] ELV: Trimmed 73052 records to 50445 (keeping 200 days of data) [2025-09-17T03:30:13.492741] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-17T03:30:13.700118] [DEBUG] [LOCAL ] ELV: Primary data saved (50445 records). [2025-09-17T03:30:13.700291] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-17T03:30:13.700408] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. ELV took 51.0s. Estimated remaining: 3h 58m 43s. Rate: 6.9 symbols/min [2025-09-17T03:30:13.869431] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:13.882164] [DEBUG] [LOCAL ] EMO: Loaded 9509 existing records from primary storage. [2025-09-17T03:30:13.882338] [INFO ] [MAIN ] EMO: Loaded 9509 existing records. [2025-09-17T03:30:14.068826] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:14.069089] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-17T03:30:14.069159] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-17T03:30:14.069589] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-17T03:30:14.069686] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-17T03:30:14.180402] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T03:30:14.295266] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-17T03:30:14.449764] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:14.479910] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T03:30:15.040776] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:30:15.090117] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-17T03:30:15.629442] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T03:30:15.890153] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-17T03:30:16.360696] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T03:30:16.361677] [INFO ] [REMOTE ] EMF: Full fetch complete (7394 records). [2025-09-17T03:30:16.361762] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-17T03:30:16.693311] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-11. [2025-09-17T03:30:16.730224] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-17T03:30:16.730319] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-17T03:30:16.730669] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-17T03:30:16.730767] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-17T03:30:16.731262] [DEBUG] [LOCAL ] EMF: Trimmed 7394 records to 3675 (keeping 200 days of data) [2025-09-17T03:30:16.755168] [DEBUG] [LOCAL ] EMF: Primary data saved (3675 records). [2025-09-17T03:30:16.755278] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-17T03:30:16.755356] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EMF took 15.3s. Estimated remaining: 3h 58m 22s. Rate: 6.9 symbols/min [2025-09-17T03:30:16.928568] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:16.933359] [DEBUG] [LOCAL ] EMP: Loaded 2224 existing records from primary storage. [2025-09-17T03:30:16.933464] [INFO ] [MAIN ] EMP: Loaded 2224 existing records. [2025-09-17T03:30:17.112015] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:17.112290] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-17T03:30:17.112350] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-17T03:30:17.112526] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-17T03:30:17.112584] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-17T03:30:17.487262] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:17.490075] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-11. [2025-09-17T03:30:18.031949] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T03:30:18.290148] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-17T03:30:18.603896] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T03:30:19.090153] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-17T03:30:19.844060] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T03:30:19.843765] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:30:19.890119] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-17T03:30:20.690134] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-17T03:30:20.701717] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T03:30:21.287557] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T03:30:21.490131] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-17T03:30:21.986258] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:30:22.290133] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-17T03:30:23.090142] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-17T03:30:23.097753] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T03:30:23.890129] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-17T03:30:24.441340] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T03:30:24.690104] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-17T03:30:24.751573] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:30:25.490144] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-17T03:30:26.290123] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-17T03:30:26.324959] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:30:27.018292] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:30:27.090106] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-17T03:30:27.227368] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T03:30:27.890134] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-17T03:30:27.986447] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:30:28.690133] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-17T03:30:29.490132] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-17T03:30:29.513220] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T03:30:29.554279] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:30:30.290145] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-17T03:30:31.090143] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-17T03:30:31.339320] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T03:30:31.890172] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-17T03:30:31.914722] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:30:32.010203] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T03:30:32.690186] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-17T03:30:33.243764] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T03:30:33.419352] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:30:33.490096] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-17T03:30:34.290142] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-17T03:30:35.090117] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-17T03:30:35.390798] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:30:35.750196] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T03:30:35.750338] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T03:30:35.890109] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-17T03:30:36.484321] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:30:36.690190] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-17T03:30:37.490137] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-17T03:30:38.055536] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T03:30:38.290139] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-17T03:30:38.514238] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:30:38.890033] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:30:39.090178] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-17T03:30:39.890201] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-17T03:30:40.581228] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:30:40.690166] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-17T03:30:40.938013] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T03:30:41.490150] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-17T03:30:42.290107] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-17T03:30:42.364331] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T03:30:42.741232] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T03:30:42.752959] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T03:30:43.090168] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-17T03:30:43.890192] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-17T03:30:44.303535] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:30:44.309083] [INFO ] [REMOTE ] EME: Full fetch complete (46557 records). [2025-09-17T03:30:44.309278] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-17T03:30:44.694280] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-17T03:30:44.709239] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-17T03:30:44.710139] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-17T03:30:44.710966] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-17T03:30:44.711145] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-17T03:30:44.712498] [DEBUG] [LOCAL ] EME: Trimmed 46557 records to 31886 (keeping 200 days of data) [2025-09-17T03:30:44.823081] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T03:30:44.933704] [DEBUG] [LOCAL ] EME: Primary data saved (31886 records). [2025-09-17T03:30:44.933876] [INFO ] [MAIN ] EME: Full history saved. [2025-09-17T03:30:44.934000] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. EME took 47.2s. Estimated remaining: 3h 58m 57s. Rate: 6.9 symbols/min [2025-09-17T03:30:45.105034] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:45.105231] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-09-17T03:30:45.105276] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-09-17T03:30:45.105382] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-17T03:30:45.105443] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-17T03:30:45.105491] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-09-17T03:30:45.105531] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-17T03:30:45.462838] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:45.490095] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-11. [2025-09-17T03:30:46.290119] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-17T03:30:46.710214] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T03:30:46.785792] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T03:30:46.786872] [INFO ] [REMOTE ] EMP: Full fetch complete (4277 records). [2025-09-17T03:30:46.786961] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-17T03:30:47.095202] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-17T03:30:47.164849] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-17T03:30:47.165130] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-17T03:30:47.165290] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-17T03:30:47.165465] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-17T03:30:47.165974] [DEBUG] [LOCAL ] EMP: Trimmed 4277 records to 2984 (keeping 200 days of data) [2025-09-17T03:30:47.185976] [DEBUG] [LOCAL ] EMP: Primary data saved (2984 records). [2025-09-17T03:30:47.186097] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-17T03:30:47.186209] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMP took 30.4s. Estimated remaining: 3h 58m 33s. Rate: 6.9 symbols/min [2025-09-17T03:30:47.364930] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:47.396895] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T03:30:47.451162] [DEBUG] [LOCAL ] ENB: Loaded 39899 existing records from primary storage. [2025-09-17T03:30:47.451336] [INFO ] [MAIN ] ENB: Loaded 39899 existing records. [2025-09-17T03:30:47.644176] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:47.644452] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-17T03:30:47.644510] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-17T03:30:47.645504] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-17T03:30:47.645565] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-17T03:30:47.895269] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-17T03:30:48.012024] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:48.019272] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:30:48.022212] [INFO ] [REMOTE ] EMO: Full fetch complete (17163 records). [2025-09-17T03:30:48.022299] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-17T03:30:48.398702] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-17T03:30:48.398811] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-17T03:30:48.399268] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-17T03:30:48.399324] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-17T03:30:48.399977] [DEBUG] [LOCAL ] EMO: Trimmed 17163 records to 12202 (keeping 200 days of data) [2025-09-17T03:30:48.477008] [DEBUG] [LOCAL ] EMO: Primary data saved (12202 records). [2025-09-17T03:30:48.477160] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-17T03:30:48.477252] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMO took 34.8s. Estimated remaining: 3h 58m 8s. Rate: 6.9 symbols/min [2025-09-17T03:30:48.648854] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:48.649041] [DEBUG] [LOCAL ] ENFY: No existing data file found in primary storage. [2025-09-17T03:30:48.649082] [WARN ] [MAIN ] ENFY: No existing data found, performing full refresh instead. [2025-09-17T03:30:48.649187] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-17T03:30:48.649240] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-17T03:30:48.649285] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-17T03:30:48.649328] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-17T03:30:48.695198] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-17T03:30:49.014274] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:49.490119] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-11. [2025-09-17T03:30:49.746405] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:30:50.290136] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-11. [2025-09-17T03:30:50.579503] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T03:30:50.609556] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:30:51.090130] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-17T03:30:51.475317] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T03:30:51.782064] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:30:51.890194] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-17T03:30:52.691736] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-17T03:30:52.693610] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T03:30:53.490131] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-17T03:30:54.290197] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-17T03:30:54.589022] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T03:30:55.090159] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-17T03:30:55.433813] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T03:30:55.895190] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-17T03:30:55.905993] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T03:30:55.912840] [INFO ] [REMOTE ] EMN: Full fetch complete (71662 records). [2025-09-17T03:30:55.913039] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-17T03:30:56.301791] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-17T03:30:56.301922] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-17T03:30:56.302770] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-17T03:30:56.302846] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-17T03:30:56.304812] [DEBUG] [LOCAL ] EMN: Trimmed 71662 records to 50214 (keeping 200 days of data) [2025-09-17T03:30:56.623097] [DEBUG] [LOCAL ] EMN: Primary data saved (50214 records). [2025-09-17T03:30:56.623265] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-17T03:30:56.623364] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMN took 48.6s. Estimated remaining: 3h 57m 58s. Rate: 6.9 symbols/min [2025-09-17T03:30:56.698068] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-17T03:30:56.807861] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:56.808133] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-09-17T03:30:56.808275] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-09-17T03:30:56.808513] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-17T03:30:56.808860] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-17T03:30:56.809031] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-17T03:30:56.809165] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-17T03:30:57.220751] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:57.223125] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T03:30:57.344986] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T03:30:57.490145] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-17T03:30:57.661951] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:30:58.290173] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-17T03:30:59.090215] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-11. [2025-09-17T03:30:59.413943] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T03:30:59.839881] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:30:59.890175] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-17T03:31:00.223144] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:31:00.690142] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-17T03:31:01.296249] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:31:01.490183] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-17T03:31:02.290200] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-17T03:31:02.582512] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T03:31:02.753977] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:31:02.974570] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T03:31:03.090143] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-17T03:31:03.890105] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-17T03:31:04.284627] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T03:31:04.690206] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-17T03:31:05.490136] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-17T03:31:05.816303] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T03:31:06.290165] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-17T03:31:06.657120] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:31:07.003752] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T03:31:07.090114] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-17T03:31:07.890173] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-17T03:31:08.147328] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:31:08.177137] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-17T03:31:08.690178] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-17T03:31:09.000993] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T03:31:09.033464] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T03:31:09.490193] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-17T03:31:10.290159] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-17T03:31:11.090133] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-17T03:31:11.361394] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:31:11.685731] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:31:11.805929] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:31:11.890087] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-17T03:31:12.451051] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T03:31:12.690181] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-17T03:31:13.490180] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-17T03:31:14.092334] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:31:14.290165] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-17T03:31:14.841009] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T03:31:15.090148] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-17T03:31:15.426715] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T03:31:15.890160] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-17T03:31:16.404482] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T03:31:16.405952] [INFO ] [REMOTE ] ENFY: Full fetch complete (5734 records). [2025-09-17T03:31:16.406076] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-17T03:31:16.700238] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-17T03:31:16.788877] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-17T03:31:16.788993] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-17T03:31:16.789325] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-17T03:31:16.789448] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-17T03:31:16.790085] [DEBUG] [LOCAL ] ENFY: Trimmed 5734 records to 3056 (keeping 200 days of data) [2025-09-17T03:31:16.808302] [DEBUG] [LOCAL ] ENFY: Primary data saved (3056 records). [2025-09-17T03:31:16.808500] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-17T03:31:16.808599] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. ENFY took 28.3s. Estimated remaining: 3h 58m 15s. Rate: 6.9 symbols/min [2025-09-17T03:31:16.985551] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:16.985992] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-09-17T03:31:16.986100] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-09-17T03:31:16.986303] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-17T03:31:16.986374] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-17T03:31:16.986500] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-09-17T03:31:16.986792] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-17T03:31:17.085603] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:31:17.390098] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:17.490128] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-17T03:31:18.290133] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-17T03:31:18.589241] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T03:31:19.067463] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T03:31:19.075609] [INFO ] [REMOTE ] EMR: Full fetch complete (76936 records). [2025-09-17T03:31:19.075805] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-17T03:31:19.097279] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-17T03:31:19.472939] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-17T03:31:19.473042] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-17T03:31:19.473894] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-17T03:31:19.473950] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-17T03:31:19.475453] [DEBUG] [LOCAL ] EMR: Trimmed 76936 records to 53256 (keeping 200 days of data) [2025-09-17T03:31:19.825259] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:31:19.845312] [DEBUG] [LOCAL ] EMR: Primary data saved (53256 records). [2025-09-17T03:31:19.845449] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-17T03:31:19.845524] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 34.9s. Estimated remaining: 3h 57m 53s. Rate: 6.9 symbols/min [2025-09-17T03:31:19.900247] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-11. [2025-09-17T03:31:20.020755] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:20.020961] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-09-17T03:31:20.021006] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-09-17T03:31:20.021126] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-17T03:31:20.021177] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-17T03:31:20.021228] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-09-17T03:31:20.021275] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-17T03:31:20.384692] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:20.417161] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T03:31:20.690109] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-17T03:31:20.743473] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T03:31:21.490126] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-17T03:31:22.029868] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T03:31:22.171948] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:31:22.290132] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-11. [2025-09-17T03:31:23.090130] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-17T03:31:23.688202] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T03:31:23.890137] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-17T03:31:24.461987] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T03:31:24.587813] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:31:24.690142] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-17T03:31:25.490121] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-17T03:31:25.938203] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T03:31:25.942559] [INFO ] [REMOTE ] ENIC: Full fetch complete (51132 records). [2025-09-17T03:31:25.942693] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-17T03:31:26.047571] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:31:26.292723] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-17T03:31:26.328396] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-17T03:31:26.328494] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-17T03:31:26.329184] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-17T03:31:26.329267] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-17T03:31:26.330371] [DEBUG] [LOCAL ] ENIC: Trimmed 51132 records to 36932 (keeping 200 days of data) [2025-09-17T03:31:26.538522] [DEBUG] [LOCAL ] ENIC: Primary data saved (36932 records). [2025-09-17T03:31:26.538704] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-17T03:31:26.538796] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENIC took 29.9s. Estimated remaining: 3h 57m 40s. Rate: 6.9 symbols/min [2025-09-17T03:31:26.732853] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:26.733074] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-17T03:31:26.733119] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-17T03:31:26.733233] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-17T03:31:26.733309] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-17T03:31:26.733362] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-17T03:31:26.733403] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-17T03:31:26.841440] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T03:31:27.095230] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-17T03:31:27.100144] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:27.672694] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:31:27.890127] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-17T03:31:28.690201] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-17T03:31:29.145156] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T03:31:29.319763] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:31:29.490123] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-17T03:31:30.290131] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-11. [2025-09-17T03:31:31.074299] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T03:31:31.090074] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-17T03:31:31.726454] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:31:31.890100] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-17T03:31:32.615577] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:31:32.690140] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-17T03:31:33.490148] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-17T03:31:33.791602] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T03:31:34.019037] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T03:31:34.290202] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-17T03:31:34.746999] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T03:31:35.090146] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-17T03:31:35.627448] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T03:31:35.890145] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-17T03:31:36.690152] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-17T03:31:36.736137] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:31:37.142826] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T03:31:37.490140] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-17T03:31:37.673283] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T03:31:37.679955] [INFO ] [REMOTE ] ENB: Full fetch complete (77356 records). [2025-09-17T03:31:37.680109] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-17T03:31:37.982662] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T03:31:38.082323] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-17T03:31:38.082438] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-17T03:31:38.083370] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-17T03:31:38.083445] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-17T03:31:38.085061] [DEBUG] [LOCAL ] ENB: Trimmed 77356 records to 53528 (keeping 200 days of data) [2025-09-17T03:31:38.290223] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-17T03:31:38.438527] [DEBUG] [LOCAL ] ENB: Primary data saved (53528 records). [2025-09-17T03:31:38.438710] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-17T03:31:38.438810] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 51.3s. Estimated remaining: 3h 57m 38s. Rate: 6.9 symbols/min [2025-09-17T03:31:38.614156] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:38.614364] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-09-17T03:31:38.614416] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-09-17T03:31:38.614531] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-17T03:31:38.614608] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-17T03:31:38.614689] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-17T03:31:38.614734] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-17T03:31:39.019627] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:39.090098] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-17T03:31:39.600146] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T03:31:39.890142] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-17T03:31:40.012366] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T03:31:40.319485] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T03:31:40.320410] [INFO ] [REMOTE ] ENO: Full fetch complete (3248 records). [2025-09-17T03:31:40.320498] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-17T03:31:40.680152] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-17T03:31:40.680258] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-17T03:31:40.680383] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-17T03:31:40.680432] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-17T03:31:40.680837] [DEBUG] [LOCAL ] ENO: Trimmed 3248 records to 2001 (keeping 200 days of data) [2025-09-17T03:31:40.690331] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-11. [2025-09-17T03:31:40.698719] [DEBUG] [LOCAL ] ENO: Primary data saved (2001 records). [2025-09-17T03:31:40.698875] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-17T03:31:40.699006] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENO took 23.9s. Estimated remaining: 3h 57m 15s. Rate: 6.9 symbols/min [2025-09-17T03:31:40.870244] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:40.870452] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-09-17T03:31:40.870523] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-09-17T03:31:40.870696] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-17T03:31:40.870765] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-17T03:31:40.870842] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-17T03:31:40.870911] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-17T03:31:41.223842] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:41.490105] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-17T03:31:41.963897] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:31:42.290176] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-11. [2025-09-17T03:31:43.034950] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T03:31:43.090113] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-17T03:31:43.383085] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:31:43.890142] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-17T03:31:44.617972] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:31:44.690170] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-17T03:31:45.435526] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:31:45.490090] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-17T03:31:46.094417] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T03:31:46.290158] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-17T03:31:46.983859] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:31:47.090164] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-17T03:31:47.167884] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T03:31:47.890153] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-17T03:31:48.690146] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-17T03:31:48.752958] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:31:49.490121] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-17T03:31:49.524178] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:31:50.126983] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T03:31:50.290112] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-17T03:31:50.595945] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T03:31:51.090148] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-17T03:31:51.873936] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:31:51.890122] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-17T03:31:52.415042] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T03:31:52.690135] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-17T03:31:53.478410] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:31:53.490073] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-17T03:31:54.041464] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T03:31:54.290154] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-17T03:31:54.970772] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:31:54.976465] [INFO ] [REMOTE ] ENOV: Full fetch complete (62748 records). [2025-09-17T03:31:54.976613] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-17T03:31:55.095182] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-17T03:31:55.381276] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-17T03:31:55.381395] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-17T03:31:55.382201] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-17T03:31:55.382267] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-17T03:31:55.383665] [DEBUG] [LOCAL ] ENOV: Trimmed 62748 records to 45347 (keeping 200 days of data) [2025-09-17T03:31:55.492837] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:31:55.675634] [DEBUG] [LOCAL ] ENOV: Primary data saved (45347 records). [2025-09-17T03:31:55.675821] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-17T03:31:55.675911] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 35.8s. Estimated remaining: 3h 57m 20s. Rate: 6.9 symbols/min [2025-09-17T03:31:55.845729] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:55.857486] [DEBUG] [LOCAL ] EOD: Loaded 10922 existing records from primary storage. [2025-09-17T03:31:55.857661] [INFO ] [MAIN ] EOD: Loaded 10922 existing records. [2025-09-17T03:31:55.900129] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-17T03:31:56.041343] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:31:56.041609] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-17T03:31:56.041690] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-17T03:31:56.042199] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-17T03:31:56.042262] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-17T03:31:56.402829] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:56.690151] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-11. [2025-09-17T03:31:56.974028] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T03:31:57.001000] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:31:57.490121] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-17T03:31:57.491031] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:31:58.290124] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-17T03:31:58.815456] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:31:58.994053] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T03:31:59.090137] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-17T03:31:59.890158] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-17T03:32:00.358520] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T03:32:00.690147] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-17T03:32:01.314024] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:32:01.490178] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-17T03:32:01.759366] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:32:02.290192] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-17T03:32:02.956008] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:32:02.961265] [INFO ] [REMOTE ] ENR: Full fetch complete (57740 records). [2025-09-17T03:32:02.961413] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-17T03:32:03.102123] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-17T03:32:03.355221] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-17T03:32:03.355329] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-17T03:32:03.356169] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-17T03:32:03.356235] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-17T03:32:03.357478] [DEBUG] [LOCAL ] ENR: Trimmed 57740 records to 42493 (keeping 200 days of data) [2025-09-17T03:32:03.594951] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T03:32:03.647591] [DEBUG] [LOCAL ] ENR: Primary data saved (42493 records). [2025-09-17T03:32:03.647778] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-17T03:32:03.647868] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENR took 37.1s. Estimated remaining: 3h 57m 10s. Rate: 6.9 symbols/min [2025-09-17T03:32:03.819950] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:03.830679] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T03:32:03.875674] [DEBUG] [LOCAL ] EOG: Loaded 39747 existing records from primary storage. [2025-09-17T03:32:03.875865] [INFO ] [MAIN ] EOG: Loaded 39747 existing records. [2025-09-17T03:32:03.896444] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-17T03:32:04.060851] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:04.061122] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-17T03:32:04.061185] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-17T03:32:04.062179] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-17T03:32:04.062240] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-17T03:32:04.442926] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:04.690174] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-17T03:32:05.390486] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:32:05.490108] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-11. [2025-09-17T03:32:05.881095] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T03:32:06.290191] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-17T03:32:07.090147] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-17T03:32:07.119121] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T03:32:07.369145] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T03:32:07.890165] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-17T03:32:08.055764] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T03:32:08.690137] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-17T03:32:08.773005] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T03:32:09.490136] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-17T03:32:09.782778] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T03:32:10.290139] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-17T03:32:10.792294] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:32:11.090137] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-17T03:32:11.249254] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T03:32:11.890166] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-17T03:32:12.315088] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:32:12.690155] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-17T03:32:13.054598] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:32:13.058984] [INFO ] [REMOTE ] ENS: Full fetch complete (41437 records). [2025-09-17T03:32:13.059116] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-17T03:32:13.480665] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-17T03:32:13.480788] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-17T03:32:13.481422] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-17T03:32:13.481485] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-17T03:32:13.482577] [DEBUG] [LOCAL ] ENS: Trimmed 41437 records to 29286 (keeping 200 days of data) [2025-09-17T03:32:13.546009] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-17T03:32:13.679960] [DEBUG] [LOCAL ] ENS: Primary data saved (29286 records). [2025-09-17T03:32:13.680137] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-17T03:32:13.680227] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENS took 35.2s. Estimated remaining: 3h 57m 4s. Rate: 6.9 symbols/min [2025-09-17T03:32:13.860111] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:13.869808] [DEBUG] [LOCAL ] EOI: Loaded 6949 existing records from primary storage. [2025-09-17T03:32:13.869973] [INFO ] [MAIN ] EOI: Loaded 6949 existing records. [2025-09-17T03:32:14.062729] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:14.063032] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-17T03:32:14.063094] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-17T03:32:14.063455] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-17T03:32:14.063526] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-17T03:32:14.313390] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-17T03:32:14.432418] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:14.675588] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T03:32:14.695836] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:32:14.699536] [INFO ] [REMOTE ] ENVA: Full fetch complete (36153 records). [2025-09-17T03:32:14.699681] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-17T03:32:15.072742] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-17T03:32:15.072877] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-17T03:32:15.073524] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-17T03:32:15.073595] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-17T03:32:15.074566] [DEBUG] [LOCAL ] ENVA: Trimmed 36153 records to 25610 (keeping 200 days of data) [2025-09-17T03:32:15.125321] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-17T03:32:15.200686] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T03:32:15.240215] [DEBUG] [LOCAL ] ENVA: Primary data saved (25610 records). [2025-09-17T03:32:15.240370] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-17T03:32:15.240469] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. ENVA took 34.5s. Estimated remaining: 3h 56m 39s. Rate: 6.9 symbols/min [2025-09-17T03:32:15.409143] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:15.409341] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-09-17T03:32:15.409390] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-09-17T03:32:15.409519] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-17T03:32:15.409571] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-17T03:32:15.409617] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-09-17T03:32:15.409677] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-17T03:32:15.759753] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:15.890123] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-17T03:32:16.690116] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-11. [2025-09-17T03:32:16.850702] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:32:17.028881] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T03:32:17.361470] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T03:32:17.490131] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-17T03:32:18.290179] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-17T03:32:19.090180] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-17T03:32:19.195811] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:32:19.481213] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T03:32:19.890095] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-17T03:32:20.233806] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:32:20.690149] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-11. [2025-09-17T03:32:20.843980] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T03:32:21.490124] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-17T03:32:21.625668] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T03:32:22.290118] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-17T03:32:22.303537] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:32:22.305536] [INFO ] [REMOTE ] EOD: Full fetch complete (19687 records). [2025-09-17T03:32:22.305620] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-17T03:32:22.693272] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-17T03:32:22.693475] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-17T03:32:22.694003] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-17T03:32:22.694081] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-17T03:32:22.694779] [DEBUG] [LOCAL ] EOD: Trimmed 19687 records to 14172 (keeping 200 days of data) [2025-09-17T03:32:22.776150] [DEBUG] [LOCAL ] EOD: Primary data saved (14172 records). [2025-09-17T03:32:22.776319] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-17T03:32:22.776438] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. EOD took 27.1s. Estimated remaining: 3h 56m 28s. Rate: 6.9 symbols/min [2025-09-17T03:32:22.944191] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:22.951079] [DEBUG] [LOCAL ] EOT: Loaded 5065 existing records from primary storage. [2025-09-17T03:32:22.951206] [INFO ] [MAIN ] EOT: Loaded 5065 existing records. [2025-09-17T03:32:23.095251] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-17T03:32:23.129498] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:23.130632] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-17T03:32:23.130780] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-17T03:32:23.138597] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-17T03:32:23.138937] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T03:32:23.139146] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-17T03:32:23.504027] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:23.890155] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-17T03:32:24.133529] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T03:32:24.690193] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-11. [2025-09-17T03:32:25.455255] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T03:32:25.490080] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-17T03:32:25.789409] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:32:26.290120] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-17T03:32:26.538379] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:32:27.090191] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-17T03:32:27.895524] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-17T03:32:27.897144] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:32:28.239031] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T03:32:28.690132] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-17T03:32:28.748012] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T03:32:29.440602] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T03:32:29.490083] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-17T03:32:30.253204] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T03:32:30.290127] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-17T03:32:31.090188] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-17T03:32:31.160884] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T03:32:31.890163] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-17T03:32:32.255694] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T03:32:32.690145] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-17T03:32:33.490109] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-17T03:32:33.798968] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T03:32:33.876267] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T03:32:34.150869] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:32:34.290147] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-17T03:32:35.090146] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-17T03:32:35.890175] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-17T03:32:36.082881] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:32:36.204058] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T03:32:36.667417] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T03:32:36.690072] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-17T03:32:37.105799] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T03:32:37.490150] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-17T03:32:38.132190] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T03:32:38.290166] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-17T03:32:39.038663] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:32:39.090154] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-17T03:32:39.617965] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T03:32:39.890191] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-17T03:32:40.535849] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T03:32:40.538130] [INFO ] [REMOTE ] EOT: Full fetch complete (10811 records). [2025-09-17T03:32:40.538272] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-17T03:32:40.696888] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-17T03:32:40.920011] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-17T03:32:40.920132] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-17T03:32:40.920546] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-17T03:32:40.920598] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-17T03:32:40.921063] [DEBUG] [LOCAL ] EOT: Trimmed 10811 records to 6764 (keeping 200 days of data) [2025-09-17T03:32:40.962933] [DEBUG] [LOCAL ] EOT: Primary data saved (6764 records). [2025-09-17T03:32:40.963081] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-17T03:32:40.963178] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOT took 18.2s. Estimated remaining: 3h 56m 40s. Rate: 6.9 symbols/min [2025-09-17T03:32:41.130497] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:41.148636] [DEBUG] [LOCAL ] EPAC: Loaded 19167 existing records from primary storage. [2025-09-17T03:32:41.148809] [INFO ] [MAIN ] EPAC: Loaded 19167 existing records. [2025-09-17T03:32:41.325366] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:41.325616] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-17T03:32:41.325697] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-17T03:32:41.326351] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-17T03:32:41.326421] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-17T03:32:41.504524] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-17T03:32:41.708227] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:41.717594] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:32:42.290194] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-11. [2025-09-17T03:32:43.090110] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-17T03:32:43.586487] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T03:32:43.587654] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:32:43.890157] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-17T03:32:44.196281] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T03:32:44.690206] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-17T03:32:45.490231] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-17T03:32:45.713820] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:32:45.747939] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T03:32:46.290254] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-17T03:32:46.457117] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T03:32:47.090172] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-17T03:32:47.337143] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T03:32:47.890175] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-17T03:32:47.948848] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:32:48.690176] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-17T03:32:48.987342] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:32:49.490152] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-17T03:32:49.587615] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:32:50.029147] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T03:32:50.290131] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-17T03:32:51.084786] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T03:32:51.090082] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-17T03:32:51.890171] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-17T03:32:51.897261] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:32:51.899714] [INFO ] [REMOTE ] EOS: Full fetch complete (23051 records). [2025-09-17T03:32:51.899896] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-17T03:32:52.305490] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-17T03:32:52.305636] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-17T03:32:52.306193] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-17T03:32:52.306268] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-17T03:32:52.306992] [DEBUG] [LOCAL ] EOS: Trimmed 23051 records to 15587 (keeping 200 days of data) [2025-09-17T03:32:52.404669] [DEBUG] [LOCAL ] EOS: Primary data saved (15587 records). [2025-09-17T03:32:52.404832] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-17T03:32:52.404920] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOS took 37.2s. Estimated remaining: 3h 56m 37s. Rate: 6.9 symbols/min [2025-09-17T03:32:52.571566] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:52.571767] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-09-17T03:32:52.571852] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-09-17T03:32:52.571969] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-17T03:32:52.572029] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-17T03:32:52.572078] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-09-17T03:32:52.572120] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-17T03:32:52.695237] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-17T03:32:52.943492] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:53.053515] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T03:32:53.490136] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-17T03:32:53.650820] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T03:32:54.290199] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-11. [2025-09-17T03:32:54.904295] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T03:32:55.090169] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-17T03:32:55.841503] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T03:32:55.843258] [INFO ] [REMOTE ] EOI: Full fetch complete (15936 records). [2025-09-17T03:32:55.843360] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-17T03:32:55.897425] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-17T03:32:56.162441] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:32:56.250966] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-17T03:32:56.251072] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-17T03:32:56.251457] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-17T03:32:56.251537] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-17T03:32:56.252118] [DEBUG] [LOCAL ] EOI: Trimmed 15936 records to 10634 (keeping 200 days of data) [2025-09-17T03:32:56.319401] [DEBUG] [LOCAL ] EOI: Primary data saved (10634 records). [2025-09-17T03:32:56.319566] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-17T03:32:56.319700] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOI took 42.6s. Estimated remaining: 3h 56m 18s. Rate: 6.9 symbols/min [2025-09-17T03:32:56.496327] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:56.496559] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-09-17T03:32:56.496619] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-09-17T03:32:56.496823] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-17T03:32:56.496883] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-17T03:32:56.496957] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-17T03:32:56.497026] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-17T03:32:56.697548] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-17T03:32:56.865126] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:57.490121] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-17T03:32:57.692797] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T03:32:57.700349] [INFO ] [REMOTE ] EOG: Full fetch complete (77110 records). [2025-09-17T03:32:57.700566] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-17T03:32:58.120038] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-17T03:32:58.120245] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-17T03:32:58.121607] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-17T03:32:58.121710] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-17T03:32:58.125031] [DEBUG] [LOCAL ] EOG: Trimmed 77110 records to 53343 (keeping 200 days of data) [2025-09-17T03:32:58.319527] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-11. [2025-09-17T03:32:58.386303] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:32:58.505893] [DEBUG] [LOCAL ] EOG: Primary data saved (53343 records). [2025-09-17T03:32:58.506062] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-17T03:32:58.507020] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOG took 54.9s. Estimated remaining: 3h 55m 55s. Rate: 6.9 symbols/min [2025-09-17T03:32:58.676176] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:58.722756] [DEBUG] [LOCAL ] EPD: Loaded 39972 existing records from primary storage. [2025-09-17T03:32:58.722947] [INFO ] [MAIN ] EPD: Loaded 39972 existing records. [2025-09-17T03:32:58.886182] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:32:58.925377] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:58.925924] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-17T03:32:58.926267] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-17T03:32:58.927233] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-17T03:32:58.927336] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-17T03:32:59.108221] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-17T03:32:59.298378] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:59.691778] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T03:32:59.890164] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-17T03:33:00.329789] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T03:33:00.690138] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-17T03:33:01.313307] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T03:33:01.490135] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-17T03:33:02.290150] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-11. [2025-09-17T03:33:02.505596] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:33:03.090147] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-17T03:33:03.890135] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-17T03:33:04.884042] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (3.39 seconds). [2025-09-17T03:33:04.892070] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-17T03:33:05.291445] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T03:33:05.380444] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-11 (3.09 seconds). [2025-09-17T03:33:05.412244] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T03:33:05.490198] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-17T03:33:06.030854] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T03:33:06.290143] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-17T03:33:07.090184] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-17T03:33:07.273105] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:33:07.854343] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:33:07.890089] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-17T03:33:08.690160] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-17T03:33:08.826762] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T03:33:09.323249] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:33:09.490233] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-17T03:33:10.290169] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-17T03:33:10.456051] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:33:11.068954] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T03:33:11.090109] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-17T03:33:11.672014] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T03:33:11.890133] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-17T03:33:12.691530] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-17T03:33:12.696633] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:33:13.065711] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T03:33:13.490131] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-17T03:33:14.290171] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-17T03:33:14.410497] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:33:14.630823] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T03:33:14.634508] [INFO ] [REMOTE ] EPAC: Full fetch complete (38801 records). [2025-09-17T03:33:14.638026] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-17T03:33:15.025277] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-17T03:33:15.025400] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-17T03:33:15.026057] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-17T03:33:15.026117] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-17T03:33:15.027122] [DEBUG] [LOCAL ] EPAC: Trimmed 38801 records to 26910 (keeping 200 days of data) [2025-09-17T03:33:15.092511] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-17T03:33:15.194461] [DEBUG] [LOCAL ] EPAC: Primary data saved (26910 records). [2025-09-17T03:33:15.194669] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-17T03:33:15.194778] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 34.2s. Estimated remaining: 3h 56m 3s. Rate: 6.9 symbols/min [2025-09-17T03:33:15.363961] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:15.364185] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-09-17T03:33:15.364240] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-09-17T03:33:15.364349] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-17T03:33:15.364401] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-17T03:33:15.364461] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-09-17T03:33:15.364506] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-17T03:33:15.727701] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:15.861417] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:33:15.890138] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-17T03:33:16.653591] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:33:16.690098] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-17T03:33:17.432022] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:33:17.490130] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-17T03:33:18.268316] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:33:18.290096] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-17T03:33:19.079226] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:33:19.084454] [INFO ] [REMOTE ] EPC: Full fetch complete (56460 records). [2025-09-17T03:33:19.084682] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-17T03:33:19.096584] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-11. [2025-09-17T03:33:19.471351] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-17T03:33:19.471456] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-17T03:33:19.472172] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-17T03:33:19.472230] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-17T03:33:19.473469] [DEBUG] [LOCAL ] EPC: Trimmed 56460 records to 39929 (keeping 200 days of data) [2025-09-17T03:33:19.735993] [DEBUG] [LOCAL ] EPC: Primary data saved (39929 records). [2025-09-17T03:33:19.736176] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-17T03:33:19.736279] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPC took 23.4s. Estimated remaining: 3h 55m 46s. Rate: 6.9 symbols/min [2025-09-17T03:33:19.894991] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-17T03:33:19.912371] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:19.956697] [DEBUG] [LOCAL ] EPRT: Loaded 35910 existing records from primary storage. [2025-09-17T03:33:19.956957] [INFO ] [MAIN ] EPRT: Loaded 35910 existing records. [2025-09-17T03:33:20.136422] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:20.136841] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-17T03:33:20.136962] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-17T03:33:20.145256] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-17T03:33:20.158322] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-17T03:33:20.223456] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T03:33:20.527950] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:20.555583] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T03:33:20.690121] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-17T03:33:21.490146] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-11. [2025-09-17T03:33:21.541139] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:33:22.221519] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:33:22.290093] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-17T03:33:23.080160] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T03:33:23.090081] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-17T03:33:23.815800] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T03:33:23.890099] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-17T03:33:24.667664] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:33:24.690081] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-17T03:33:25.487838] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T03:33:25.492911] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-17T03:33:25.493920] [INFO ] [REMOTE ] EPAM: Full fetch complete (55793 records). [2025-09-17T03:33:25.494011] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-17T03:33:25.880942] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-17T03:33:25.881057] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-17T03:33:25.881902] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-17T03:33:25.881997] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-17T03:33:25.883522] [DEBUG] [LOCAL ] EPAM: Trimmed 55793 records to 39770 (keeping 200 days of data) [2025-09-17T03:33:26.013773] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:33:26.159356] [DEBUG] [LOCAL ] EPAM: Primary data saved (39770 records). [2025-09-17T03:33:26.159541] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-17T03:33:26.159668] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPAM took 33.8s. Estimated remaining: 3h 55m 32s. Rate: 6.9 symbols/min [2025-09-17T03:33:26.298192] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-17T03:33:26.328359] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:26.338217] [DEBUG] [LOCAL ] EQBK: Loaded 8045 existing records from primary storage. [2025-09-17T03:33:26.338353] [INFO ] [MAIN ] EQBK: Loaded 8045 existing records. [2025-09-17T03:33:26.513189] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:26.513452] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-17T03:33:26.513529] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-17T03:33:26.514105] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-17T03:33:26.514174] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-17T03:33:26.865784] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:27.090117] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-17T03:33:27.376609] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T03:33:27.890129] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-17T03:33:28.060109] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T03:33:28.578991] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:33:28.690156] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-11. [2025-09-17T03:33:29.490113] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-17T03:33:29.504208] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:33:29.906700] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T03:33:30.290183] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-17T03:33:31.090099] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-17T03:33:31.201266] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T03:33:31.859805] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T03:33:31.890091] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-17T03:33:32.690139] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-17T03:33:33.152557] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T03:33:33.490159] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-17T03:33:33.602352] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T03:33:33.820714] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:33:34.290137] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-17T03:33:35.090113] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-17T03:33:35.139145] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T03:33:35.491897] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T03:33:35.890122] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-17T03:33:36.496609] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T03:33:36.690131] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-17T03:33:37.482188] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T03:33:37.490081] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-17T03:33:37.632653] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T03:33:37.970844] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T03:33:38.290165] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-17T03:33:39.090145] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-17T03:33:39.890131] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-17T03:33:40.224776] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T03:33:40.690173] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-17T03:33:40.783178] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T03:33:40.819771] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T03:33:41.490185] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-17T03:33:42.227125] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T03:33:42.290127] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-17T03:33:42.718701] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T03:33:43.090130] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-17T03:33:43.879326] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T03:33:43.890082] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-17T03:33:43.945087] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T03:33:44.690161] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-17T03:33:45.490144] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-17T03:33:45.516453] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:33:46.290176] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-17T03:33:46.517669] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:33:46.693074] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:33:47.090170] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-17T03:33:47.890171] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-17T03:33:47.972404] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T03:33:48.165677] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T03:33:48.690160] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-17T03:33:49.494578] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-17T03:33:49.499859] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T03:33:49.525938] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:33:49.528254] [INFO ] [REMOTE ] EQBK: Full fetch complete (15362 records). [2025-09-17T03:33:49.528380] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-17T03:33:49.903665] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-17T03:33:49.903776] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-17T03:33:49.904149] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-17T03:33:49.904203] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-17T03:33:49.904829] [DEBUG] [LOCAL ] EQBK: Trimmed 15362 records to 10852 (keeping 200 days of data) [2025-09-17T03:33:49.973891] [DEBUG] [LOCAL ] EQBK: Primary data saved (10852 records). [2025-09-17T03:33:49.974076] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-17T03:33:49.974172] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EQBK took 23.8s. Estimated remaining: 3h 55m 56s. Rate: 6.9 symbols/min [2025-09-17T03:33:50.150240] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:50.189569] [DEBUG] [LOCAL ] EQH: Loaded 39156 existing records from primary storage. [2025-09-17T03:33:50.189763] [INFO ] [MAIN ] EQH: Loaded 39156 existing records. [2025-09-17T03:33:50.292579] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-17T03:33:50.371022] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:50.371288] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-17T03:33:50.371348] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-17T03:33:50.372347] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-17T03:33:50.372411] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-17T03:33:50.725153] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:51.090176] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-11. [2025-09-17T03:33:51.263224] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:33:51.890195] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-17T03:33:52.065373] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T03:33:52.072177] [INFO ] [REMOTE ] EPD: Full fetch complete (77533 records). [2025-09-17T03:33:52.072392] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-17T03:33:52.495738] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-17T03:33:52.495913] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-17T03:33:52.497271] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-17T03:33:52.497506] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-17T03:33:52.509270] [DEBUG] [LOCAL ] EPD: Trimmed 77533 records to 53616 (keeping 200 days of data) [2025-09-17T03:33:52.529855] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:33:52.727591] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-17T03:33:52.879499] [DEBUG] [LOCAL ] EPD: Primary data saved (53616 records). [2025-09-17T03:33:52.879680] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-17T03:33:52.879776] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 54.4s. Estimated remaining: 3h 55m 34s. Rate: 6.9 symbols/min [2025-09-17T03:33:53.051278] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:53.087686] [DEBUG] [LOCAL ] EQNR: Loaded 39521 existing records from primary storage. [2025-09-17T03:33:53.087849] [INFO ] [MAIN ] EQNR: Loaded 39521 existing records. [2025-09-17T03:33:53.267741] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:53.267972] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-17T03:33:53.268032] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-17T03:33:53.269024] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-17T03:33:53.269098] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-17T03:33:53.511105] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-17T03:33:53.626971] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:53.695172] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T03:33:54.290237] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-11. [2025-09-17T03:33:54.447169] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T03:33:55.007276] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T03:33:55.013241] [INFO ] [REMOTE ] EPRT: Full fetch complete (68394 records). [2025-09-17T03:33:55.013368] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-17T03:33:55.095224] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-17T03:33:55.442267] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-17T03:33:55.442407] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-17T03:33:55.443290] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-17T03:33:55.443370] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-17T03:33:55.444939] [DEBUG] [LOCAL ] EPRT: Trimmed 68394 records to 48707 (keeping 200 days of data) [2025-09-17T03:33:55.757491] [DEBUG] [LOCAL ] EPRT: Primary data saved (48707 records). [2025-09-17T03:33:55.757684] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-17T03:33:55.757784] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EPRT took 36.0s. Estimated remaining: 3h 55m 13s. Rate: 6.9 symbols/min [2025-09-17T03:33:55.901751] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-17T03:33:55.936827] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:55.937019] [DEBUG] [LOCAL ] EQR: No existing data file found in primary storage. [2025-09-17T03:33:55.937085] [WARN ] [MAIN ] EQR: No existing data found, performing full refresh instead. [2025-09-17T03:33:55.937252] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-17T03:33:55.937331] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-17T03:33:55.937418] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-09-17T03:33:55.937474] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-17T03:33:56.302435] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:56.335318] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T03:33:56.522236] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:33:56.528825] [INFO ] [REMOTE ] EPR: Full fetch complete (62715 records). [2025-09-17T03:33:56.529042] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-17T03:33:56.714785] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-17T03:33:57.029788] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-17T03:33:57.029956] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-17T03:33:57.031592] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-17T03:33:57.031739] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-17T03:33:57.033873] [DEBUG] [LOCAL ] EPR: Trimmed 62715 records to 44485 (keeping 200 days of data) [2025-09-17T03:33:57.447724] [DEBUG] [LOCAL ] EPR: Primary data saved (44485 records). [2025-09-17T03:33:57.447953] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-17T03:33:57.448070] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EPR took 42.3s. Estimated remaining: 3h 54m 49s. Rate: 6.9 symbols/min [2025-09-17T03:33:57.497112] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-11. [2025-09-17T03:33:57.668992] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:57.669360] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-17T03:33:57.669575] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-17T03:33:57.669856] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-17T03:33:57.669975] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-17T03:33:57.670083] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-17T03:33:57.670320] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-17T03:33:58.115016] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:58.117442] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T03:33:58.290103] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-11. [2025-09-17T03:33:58.620279] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T03:33:58.783777] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T03:33:59.090180] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-17T03:33:59.220169] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T03:33:59.890168] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-17T03:34:00.690156] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-17T03:34:00.895096] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:34:01.092110] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:34:01.235984] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T03:34:01.490134] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-17T03:34:02.290164] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-17T03:34:03.090153] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-17T03:34:03.166654] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:34:03.890152] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-17T03:34:04.095313] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:34:04.690169] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-17T03:34:04.957822] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T03:34:05.490163] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-17T03:34:05.636029] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T03:34:06.290142] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-17T03:34:06.475415] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:34:06.652492] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T03:34:07.095218] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-17T03:34:07.112590] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T03:34:07.471658] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T03:34:07.890208] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-17T03:34:08.690141] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-17T03:34:09.059178] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T03:34:09.490112] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-17T03:34:09.773392] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T03:34:09.819855] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-17T03:34:10.290149] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-17T03:34:10.645522] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T03:34:11.090193] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-17T03:34:11.511264] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T03:34:11.890136] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-17T03:34:12.361483] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T03:34:12.690140] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-17T03:34:13.490127] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-17T03:34:14.201529] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T03:34:14.290094] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-17T03:34:14.679830] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T03:34:14.808405] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T03:34:14.809699] [INFO ] [REMOTE ] EQS: Full fetch complete (2436 records). [2025-09-17T03:34:14.809822] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-17T03:34:14.991808] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-17T03:34:14.992021] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:34:14.992091] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:34:14.992158] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-17T03:34:14.992243] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-17T03:34:14.992300] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-17T03:34:14.992383] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-17T03:34:14.992481] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQS took 17.5s. Estimated remaining: 3h 54m 59s. Rate: 6.9 symbols/min [2025-09-17T03:34:15.092068] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-17T03:34:15.162254] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:15.199601] [DEBUG] [LOCAL ] EQT: Loaded 40035 existing records from primary storage. [2025-09-17T03:34:15.199784] [INFO ] [MAIN ] EQT: Loaded 40035 existing records. [2025-09-17T03:34:15.376996] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:15.377227] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-17T03:34:15.377285] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-17T03:34:15.378394] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-17T03:34:15.378463] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-17T03:34:15.736118] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:15.890122] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-17T03:34:16.690091] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-17T03:34:17.220955] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T03:34:17.264094] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T03:34:17.490123] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-17T03:34:18.290132] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-17T03:34:18.530839] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:34:19.090139] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-17T03:34:19.474388] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:34:19.564112] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:34:19.890136] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-17T03:34:20.690140] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-17T03:34:20.809692] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:34:21.493557] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-17T03:34:21.501919] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:34:22.290166] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-17T03:34:22.479865] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:34:23.090135] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-11. [2025-09-17T03:34:23.307348] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:34:23.796554] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:34:23.890124] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-17T03:34:24.690163] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-17T03:34:24.981207] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T03:34:25.490115] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-17T03:34:25.910908] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T03:34:26.063205] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T03:34:26.290145] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-17T03:34:27.090131] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-17T03:34:27.430839] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:34:27.890128] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-17T03:34:27.942503] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:34:28.690167] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-17T03:34:28.820524] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T03:34:28.827028] [INFO ] [REMOTE ] EQNR: Full fetch complete (76582 records). [2025-09-17T03:34:28.827200] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-17T03:34:29.215936] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-17T03:34:29.216056] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-17T03:34:29.217024] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-17T03:34:29.217103] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-17T03:34:29.218587] [DEBUG] [LOCAL ] EQNR: Trimmed 76582 records to 53054 (keeping 200 days of data) [2025-09-17T03:34:29.503325] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-17T03:34:29.551242] [DEBUG] [LOCAL ] EQNR: Primary data saved (53054 records). [2025-09-17T03:34:29.551431] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-17T03:34:29.551563] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQNR took 36.7s. Estimated remaining: 3h 55m 3s. Rate: 6.9 symbols/min [2025-09-17T03:34:29.757974] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T03:34:30.290139] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-17T03:34:30.509666] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:34:31.090165] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-17T03:34:31.217301] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T03:34:31.223804] [INFO ] [REMOTE ] EQH: Full fetch complete (76117 records). [2025-09-17T03:34:31.224004] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-17T03:34:31.623963] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-17T03:34:31.624078] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-17T03:34:31.624983] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-17T03:34:31.625047] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-17T03:34:31.626534] [DEBUG] [LOCAL ] EQH: Trimmed 76117 records to 52657 (keeping 200 days of data) [2025-09-17T03:34:31.963016] [DEBUG] [LOCAL ] EQH: Primary data saved (52657 records). [2025-09-17T03:34:31.963205] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-17T03:34:31.963341] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQH took 42.0s. Estimated remaining: 3h 54m 41s. Rate: 6.9 symbols/min [2025-09-17T03:34:32.190513] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T03:34:32.200870] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-17T03:34:32.679889] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:34:32.686464] [INFO ] [REMOTE ] EQR: Full fetch complete (73455 records). [2025-09-17T03:34:32.686603] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-17T03:34:33.075880] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-17T03:34:33.075991] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-17T03:34:33.076846] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-17T03:34:33.076906] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-17T03:34:33.078402] [DEBUG] [LOCAL ] EQR: Trimmed 73455 records to 51365 (keeping 200 days of data) [2025-09-17T03:34:33.398466] [DEBUG] [LOCAL ] EQR: Primary data saved (51365 records). [2025-09-17T03:34:33.398676] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-17T03:34:33.398773] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQR took 37.6s. Estimated remaining: 3h 54m 16s. Rate: 6.9 symbols/min [2025-09-17T03:34:33.973954] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:34:33.985324] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-17T03:34:36.021409] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T03:34:36.033231] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-17T03:34:38.118785] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T03:34:38.130242] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-17T03:34:40.155283] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T03:34:40.166271] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-17T03:34:42.316729] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-17T03:34:42.328707] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-17T03:34:44.334347] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T03:34:44.346168] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-17T03:34:46.191992] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T03:34:46.198849] [INFO ] [REMOTE ] EQT: Full fetch complete (77542 records). [2025-09-17T03:34:46.199029] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-17T03:34:46.620173] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-17T03:34:46.620291] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-17T03:34:46.621232] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-17T03:34:46.621324] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-17T03:34:46.622993] [DEBUG] [LOCAL ] EQT: Trimmed 77542 records to 53682 (keeping 200 days of data) [2025-09-17T03:34:46.964901] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-17T03:34:46.965116] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-17T03:34:46.965252] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 32.0s. Estimated remaining: 3h 54m 18s. Rate: 6.9 symbols/min [2025-09-17T03:34:47.512070] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.645356] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.668972] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.671014] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.671811] [DEBUG] [LOCAL ] EQV: No existing data file found in primary storage. [2025-09-17T03:34:47.672503] [WARN ] [MAIN ] EQV: No existing data found, performing full refresh instead. [2025-09-17T03:34:47.672884] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-17T03:34:47.672992] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-17T03:34:47.673095] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-09-17T03:34:47.673152] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-17T03:34:47.950046] [DEBUG] [LOCAL ] ES: Loaded 39171 existing records from primary storage. [2025-09-17T03:34:47.983894] [INFO ] [MAIN ] ES: Loaded 39171 existing records. [2025-09-17T03:34:47.989723] [DEBUG] [LOCAL ] ERO: Loaded 30125 existing records from primary storage. [2025-09-17T03:34:47.978664] [DEBUG] [LOCAL ] ERJ: Loaded 37655 existing records from primary storage. [2025-09-17T03:34:48.010546] [INFO ] [MAIN ] ERO: Loaded 30125 existing records. [2025-09-17T03:34:48.025149] [INFO ] [MAIN ] ERJ: Loaded 37655 existing records. [2025-09-17T03:34:48.358426] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:48.431034] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-11. [2025-09-17T03:34:48.518401] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:48.614911] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-17T03:34:48.646163] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-17T03:34:48.690391] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-17T03:34:48.696192] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-17T03:34:48.690569] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:48.696129] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:48.729414] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-17T03:34:48.789189] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-17T03:34:48.771527] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-17T03:34:48.804437] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-17T03:34:48.808277] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-17T03:34:48.808417] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-17T03:34:48.846708] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-17T03:34:48.886252] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-17T03:34:48.938291] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T03:34:49.016630] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-17T03:34:50.040144] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:34:50.008810] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:50.098429] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:50.114979] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-11. [2025-09-17T03:34:50.115601] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-11. [2025-09-17T03:34:50.124788] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-17T03:34:50.252375] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:50.252834] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-11. [2025-09-17T03:34:50.957491] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T03:34:50.959829] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-17T03:34:51.569849] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T03:34:51.571512] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-17T03:34:51.606142] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T03:34:51.614963] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-17T03:34:51.695237] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:34:51.705799] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-17T03:34:51.876694] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T03:34:51.886713] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-17T03:34:52.235598] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:34:52.237198] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-17T03:34:52.755396] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T03:34:52.756808] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-17T03:34:53.127325] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T03:34:53.136075] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-17T03:34:53.260218] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T03:34:53.261852] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-17T03:34:53.391120] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:34:53.402663] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-17T03:34:53.526233] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:34:53.536331] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-17T03:34:53.893302] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:34:53.895814] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-17T03:34:54.373559] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T03:34:54.376419] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-17T03:34:54.585139] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T03:34:54.596583] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-17T03:34:54.797783] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T03:34:54.799330] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-17T03:34:55.077865] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:34:55.090886] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-17T03:34:55.105392] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T03:34:55.106417] [INFO ] [REMOTE ] EQV: Full fetch complete (5700 records). [2025-09-17T03:34:55.106503] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-17T03:34:55.423968] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T03:34:55.471005] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-17T03:34:55.525833] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-17T03:34:55.525946] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-17T03:34:55.526154] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-17T03:34:55.526208] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-17T03:34:55.526617] [DEBUG] [LOCAL ] EQV: Trimmed 5700 records to 2934 (keeping 200 days of data) [2025-09-17T03:34:55.545802] [DEBUG] [LOCAL ] EQV: Primary data saved (2934 records). [2025-09-17T03:34:55.545909] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-17T03:34:55.546001] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 8.6s. Estimated remaining: 3h 54m 9s. Rate: 6.9 symbols/min [2025-09-17T03:34:55.716127] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:55.716467] [DEBUG] [LOCAL ] ESAB: No existing data file found in primary storage. [2025-09-17T03:34:55.716542] [WARN ] [MAIN ] ESAB: No existing data found, performing full refresh instead. [2025-09-17T03:34:55.716764] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-17T03:34:55.716933] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-17T03:34:55.717024] [DEBUG] [LOCAL ] ESAB: No primary data file found to delete. [2025-09-17T03:34:55.717157] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-17T03:34:55.888879] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T03:34:56.008781] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-17T03:34:56.145741] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:56.690215] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-11. [2025-09-17T03:34:56.757247] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:34:57.290103] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T03:34:57.374311] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T03:34:57.490167] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-17T03:34:57.927874] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T03:34:58.290175] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-17T03:34:59.090148] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-17T03:34:59.244056] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T03:34:59.519394] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:34:59.890241] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-17T03:35:00.678191] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:35:00.690071] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-17T03:35:01.003454] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T03:35:01.490220] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-17T03:35:02.249492] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T03:35:02.290089] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-17T03:35:03.090121] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-17T03:35:03.370841] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:35:03.435019] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:35:03.890149] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-17T03:35:04.626331] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:35:04.690129] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-17T03:35:05.287813] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:35:05.490138] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-17T03:35:06.290140] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-17T03:35:06.400729] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:35:07.090135] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-17T03:35:07.291476] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T03:35:07.345786] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T03:35:07.890147] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-17T03:35:08.557473] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T03:35:08.690154] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-17T03:35:09.490101] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-17T03:35:09.591793] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:35:09.856215] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:35:10.290166] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-17T03:35:10.672627] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:35:10.678395] [INFO ] [REMOTE ] ERO: Full fetch complete (58732 records). [2025-09-17T03:35:10.678539] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-17T03:35:11.077433] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-17T03:35:11.077540] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-17T03:35:11.078272] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-17T03:35:11.078330] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-17T03:35:11.079892] [DEBUG] [LOCAL ] ERO: Trimmed 58732 records to 41171 (keeping 200 days of data) [2025-09-17T03:35:11.130783] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-17T03:35:11.328073] [DEBUG] [LOCAL ] ERO: Primary data saved (41171 records). [2025-09-17T03:35:11.328225] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-17T03:35:11.328318] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 24.4s. Estimated remaining: 3h 54m 15s. Rate: 6.9 symbols/min [2025-09-17T03:35:11.523875] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:11.541020] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T03:35:11.556104] [DEBUG] [LOCAL ] ESE: Loaded 12263 existing records from primary storage. [2025-09-17T03:35:11.556255] [INFO ] [MAIN ] ESE: Loaded 12263 existing records. [2025-09-17T03:35:11.736111] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:11.736394] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-17T03:35:11.736472] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-17T03:35:11.736952] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-17T03:35:11.737217] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-17T03:35:11.893988] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-17T03:35:12.112970] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:12.690177] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-11. [2025-09-17T03:35:13.116402] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T03:35:13.379588] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:35:13.490097] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-17T03:35:13.677783] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T03:35:14.290139] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-17T03:35:15.090155] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-17T03:35:15.171836] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T03:35:15.535703] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T03:35:15.890126] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-17T03:35:16.332006] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T03:35:16.690129] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-17T03:35:16.777976] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:35:17.490163] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-17T03:35:18.290139] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-17T03:35:18.546843] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T03:35:19.090129] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-17T03:35:19.342052] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T03:35:19.400049] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T03:35:19.890139] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-17T03:35:20.070881] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T03:35:20.690135] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-17T03:35:21.490137] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-17T03:35:21.520596] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:35:21.529237] [INFO ] [REMOTE ] ERJ: Full fetch complete (72136 records). [2025-09-17T03:35:21.529487] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-17T03:35:21.921961] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-17T03:35:21.922072] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-17T03:35:21.922980] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-17T03:35:21.923054] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-17T03:35:21.924790] [DEBUG] [LOCAL ] ERJ: Trimmed 72136 records to 51018 (keeping 200 days of data) [2025-09-17T03:35:22.244185] [DEBUG] [LOCAL ] ERJ: Primary data saved (51018 records). [2025-09-17T03:35:22.244457] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-17T03:35:22.244674] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ERJ took 35.3s. Estimated remaining: 3h 54m 11s. Rate: 6.9 symbols/min [2025-09-17T03:35:22.309434] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-17T03:35:22.425566] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:22.494047] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T03:35:22.507330] [DEBUG] [LOCAL ] ESI: Loaded 37431 existing records from primary storage. [2025-09-17T03:35:22.507741] [INFO ] [MAIN ] ESI: Loaded 37431 existing records. [2025-09-17T03:35:22.701181] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:22.701709] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-17T03:35:22.701879] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-17T03:35:22.707883] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-17T03:35:22.710826] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-17T03:35:22.717013] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:35:22.820473] [INFO ] [REMOTE ] ESAB: Full fetch complete (34689 records). [2025-09-17T03:35:22.820990] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-17T03:35:23.091943] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-17T03:35:23.371420] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:23.480958] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-17T03:35:23.481109] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-17T03:35:23.481778] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-17T03:35:23.481885] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-17T03:35:23.493358] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:35:23.498247] [DEBUG] [LOCAL ] ESAB: Trimmed 34689 records to 25485 (keeping 200 days of data) [2025-09-17T03:35:23.671767] [DEBUG] [LOCAL ] ESAB: Primary data saved (25485 records). [2025-09-17T03:35:23.671944] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-17T03:35:23.672046] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ESAB took 28.1s. Estimated remaining: 3h 53m 47s. Rate: 6.9 symbols/min [2025-09-17T03:35:23.843974] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:23.871943] [DEBUG] [LOCAL ] ESNT: Loaded 28016 existing records from primary storage. [2025-09-17T03:35:23.872126] [INFO ] [MAIN ] ESNT: Loaded 28016 existing records. [2025-09-17T03:35:23.902154] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-17T03:35:24.052125] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:24.052371] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-17T03:35:24.052440] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-17T03:35:24.053239] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-17T03:35:24.053311] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-17T03:35:24.419014] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:24.690108] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-11. [2025-09-17T03:35:25.002714] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T03:35:25.059579] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:35:25.490118] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-17T03:35:26.070684] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T03:35:26.290126] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-17T03:35:26.586479] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T03:35:27.090119] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-17T03:35:27.890132] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-17T03:35:27.975840] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:35:28.153984] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T03:35:28.690169] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-17T03:35:29.490134] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-17T03:35:29.629896] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T03:35:29.677918] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:35:30.290187] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-17T03:35:31.090164] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-11. [2025-09-17T03:35:31.161626] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:35:31.339017] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T03:35:31.890134] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-17T03:35:32.690113] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-17T03:35:32.757071] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T03:35:32.840516] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:35:32.843490] [INFO ] [REMOTE ] ESE: Full fetch complete (21570 records). [2025-09-17T03:35:32.843672] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-17T03:35:33.214032] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-17T03:35:33.214144] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-17T03:35:33.214629] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-17T03:35:33.214705] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-17T03:35:33.215435] [DEBUG] [LOCAL ] ESE: Trimmed 21570 records to 16547 (keeping 200 days of data) [2025-09-17T03:35:33.326067] [DEBUG] [LOCAL ] ESE: Primary data saved (16547 records). [2025-09-17T03:35:33.326251] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-17T03:35:33.326360] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ESE took 22.0s. Estimated remaining: 3h 53m 40s. Rate: 6.9 symbols/min [2025-09-17T03:35:33.494684] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-17T03:35:33.496242] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:33.540772] [DEBUG] [LOCAL ] ESRT: Loaded 34466 existing records from primary storage. [2025-09-17T03:35:33.540980] [INFO ] [MAIN ] ESRT: Loaded 34466 existing records. [2025-09-17T03:35:33.726021] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:33.726412] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-17T03:35:33.726558] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-17T03:35:33.727769] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-17T03:35:33.727849] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-17T03:35:34.095867] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:34.219443] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:35:34.226613] [INFO ] [REMOTE ] ES: Full fetch complete (75924 records). [2025-09-17T03:35:34.226862] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-17T03:35:34.295296] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-17T03:35:34.628722] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-17T03:35:34.628872] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-17T03:35:34.629927] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-17T03:35:34.630020] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-17T03:35:34.631730] [DEBUG] [LOCAL ] ES: Trimmed 75924 records to 52512 (keeping 200 days of data) [2025-09-17T03:35:34.952279] [DEBUG] [LOCAL ] ES: Primary data saved (52512 records). [2025-09-17T03:35:34.952482] [INFO ] [MAIN ] ES: Full history saved. [2025-09-17T03:35:34.952591] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ES took 48.0s. Estimated remaining: 3h 53m 16s. Rate: 6.9 symbols/min [2025-09-17T03:35:35.125763] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:35.094933] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-11. [2025-09-17T03:35:35.150230] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:35:35.174291] [DEBUG] [LOCAL ] ESS: Loaded 22109 existing records from primary storage. [2025-09-17T03:35:35.174443] [INFO ] [MAIN ] ESS: Loaded 22109 existing records. [2025-09-17T03:35:35.352880] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:35.353173] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-17T03:35:35.353232] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-17T03:35:35.354069] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-17T03:35:35.354150] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-17T03:35:35.708002] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:35.890262] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-17T03:35:35.895732] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T03:35:36.641436] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:35:36.690099] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-17T03:35:37.443843] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T03:35:37.490083] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-17T03:35:38.290276] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-11. [2025-09-17T03:35:38.296089] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:35:39.025554] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:35:39.090104] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-17T03:35:39.564946] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:35:39.890136] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-17T03:35:40.609045] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T03:35:40.690129] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-17T03:35:41.426677] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T03:35:41.490091] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-17T03:35:42.175871] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T03:35:42.290192] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-17T03:35:43.085373] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:35:43.094848] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-17T03:35:43.746258] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:35:43.890138] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-17T03:35:44.490635] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:35:44.690153] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-17T03:35:45.490175] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-17T03:35:45.604255] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T03:35:46.178908] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:35:46.290089] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-17T03:35:46.804878] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T03:35:47.090152] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-17T03:35:47.697414] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T03:35:47.890143] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-17T03:35:48.690158] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-17T03:35:48.859144] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:35:49.498319] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-17T03:35:49.503709] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T03:35:50.259312] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:35:50.290081] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-17T03:35:50.990959] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:35:51.090167] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-17T03:35:51.405104] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T03:35:51.890232] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-17T03:35:52.690155] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-17T03:35:52.768340] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T03:35:53.490143] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-17T03:35:53.530620] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:35:54.064126] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:35:54.290102] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-17T03:35:54.709162] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T03:35:54.715756] [INFO ] [REMOTE ] ESNT: Full fetch complete (57107 records). [2025-09-17T03:35:54.715924] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-17T03:35:55.101956] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-17T03:35:55.121256] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-17T03:35:55.121366] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-17T03:35:55.122109] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-17T03:35:55.122272] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-17T03:35:55.123426] [DEBUG] [LOCAL ] ESNT: Trimmed 57107 records to 38806 (keeping 200 days of data) [2025-09-17T03:35:55.367583] [DEBUG] [LOCAL ] ESNT: Primary data saved (38806 records). [2025-09-17T03:35:55.367773] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-17T03:35:55.367868] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESNT took 31.7s. Estimated remaining: 3h 53m 32s. Rate: 6.9 symbols/min [2025-09-17T03:35:55.542317] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:55.577054] [DEBUG] [LOCAL ] ESTC: Loaded 37574 existing records from primary storage. [2025-09-17T03:35:55.577376] [INFO ] [MAIN ] ESTC: Loaded 37574 existing records. [2025-09-17T03:35:55.759988] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:55.760448] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-17T03:35:55.760519] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-17T03:35:55.771331] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-17T03:35:55.786261] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-17T03:35:55.861987] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T03:35:55.893797] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-17T03:35:56.162689] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:56.690129] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-17T03:35:56.850473] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T03:35:57.352160] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:35:57.490106] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-17T03:35:58.180165] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:35:58.290166] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-17T03:35:59.084452] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:35:59.091609] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-17T03:35:59.890145] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-11. [2025-09-17T03:36:00.004781] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T03:36:00.690146] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-17T03:36:00.757586] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T03:36:01.490199] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-17T03:36:01.686513] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T03:36:02.089063] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:36:02.290168] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-17T03:36:03.090121] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-17T03:36:03.293467] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T03:36:03.300543] [INFO ] [REMOTE ] ESI: Full fetch complete (71996 records). [2025-09-17T03:36:03.300705] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-17T03:36:03.705142] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-17T03:36:03.705267] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-17T03:36:03.706216] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-17T03:36:03.706310] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-17T03:36:03.707921] [DEBUG] [LOCAL ] ESI: Trimmed 71996 records to 50857 (keeping 200 days of data) [2025-09-17T03:36:03.895670] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-17T03:36:04.045262] [DEBUG] [LOCAL ] ESI: Primary data saved (50857 records). [2025-09-17T03:36:04.045447] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-17T03:36:04.045560] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESI took 41.8s. Estimated remaining: 3h 53m 23s. Rate: 6.9 symbols/min [2025-09-17T03:36:04.220491] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:04.220765] [DEBUG] [LOCAL ] ET: No existing data file found in primary storage. [2025-09-17T03:36:04.220817] [WARN ] [MAIN ] ET: No existing data found, performing full refresh instead. [2025-09-17T03:36:04.220929] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-17T03:36:04.220984] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-17T03:36:04.221033] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-09-17T03:36:04.221103] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-17T03:36:04.586306] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:04.690135] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-11. [2025-09-17T03:36:05.542097] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (3.25 seconds). [2025-09-17T03:36:05.552479] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-17T03:36:05.591156] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-17T03:36:05.596893] [INFO ] [REMOTE ] ESRT: Full fetch complete (66259 records). [2025-09-17T03:36:05.597040] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-17T03:36:06.022517] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-17T03:36:06.022712] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-17T03:36:06.023549] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-17T03:36:06.023664] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-17T03:36:06.031286] [DEBUG] [LOCAL ] ESRT: Trimmed 66259 records to 46391 (keeping 200 days of data) [2025-09-17T03:36:06.042818] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-17T03:36:06.290244] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-17T03:36:06.347274] [DEBUG] [LOCAL ] ESRT: Primary data saved (46391 records). [2025-09-17T03:36:06.347522] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-17T03:36:06.347667] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESRT took 33.0s. Estimated remaining: 3h 53m 1s. Rate: 6.9 symbols/min [2025-09-17T03:36:06.526259] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:06.537959] [DEBUG] [LOCAL ] ETB: Loaded 8126 existing records from primary storage. [2025-09-17T03:36:06.538159] [INFO ] [MAIN ] ETB: Loaded 8126 existing records. [2025-09-17T03:36:06.726398] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:06.726976] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-17T03:36:06.727076] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-17T03:36:06.727602] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-17T03:36:06.727804] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-17T03:36:07.120753] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-11 (2.43 seconds). [2025-09-17T03:36:07.157319] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:07.158609] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-17T03:36:07.207950] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:36:07.397460] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T03:36:07.890170] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-17T03:36:08.690135] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-11. [2025-09-17T03:36:09.313451] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:36:09.406238] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-17T03:36:09.452666] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T03:36:09.490092] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-17T03:36:10.290190] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-17T03:36:11.090233] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-17T03:36:11.219532] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T03:36:11.719168] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-17T03:36:11.890141] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-17T03:36:12.318865] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:36:12.322867] [INFO ] [REMOTE ] ESS: Full fetch complete (43147 records). [2025-09-17T03:36:12.322975] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-17T03:36:12.692275] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-17T03:36:12.720762] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-17T03:36:12.721025] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-17T03:36:12.721874] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-17T03:36:12.721963] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-17T03:36:12.731937] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T03:36:12.732356] [DEBUG] [LOCAL ] ESS: Trimmed 43147 records to 30217 (keeping 200 days of data) [2025-09-17T03:36:12.944436] [DEBUG] [LOCAL ] ESS: Primary data saved (30217 records). [2025-09-17T03:36:12.944769] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-17T03:36:12.944904] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESS took 38.0s. Estimated remaining: 3h 52m 48s. Rate: 6.9 symbols/min [2025-09-17T03:36:13.117498] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:13.143173] [DEBUG] [LOCAL ] ETD: Loaded 20572 existing records from primary storage. [2025-09-17T03:36:13.143451] [INFO ] [MAIN ] ETD: Loaded 20572 existing records. [2025-09-17T03:36:13.334290] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:13.334693] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-17T03:36:13.334770] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-17T03:36:13.335472] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-17T03:36:13.335543] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-17T03:36:13.497522] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-17T03:36:13.707482] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:14.290121] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-17T03:36:14.414418] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T03:36:14.647011] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:36:15.090135] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-17T03:36:15.890132] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-17T03:36:16.184351] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T03:36:16.360520] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T03:36:16.690135] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-11. [2025-09-17T03:36:17.490118] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-17T03:36:17.909002] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T03:36:18.047203] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:36:18.290162] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-17T03:36:19.090135] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-17T03:36:19.890144] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-17T03:36:19.962041] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T03:36:20.072776] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T03:36:20.260100] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T03:36:20.690141] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-17T03:36:20.974889] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:36:21.490130] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-17T03:36:21.634600] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T03:36:22.290151] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-17T03:36:23.090127] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-17T03:36:23.306828] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:36:23.890156] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-17T03:36:24.374968] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T03:36:24.676604] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T03:36:24.694332] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-17T03:36:24.695937] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:36:25.490122] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-17T03:36:26.290124] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-17T03:36:26.454160] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T03:36:27.090125] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-17T03:36:27.450670] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T03:36:27.754936] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T03:36:27.890128] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-17T03:36:27.932875] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T03:36:28.690152] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-17T03:36:29.490141] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-17T03:36:29.691675] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T03:36:29.888065] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T03:36:30.290195] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-17T03:36:31.090201] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-17T03:36:31.693041] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:36:31.778688] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T03:36:31.890091] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-17T03:36:32.690185] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-17T03:36:32.944487] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T03:36:33.490141] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-17T03:36:34.086331] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:36:34.302861] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-17T03:36:34.329368] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-17T03:36:35.090163] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-17T03:36:35.266127] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T03:36:35.274542] [INFO ] [REMOTE ] ESTC: Full fetch complete (72131 records). [2025-09-17T03:36:35.274807] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-17T03:36:35.735177] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-17T03:36:35.750015] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-17T03:36:35.751675] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-17T03:36:35.752426] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:36:35.752575] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-17T03:36:35.760206] [DEBUG] [LOCAL ] ESTC: Trimmed 72131 records to 50254 (keeping 200 days of data) [2025-09-17T03:36:35.930431] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-17T03:36:36.000099] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T03:36:36.080018] [DEBUG] [LOCAL ] ESTC: Primary data saved (50254 records). [2025-09-17T03:36:36.080201] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-17T03:36:36.080304] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ESTC took 40.7s. Estimated remaining: 3h 53m 9s. Rate: 6.9 symbols/min [2025-09-17T03:36:36.250384] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:36.250629] [DEBUG] [LOCAL ] ETG: No existing data file found in primary storage. [2025-09-17T03:36:36.250698] [WARN ] [MAIN ] ETG: No existing data found, performing full refresh instead. [2025-09-17T03:36:36.250809] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-17T03:36:36.250854] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-17T03:36:36.250903] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-09-17T03:36:36.250944] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-17T03:36:36.605183] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:36.690128] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-11. [2025-09-17T03:36:37.198409] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T03:36:37.490129] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-17T03:36:37.782937] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:36:38.290090] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-17T03:36:38.761752] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:36:38.968603] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T03:36:38.970196] [INFO ] [REMOTE ] ETB: Full fetch complete (17773 records). [2025-09-17T03:36:38.970346] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-17T03:36:39.095317] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-17T03:36:39.343333] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-17T03:36:39.343438] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-17T03:36:39.343918] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-17T03:36:39.343994] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-17T03:36:39.344672] [DEBUG] [LOCAL ] ETB: Trimmed 17773 records to 12202 (keeping 200 days of data) [2025-09-17T03:36:39.419545] [DEBUG] [LOCAL ] ETB: Primary data saved (12202 records). [2025-09-17T03:36:39.419747] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-17T03:36:39.419903] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ETB took 33.1s. Estimated remaining: 3h 52m 49s. Rate: 6.9 symbols/min [2025-09-17T03:36:39.587549] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:39.587807] [DEBUG] [LOCAL ] ETJ: No existing data file found in primary storage. [2025-09-17T03:36:39.587878] [WARN ] [MAIN ] ETJ: No existing data found, performing full refresh instead. [2025-09-17T03:36:39.588010] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-17T03:36:39.588102] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-17T03:36:39.588183] [DEBUG] [LOCAL ] ETJ: No primary data file found to delete. [2025-09-17T03:36:39.588244] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-17T03:36:39.902470] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-17T03:36:39.944799] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:40.305533] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:36:40.309365] [INFO ] [REMOTE ] ETD: Full fetch complete (37682 records). [2025-09-17T03:36:40.309483] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-17T03:36:40.692315] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-17T03:36:40.706637] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-17T03:36:40.706773] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-17T03:36:40.707511] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-17T03:36:40.707579] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-17T03:36:40.708813] [DEBUG] [LOCAL ] ETD: Trimmed 37682 records to 27390 (keeping 200 days of data) [2025-09-17T03:36:40.878109] [DEBUG] [LOCAL ] ETD: Primary data saved (27390 records). [2025-09-17T03:36:40.878264] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-17T03:36:40.878364] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ETD took 27.9s. Estimated remaining: 3h 52m 25s. Rate: 6.9 symbols/min [2025-09-17T03:36:41.054454] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:41.071026] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T03:36:41.112492] [DEBUG] [LOCAL ] ETN: Loaded 39261 existing records from primary storage. [2025-09-17T03:36:41.112688] [INFO ] [MAIN ] ETN: Loaded 39261 existing records. [2025-09-17T03:36:41.295777] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:41.296040] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-17T03:36:41.296093] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-17T03:36:41.297171] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-17T03:36:41.297232] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-17T03:36:41.498183] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-17T03:36:41.660200] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:42.290151] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-11. [2025-09-17T03:36:42.713445] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T03:36:43.056099] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T03:36:43.090163] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-17T03:36:43.820466] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T03:36:43.890122] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-17T03:36:44.690144] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-11. [2025-09-17T03:36:45.170407] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T03:36:45.177080] [INFO ] [REMOTE ] ET: Full fetch complete (77947 records). [2025-09-17T03:36:45.177228] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-17T03:36:45.490563] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-17T03:36:45.590264] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-17T03:36:45.590479] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-17T03:36:45.591428] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-17T03:36:45.591558] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-17T03:36:45.593231] [DEBUG] [LOCAL ] ET: Trimmed 77947 records to 53790 (keeping 200 days of data) [2025-09-17T03:36:45.733185] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T03:36:45.758446] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T03:36:45.994009] [DEBUG] [LOCAL ] ET: Primary data saved (53790 records). [2025-09-17T03:36:45.994187] [INFO ] [MAIN ] ET: Full history saved. [2025-09-17T03:36:45.994275] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ET took 41.9s. Estimated remaining: 3h 52m 9s. Rate: 6.9 symbols/min [2025-09-17T03:36:46.164032] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:46.170361] [DEBUG] [LOCAL ] ETO: Loaded 4864 existing records from primary storage. [2025-09-17T03:36:46.170482] [INFO ] [MAIN ] ETO: Loaded 4864 existing records. [2025-09-17T03:36:46.295263] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-17T03:36:46.356289] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:46.356699] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-17T03:36:46.356764] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-17T03:36:46.357063] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-17T03:36:46.357119] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-17T03:36:46.709424] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:46.718847] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T03:36:47.006972] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T03:36:47.090144] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-17T03:36:47.890173] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-17T03:36:48.083286] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:36:48.690134] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-11. [2025-09-17T03:36:49.313838] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T03:36:49.490166] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-17T03:36:49.948030] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T03:36:50.290131] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-17T03:36:50.500390] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:36:50.958757] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T03:36:51.090144] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-17T03:36:51.890136] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-17T03:36:51.987579] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:36:52.619514] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T03:36:52.690106] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-17T03:36:53.490132] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-17T03:36:54.290199] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-17T03:36:54.535958] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:36:54.659197] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T03:36:54.895948] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T03:36:55.090142] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-17T03:36:55.890176] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-17T03:36:56.690121] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-17T03:36:56.942545] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T03:36:57.182481] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T03:36:57.326659] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T03:36:57.490118] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-17T03:36:58.290141] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-17T03:36:58.539783] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T03:36:59.090130] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-17T03:36:59.849999] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T03:36:59.890086] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-17T03:37:00.362404] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T03:37:00.613561] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T03:37:00.690084] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-17T03:37:01.422289] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T03:37:01.490134] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-17T03:37:02.290108] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-17T03:37:02.584466] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T03:37:03.040901] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:37:03.090103] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-17T03:37:03.890146] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-17T03:37:04.259613] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:37:04.588948] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T03:37:04.690154] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-17T03:37:05.490123] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-17T03:37:06.290092] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-17T03:37:06.595065] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T03:37:06.760713] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T03:37:06.834871] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:37:06.836107] [INFO ] [REMOTE ] ETO: Full fetch complete (9296 records). [2025-09-17T03:37:06.836198] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-17T03:37:07.095684] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-17T03:37:07.234600] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-17T03:37:07.234757] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-17T03:37:07.235063] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-17T03:37:07.235130] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-17T03:37:07.235873] [DEBUG] [LOCAL ] ETO: Trimmed 9296 records to 6670 (keeping 200 days of data) [2025-09-17T03:37:07.279430] [DEBUG] [LOCAL ] ETO: Primary data saved (6670 records). [2025-09-17T03:37:07.279746] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-17T03:37:07.279874] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETO took 21.3s. Estimated remaining: 3h 52m 26s. Rate: 6.9 symbols/min [2025-09-17T03:37:07.467313] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:07.513018] [DEBUG] [LOCAL ] ETR: Loaded 39652 existing records from primary storage. [2025-09-17T03:37:07.513278] [INFO ] [MAIN ] ETR: Loaded 39652 existing records. [2025-09-17T03:37:07.723854] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:07.724286] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-17T03:37:07.724359] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-17T03:37:07.725706] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-17T03:37:07.725822] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-17T03:37:07.895290] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-17T03:37:08.104970] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:08.690109] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-11. [2025-09-17T03:37:08.902713] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T03:37:09.107790] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:37:09.490138] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-17T03:37:10.290143] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-17T03:37:10.416488] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:37:11.090127] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-17T03:37:11.135104] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:37:11.414024] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T03:37:11.890183] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-17T03:37:12.690167] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-17T03:37:12.928396] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T03:37:12.949325] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T03:37:13.490129] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-17T03:37:13.528014] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:37:13.530163] [INFO ] [REMOTE ] ETG: Full fetch complete (25222 records). [2025-09-17T03:37:13.530313] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-17T03:37:13.902661] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-17T03:37:13.902763] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-17T03:37:13.903227] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-17T03:37:13.903279] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-17T03:37:13.903979] [DEBUG] [LOCAL ] ETG: Trimmed 25222 records to 17067 (keeping 200 days of data) [2025-09-17T03:37:14.013724] [DEBUG] [LOCAL ] ETG: Primary data saved (17067 records). [2025-09-17T03:37:14.013909] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-17T03:37:14.014021] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETG took 37.9s. Estimated remaining: 3h 52m 13s. Rate: 6.9 symbols/min [2025-09-17T03:37:14.184592] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:14.200231] [DEBUG] [LOCAL ] ETV: Loaded 15040 existing records from primary storage. [2025-09-17T03:37:14.200373] [INFO ] [MAIN ] ETV: Loaded 15040 existing records. [2025-09-17T03:37:14.295295] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-17T03:37:14.383547] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:14.383799] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-17T03:37:14.383857] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-17T03:37:14.384323] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-17T03:37:14.384383] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-17T03:37:14.752356] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:14.754816] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:37:15.090176] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-17T03:37:15.890161] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-11. [2025-09-17T03:37:16.525975] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T03:37:16.617620] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T03:37:16.644629] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:37:16.690137] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-17T03:37:17.490133] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-17T03:37:18.290212] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-17T03:37:18.359126] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:37:19.090189] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-17T03:37:19.316253] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T03:37:19.417318] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T03:37:19.424022] [INFO ] [REMOTE ] ETN: Full fetch complete (76437 records). [2025-09-17T03:37:19.424200] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-17T03:37:19.822096] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-17T03:37:19.822231] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-17T03:37:19.823179] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-17T03:37:19.823260] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-17T03:37:19.828398] [DEBUG] [LOCAL ] ETN: Trimmed 76437 records to 52880 (keeping 200 days of data) [2025-09-17T03:37:19.895484] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-17T03:37:20.178848] [DEBUG] [LOCAL ] ETN: Primary data saved (52880 records). [2025-09-17T03:37:20.179040] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-17T03:37:20.179158] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETN took 39.3s. Estimated remaining: 3h 51m 59s. Rate: 6.9 symbols/min [2025-09-17T03:37:20.384186] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:20.402170] [DEBUG] [LOCAL ] ETW: Loaded 18084 existing records from primary storage. [2025-09-17T03:37:20.402336] [INFO ] [MAIN ] ETW: Loaded 18084 existing records. [2025-09-17T03:37:20.596171] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:20.596897] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-17T03:37:20.596962] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-17T03:37:20.597401] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-17T03:37:20.597458] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-17T03:37:20.696262] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-17T03:37:20.970140] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:20.986043] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T03:37:21.031623] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T03:37:21.490114] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-17T03:37:21.677712] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:37:21.680342] [INFO ] [REMOTE ] ETJ: Full fetch complete (24645 records). [2025-09-17T03:37:21.680467] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-17T03:37:22.049424] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-17T03:37:22.049551] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-17T03:37:22.050114] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-17T03:37:22.050202] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-17T03:37:22.051563] [DEBUG] [LOCAL ] ETJ: Trimmed 24645 records to 16905 (keeping 200 days of data) [2025-09-17T03:37:22.152468] [DEBUG] [LOCAL ] ETJ: Primary data saved (16905 records). [2025-09-17T03:37:22.152654] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-17T03:37:22.152745] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETJ took 42.7s. Estimated remaining: 3h 51m 36s. Rate: 6.9 symbols/min [2025-09-17T03:37:22.299014] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-11. [2025-09-17T03:37:22.326952] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:22.333372] [DEBUG] [LOCAL ] ETX: Loaded 4122 existing records from primary storage. [2025-09-17T03:37:22.333960] [INFO ] [MAIN ] ETX: Loaded 4122 existing records. [2025-09-17T03:37:22.510134] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:22.510391] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-17T03:37:22.510450] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-17T03:37:22.510735] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-17T03:37:22.510794] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-17T03:37:22.867542] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:22.883013] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:37:23.090108] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-17T03:37:23.491259] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:37:23.890160] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-17T03:37:24.145172] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T03:37:24.690144] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-17T03:37:25.490114] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-11. [2025-09-17T03:37:25.768361] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T03:37:25.868753] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T03:37:26.105057] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:37:26.290137] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-17T03:37:27.090125] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-17T03:37:27.890194] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-17T03:37:28.066586] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:37:28.276162] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T03:37:28.690134] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-17T03:37:29.014696] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:37:29.490173] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-17T03:37:29.583591] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T03:37:30.290201] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-17T03:37:30.930542] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T03:37:31.090219] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-17T03:37:31.285113] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:37:31.715598] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:37:31.890135] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-17T03:37:32.366148] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T03:37:32.690201] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-17T03:37:33.490131] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-17T03:37:33.794366] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:37:34.068874] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:37:34.290132] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-17T03:37:34.883407] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:37:35.090142] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-17T03:37:35.890136] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-17T03:37:36.690119] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-17T03:37:37.021408] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T03:37:37.157265] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:37:37.490098] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-17T03:37:37.568227] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T03:37:38.235106] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T03:37:38.290131] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-17T03:37:39.090132] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-17T03:37:39.244830] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T03:37:39.472871] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T03:37:39.890140] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-17T03:37:40.640049] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T03:37:40.690130] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-17T03:37:41.338588] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T03:37:41.339927] [INFO ] [REMOTE ] ETX: Full fetch complete (6991 records). [2025-09-17T03:37:41.340025] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-17T03:37:41.498463] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-17T03:37:41.721949] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-17T03:37:41.722070] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-17T03:37:41.722306] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-17T03:37:41.722360] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-17T03:37:41.722816] [DEBUG] [LOCAL ] ETX: Trimmed 6991 records to 4939 (keeping 200 days of data) [2025-09-17T03:37:41.758663] [DEBUG] [LOCAL ] ETX: Primary data saved (4939 records). [2025-09-17T03:37:41.758889] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-17T03:37:41.759054] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETX took 19.6s. Estimated remaining: 3h 51m 50s. Rate: 6.9 symbols/min [2025-09-17T03:37:41.948952] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:41.966458] [DEBUG] [LOCAL ] ETY: Loaded 16334 existing records from primary storage. [2025-09-17T03:37:41.966657] [INFO ] [MAIN ] ETY: Loaded 16334 existing records. [2025-09-17T03:37:42.146733] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:42.146983] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-17T03:37:42.147045] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-17T03:37:42.147528] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-17T03:37:42.147594] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-17T03:37:42.292217] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-17T03:37:42.508238] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:43.090144] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-11. [2025-09-17T03:37:43.503867] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T03:37:43.542328] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T03:37:43.890134] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-17T03:37:44.388207] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:37:44.690185] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-17T03:37:44.796683] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T03:37:45.490103] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-17T03:37:45.887900] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:37:46.290179] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-17T03:37:46.625926] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T03:37:47.090101] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-17T03:37:47.511232] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T03:37:47.890166] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-17T03:37:48.020305] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T03:37:48.690196] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-17T03:37:49.490127] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-17T03:37:49.524310] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:37:49.530903] [INFO ] [REMOTE ] ETR: Full fetch complete (76775 records). [2025-09-17T03:37:49.531077] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-17T03:37:49.937894] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-17T03:37:49.950970] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:37:49.949914] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-17T03:37:49.956519] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-17T03:37:49.957040] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-17T03:37:49.960422] [DEBUG] [LOCAL ] ETR: Trimmed 76775 records to 53253 (keeping 200 days of data) [2025-09-17T03:37:50.290740] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-17T03:37:50.304066] [DEBUG] [LOCAL ] ETR: Primary data saved (53253 records). [2025-09-17T03:37:50.304247] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-17T03:37:50.304383] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETR took 43.0s. Estimated remaining: 3h 51m 41s. Rate: 6.9 symbols/min [2025-09-17T03:37:50.479487] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:50.479815] [DEBUG] [LOCAL ] EVC: No existing data file found in primary storage. [2025-09-17T03:37:50.479868] [WARN ] [MAIN ] EVC: No existing data found, performing full refresh instead. [2025-09-17T03:37:50.480019] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-17T03:37:50.480083] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-17T03:37:50.480152] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-09-17T03:37:50.480217] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-17T03:37:50.851161] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:37:50.856475] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:51.090216] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-11. [2025-09-17T03:37:51.476986] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T03:37:51.890207] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-17T03:37:52.189084] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T03:37:52.690126] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-17T03:37:52.890283] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:37:52.893694] [INFO ] [REMOTE ] ETW: Full fetch complete (36207 records). [2025-09-17T03:37:52.893830] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-17T03:37:53.284948] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-17T03:37:53.285069] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-17T03:37:53.285780] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-17T03:37:53.285856] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-17T03:37:53.286936] [DEBUG] [LOCAL ] ETW: Trimmed 36207 records to 25369 (keeping 200 days of data) [2025-09-17T03:37:53.452092] [DEBUG] [LOCAL ] ETW: Primary data saved (25369 records). [2025-09-17T03:37:53.452264] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-17T03:37:53.452415] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETW took 33.3s. Estimated remaining: 3h 51m 21s. Rate: 6.9 symbols/min [2025-09-17T03:37:53.496952] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-17T03:37:53.633200] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:53.633595] [DEBUG] [LOCAL ] EVEX: No existing data file found in primary storage. [2025-09-17T03:37:53.633735] [WARN ] [MAIN ] EVEX: No existing data found, performing full refresh instead. [2025-09-17T03:37:53.633886] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-17T03:37:53.633960] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-17T03:37:53.634143] [DEBUG] [LOCAL ] EVEX: No primary data file found to delete. [2025-09-17T03:37:53.634266] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-17T03:37:53.808300] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:37:54.014338] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:54.290120] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-11. [2025-09-17T03:37:54.941770] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:37:55.090170] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-17T03:37:55.409279] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T03:37:55.890111] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-17T03:37:56.211506] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T03:37:56.690155] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-17T03:37:57.274455] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:37:57.490113] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-17T03:37:57.871039] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:37:58.290139] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-17T03:37:58.377171] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:37:59.090141] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-17T03:37:59.393357] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:37:59.890126] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-17T03:38:00.143412] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:38:00.690137] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-17T03:38:01.207178] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:38:01.490115] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-17T03:38:01.882540] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:38:02.290094] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-17T03:38:02.691880] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:38:03.090080] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-17T03:38:03.411746] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T03:38:03.890128] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-17T03:38:03.934933] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:38:04.690203] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-17T03:38:05.002979] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T03:38:05.490203] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-17T03:38:05.762604] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:38:06.290210] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-17T03:38:06.807976] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T03:38:07.090186] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-17T03:38:07.185081] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:38:07.187890] [INFO ] [REMOTE ] ETV: Full fetch complete (31568 records). [2025-09-17T03:38:07.188065] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-17T03:38:07.568754] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-17T03:38:07.568872] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-17T03:38:07.569375] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-17T03:38:07.569439] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-17T03:38:07.570197] [DEBUG] [LOCAL ] ETV: Trimmed 31568 records to 21483 (keeping 200 days of data) [2025-09-17T03:38:07.711894] [DEBUG] [LOCAL ] ETV: Primary data saved (21483 records). [2025-09-17T03:38:07.712052] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-17T03:38:07.712213] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETV took 53.7s. Estimated remaining: 3h 51m 23s. Rate: 6.9 symbols/min [2025-09-17T03:38:07.885087] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:07.890190] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-17T03:38:07.893438] [DEBUG] [LOCAL ] EVF: Loaded 6450 existing records from primary storage. [2025-09-17T03:38:07.894589] [INFO ] [MAIN ] EVF: Loaded 6450 existing records. [2025-09-17T03:38:08.076727] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:08.077080] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-17T03:38:08.077255] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-17T03:38:08.077588] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-17T03:38:08.090545] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-17T03:38:08.091910] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T03:38:08.473237] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:08.690176] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-11. [2025-09-17T03:38:09.162467] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:38:09.313281] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T03:38:09.490159] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-17T03:38:10.058530] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T03:38:10.290146] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-17T03:38:10.762427] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T03:38:11.090128] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-17T03:38:11.890169] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-17T03:38:12.483880] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:38:12.568997] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:38:12.690135] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-17T03:38:13.472815] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:38:13.490089] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-17T03:38:14.290130] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-17T03:38:14.365677] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T03:38:15.090149] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-17T03:38:15.368082] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T03:38:15.890138] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-17T03:38:16.695666] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-17T03:38:16.717098] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:38:17.019717] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T03:38:17.490133] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-17T03:38:17.820836] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T03:38:18.290126] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-17T03:38:18.557289] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:38:19.090168] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-17T03:38:19.349796] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T03:38:19.715741] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T03:38:19.890137] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-17T03:38:20.690166] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-17T03:38:20.862124] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T03:38:20.865089] [INFO ] [REMOTE ] ETY: Full fetch complete (34558 records). [2025-09-17T03:38:20.865257] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-17T03:38:21.284963] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-17T03:38:21.285083] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-17T03:38:21.285696] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-17T03:38:21.285757] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-17T03:38:21.286849] [DEBUG] [LOCAL ] ETY: Trimmed 34558 records to 23207 (keeping 200 days of data) [2025-09-17T03:38:21.394149] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T03:38:21.448804] [DEBUG] [LOCAL ] ETY: Primary data saved (23207 records). [2025-09-17T03:38:21.448980] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-17T03:38:21.449092] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETY took 39.7s. Estimated remaining: 3h 51m 24s. Rate: 6.9 symbols/min [2025-09-17T03:38:21.495230] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-17T03:38:21.630184] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:21.637608] [DEBUG] [LOCAL ] EVG: Loaded 4332 existing records from primary storage. [2025-09-17T03:38:21.637793] [INFO ] [MAIN ] EVG: Loaded 4332 existing records. [2025-09-17T03:38:21.824048] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:21.824299] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-17T03:38:21.824354] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-17T03:38:21.824748] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-17T03:38:21.824813] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-17T03:38:22.177669] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:22.290134] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-17T03:38:23.037734] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T03:38:23.043696] [INFO ] [REMOTE ] EVEX: Full fetch complete (40907 records). [2025-09-17T03:38:23.043834] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-17T03:38:23.095218] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-11. [2025-09-17T03:38:23.439264] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-17T03:38:23.448721] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-17T03:38:23.449440] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-17T03:38:23.450281] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T03:38:23.450363] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-17T03:38:23.455563] [DEBUG] [LOCAL ] EVEX: Trimmed 40907 records to 28901 (keeping 200 days of data) [2025-09-17T03:38:23.624721] [DEBUG] [LOCAL ] EVEX: Primary data saved (28901 records). [2025-09-17T03:38:23.624887] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-17T03:38:23.624967] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. EVEX took 30.2s. Estimated remaining: 3h 51m 2s. Rate: 6.9 symbols/min [2025-09-17T03:38:23.793111] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:23.793336] [DEBUG] [LOCAL ] EVH: No existing data file found in primary storage. [2025-09-17T03:38:23.793386] [WARN ] [MAIN ] EVH: No existing data found, performing full refresh instead. [2025-09-17T03:38:23.793550] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-17T03:38:23.793608] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-17T03:38:23.793677] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-09-17T03:38:23.793722] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-17T03:38:23.891580] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-17T03:38:23.898492] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:38:24.174112] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:24.667058] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T03:38:24.669948] [INFO ] [REMOTE ] EVC: Full fetch complete (31266 records). [2025-09-17T03:38:24.670106] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-17T03:38:24.700098] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-11. [2025-09-17T03:38:25.085918] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-17T03:38:25.086038] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-17T03:38:25.086704] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-17T03:38:25.086779] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-17T03:38:25.087612] [DEBUG] [LOCAL ] EVC: Trimmed 31266 records to 20297 (keeping 200 days of data) [2025-09-17T03:38:25.210549] [DEBUG] [LOCAL ] EVC: Primary data saved (20297 records). [2025-09-17T03:38:25.210738] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-17T03:38:25.210859] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVC took 34.9s. Estimated remaining: 3h 50m 39s. Rate: 6.9 symbols/min [2025-09-17T03:38:25.377673] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:25.387985] [DEBUG] [LOCAL ] EVN: Loaded 7786 existing records from primary storage. [2025-09-17T03:38:25.388143] [INFO ] [MAIN ] EVN: Loaded 7786 existing records. [2025-09-17T03:38:25.495198] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-17T03:38:25.569908] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:25.570124] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-17T03:38:25.570223] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-17T03:38:25.570575] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-17T03:38:25.570636] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-17T03:38:25.938496] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:26.171030] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:38:26.290124] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-17T03:38:26.468568] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:38:27.090142] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-17T03:38:27.244418] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T03:38:27.890177] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-17T03:38:28.668650] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:38:28.685976] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:38:28.690068] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-17T03:38:29.311104] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T03:38:29.490173] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-11. [2025-09-17T03:38:30.290137] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-17T03:38:30.308433] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:38:31.090173] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-17T03:38:31.667502] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T03:38:31.890123] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-17T03:38:31.946250] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:38:32.561090] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T03:38:32.562639] [INFO ] [REMOTE ] EVF: Full fetch complete (11588 records). [2025-09-17T03:38:32.562753] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-17T03:38:32.705786] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-17T03:38:32.930665] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-17T03:38:32.930771] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-17T03:38:32.931064] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-17T03:38:32.931123] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-17T03:38:32.931610] [DEBUG] [LOCAL ] EVF: Trimmed 11588 records to 9065 (keeping 200 days of data) [2025-09-17T03:38:32.985424] [DEBUG] [LOCAL ] EVF: Primary data saved (9065 records). [2025-09-17T03:38:32.985590] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-17T03:38:32.985697] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVF took 25.3s. Estimated remaining: 3h 50m 28s. Rate: 6.9 symbols/min [2025-09-17T03:38:33.159117] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:33.184054] [DEBUG] [LOCAL ] EVR: Loaded 25174 existing records from primary storage. [2025-09-17T03:38:33.184233] [INFO ] [MAIN ] EVR: Loaded 25174 existing records. [2025-09-17T03:38:33.366193] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:33.366493] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-17T03:38:33.366555] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-17T03:38:33.367316] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-17T03:38:33.367403] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-17T03:38:33.506477] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-17T03:38:33.723720] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:34.255043] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:38:34.286107] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:38:34.290072] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-17T03:38:34.713717] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T03:38:35.090146] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-17T03:38:35.890133] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-17T03:38:36.090962] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T03:38:36.690132] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-17T03:38:37.471260] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T03:38:37.501627] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-11. [2025-09-17T03:38:37.507752] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T03:38:38.290143] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-17T03:38:38.820583] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:38:38.899865] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T03:38:39.090143] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-17T03:38:39.890187] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-17T03:38:40.450490] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T03:38:40.690180] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-17T03:38:40.862907] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:38:41.490219] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-17T03:38:42.058987] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:38:42.290148] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-17T03:38:42.571169] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T03:38:43.090159] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-17T03:38:43.790826] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:38:43.812938] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T03:38:43.890107] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-17T03:38:44.519018] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T03:38:44.520361] [INFO ] [REMOTE ] EVG: Full fetch complete (8097 records). [2025-09-17T03:38:44.520448] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-17T03:38:44.695207] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-17T03:38:44.883483] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-17T03:38:44.883594] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-17T03:38:44.883856] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-17T03:38:44.883912] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-17T03:38:44.884409] [DEBUG] [LOCAL ] EVG: Trimmed 8097 records to 5848 (keeping 200 days of data) [2025-09-17T03:38:44.922128] [DEBUG] [LOCAL ] EVG: Primary data saved (5848 records). [2025-09-17T03:38:44.922289] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-17T03:38:44.922421] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. EVG took 23.5s. Estimated remaining: 3h 50m 26s. Rate: 6.9 symbols/min [2025-09-17T03:38:45.091287] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:45.105018] [DEBUG] [LOCAL ] EVT: Loaded 12703 existing records from primary storage. [2025-09-17T03:38:45.105186] [INFO ] [MAIN ] EVT: Loaded 12703 existing records. [2025-09-17T03:38:45.285854] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:45.286136] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-17T03:38:45.286200] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-17T03:38:45.286720] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-17T03:38:45.286796] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-17T03:38:45.501467] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-17T03:38:45.653818] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:46.275619] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:38:46.290073] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-17T03:38:46.438513] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T03:38:47.090152] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-11. [2025-09-17T03:38:47.890166] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-17T03:38:47.939467] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T03:38:47.991909] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T03:38:48.690297] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-17T03:38:48.827307] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:38:49.490154] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-17T03:38:50.290159] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-17T03:38:50.340294] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:38:50.493351] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T03:38:50.976986] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:38:51.090111] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-17T03:38:51.890116] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-17T03:38:52.139620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T03:38:52.690186] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-17T03:38:53.490137] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-17T03:38:53.646253] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:38:54.290121] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-17T03:38:54.390894] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:38:54.533251] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T03:38:55.090140] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-17T03:38:55.887062] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:38:55.894584] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-17T03:38:56.690187] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-17T03:38:56.838077] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T03:38:57.020986] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T03:38:57.491918] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-17T03:38:57.492826] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T03:38:58.290163] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-17T03:38:59.090172] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-17T03:38:59.176724] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T03:38:59.355587] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T03:38:59.592090] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T03:38:59.890155] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-17T03:39:00.690133] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-17T03:39:01.094986] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:39:01.496565] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-17T03:39:01.498014] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T03:39:02.290172] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-17T03:39:03.090131] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-17T03:39:03.890095] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-17T03:39:04.376765] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-09-17T03:39:04.450124] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:39:04.456271] [INFO ] [REMOTE ] EVH: Full fetch complete (71586 records). [2025-09-17T03:39:04.456428] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-17T03:39:04.647930] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T03:39:04.698879] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-17T03:39:04.872197] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-17T03:39:04.872323] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-17T03:39:04.873239] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-17T03:39:04.873308] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-17T03:39:04.874810] [DEBUG] [LOCAL ] EVH: Trimmed 71586 records to 49360 (keeping 200 days of data) [2025-09-17T03:39:04.977838] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T03:39:05.178390] [DEBUG] [LOCAL ] EVH: Primary data saved (49360 records). [2025-09-17T03:39:05.178556] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-17T03:39:05.178665] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVH took 41.6s. Estimated remaining: 3h 50m 40s. Rate: 6.9 symbols/min [2025-09-17T03:39:05.349229] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:05.368155] [DEBUG] [LOCAL ] EVTC: Loaded 19478 existing records from primary storage. [2025-09-17T03:39:05.368316] [INFO ] [MAIN ] EVTC: Loaded 19478 existing records. [2025-09-17T03:39:05.495307] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-17T03:39:05.553208] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:05.553477] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-17T03:39:05.553542] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-17T03:39:05.554165] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-17T03:39:05.554228] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-17T03:39:05.908981] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:06.290189] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-17T03:39:06.328551] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T03:39:06.483861] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:39:06.782159] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T03:39:06.784922] [INFO ] [REMOTE ] EVN: Full fetch complete (17432 records). [2025-09-17T03:39:06.785032] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-17T03:39:07.090888] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-17T03:39:07.176954] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-17T03:39:07.177070] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-17T03:39:07.177475] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-17T03:39:07.177529] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-17T03:39:07.178267] [DEBUG] [LOCAL ] EVN: Trimmed 17432 records to 10894 (keeping 200 days of data) [2025-09-17T03:39:07.247357] [DEBUG] [LOCAL ] EVN: Primary data saved (10894 records). [2025-09-17T03:39:07.247546] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-17T03:39:07.247663] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVN took 42.0s. Estimated remaining: 3h 50m 18s. Rate: 6.9 symbols/min [2025-09-17T03:39:07.422612] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:07.450532] [DEBUG] [LOCAL ] EVTL: Loaded 30107 existing records from primary storage. [2025-09-17T03:39:07.450726] [INFO ] [MAIN ] EVTL: Loaded 30107 existing records. [2025-09-17T03:39:07.632217] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:07.632474] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-17T03:39:07.632532] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-17T03:39:07.633405] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-17T03:39:07.633469] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-17T03:39:07.895362] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-17T03:39:07.999690] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:08.177123] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T03:39:08.690147] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-11. [2025-09-17T03:39:09.041499] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:39:09.416192] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T03:39:09.490114] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-17T03:39:10.290154] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-17T03:39:10.838530] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T03:39:11.090094] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-17T03:39:11.450632] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:39:11.454612] [INFO ] [REMOTE ] EVR: Full fetch complete (50411 records). [2025-09-17T03:39:11.454745] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-17T03:39:11.847422] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-17T03:39:11.847567] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-17T03:39:11.848271] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-17T03:39:11.848329] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-17T03:39:11.849411] [DEBUG] [LOCAL ] EVR: Trimmed 50411 records to 35990 (keeping 200 days of data) [2025-09-17T03:39:11.909135] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-17T03:39:11.959414] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:39:11.963988] [INFO ] [REMOTE ] EVT: Full fetch complete (25741 records). [2025-09-17T03:39:11.964852] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-17T03:39:12.360378] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-17T03:39:12.362898] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-17T03:39:12.363922] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-17T03:39:12.364379] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-17T03:39:12.367729] [DEBUG] [LOCAL ] EVT: Trimmed 25741 records to 17714 (keeping 200 days of data) [2025-09-17T03:39:12.581221] [DEBUG] [LOCAL ] EVT: Primary data saved (17714 records). [2025-09-17T03:39:12.582150] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-17T03:39:12.582826] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVT took 27.7s. Estimated remaining: 3h 50m 3s. Rate: 6.9 symbols/min [2025-09-17T03:39:12.704706] [DEBUG] [LOCAL ] EVR: Primary data saved (35990 records). [2025-09-17T03:39:12.691913] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-11. [2025-09-17T03:39:12.756172] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-17T03:39:12.759404] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVR took 39.8s. Estimated remaining: 3h 49m 37s. Rate: 6.9 symbols/min [2025-09-17T03:39:12.758527] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:12.949059] [DEBUG] [LOCAL ] EVTR: Loaded 17483 existing records from primary storage. [2025-09-17T03:39:12.948269] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:12.949628] [INFO ] [MAIN ] EVTR: Loaded 17483 existing records. [2025-09-17T03:39:13.140561] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:13.140875] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-17T03:39:13.140958] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-17T03:39:13.141495] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-17T03:39:13.141565] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-17T03:39:13.298636] [DEBUG] [LOCAL ] EW: Loaded 39779 existing records from primary storage. [2025-09-17T03:39:13.317666] [INFO ] [MAIN ] EW: Loaded 39779 existing records. [2025-09-17T03:39:13.647201] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:13.667480] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-11. [2025-09-17T03:39:13.708864] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:13.709689] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-17T03:39:13.709847] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-17T03:39:13.711360] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-17T03:39:13.711428] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-17T03:39:13.832536] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T03:39:14.097181] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:14.112887] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:39:14.290088] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-17T03:39:14.679763] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T03:39:15.090147] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-17T03:39:15.523440] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:39:15.890149] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-17T03:39:16.690106] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-11. [2025-09-17T03:39:17.179750] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T03:39:17.490132] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-17T03:39:17.573062] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:39:18.290135] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-17T03:39:18.590673] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T03:39:18.671536] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:39:18.969382] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T03:39:19.090126] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-17T03:39:19.890129] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-17T03:39:20.077257] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:39:20.690128] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-17T03:39:21.490102] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-17T03:39:21.673604] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:39:21.836880] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T03:39:22.290125] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-17T03:39:22.524417] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T03:39:23.029007] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:39:23.090112] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-17T03:39:23.890089] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-17T03:39:24.364107] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T03:39:24.690130] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-17T03:39:25.490153] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-17T03:39:25.704169] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T03:39:25.737605] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T03:39:26.290124] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-17T03:39:26.935618] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:39:27.090139] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-17T03:39:27.890186] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-17T03:39:28.087365] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:39:28.258761] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:39:28.690157] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-17T03:39:28.811609] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T03:39:29.490159] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-17T03:39:30.290158] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-17T03:39:30.675860] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T03:39:30.947389] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T03:39:31.090179] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-17T03:39:31.563767] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:39:31.890151] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-17T03:39:32.286724] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T03:39:32.690191] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-17T03:39:33.490819] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-17T03:39:33.668192] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:39:34.290189] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-17T03:39:34.496273] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:39:34.553308] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T03:39:35.090130] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-17T03:39:35.890124] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-17T03:39:36.241464] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T03:39:36.396402] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T03:39:36.690147] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-17T03:39:37.022970] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T03:39:37.490238] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-17T03:39:37.544295] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T03:39:38.290143] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-17T03:39:39.090189] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-17T03:39:39.295672] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T03:39:39.857980] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:39:39.863438] [INFO ] [REMOTE ] EVTL: Full fetch complete (49580 records). [2025-09-17T03:39:39.863563] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-17T03:39:39.895260] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-17T03:39:40.281616] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-17T03:39:40.281881] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-17T03:39:40.294104] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-17T03:39:40.295193] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:39:40.295269] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-17T03:39:40.300619] [INFO ] [REMOTE ] EVTC: Full fetch complete (37664 records). [2025-09-17T03:39:40.300877] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-17T03:39:40.301118] [DEBUG] [LOCAL ] EVTL: Trimmed 49580 records to 36188 (keeping 200 days of data) [2025-09-17T03:39:40.695273] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-17T03:39:40.776923] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-17T03:39:40.777327] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-17T03:39:40.778735] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-17T03:39:40.778911] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-17T03:39:40.782678] [DEBUG] [LOCAL ] EVTC: Trimmed 37664 records to 26661 (keeping 200 days of data) [2025-09-17T03:39:41.012476] [DEBUG] [LOCAL ] EVTL: Primary data saved (36188 records). [2025-09-17T03:39:41.014278] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-17T03:39:41.014422] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVTL took 33.8s. Estimated remaining: 3h 50m 7s. Rate: 6.9 symbols/min [2025-09-17T03:39:41.220694] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:41.226057] [DEBUG] [LOCAL ] EVTC: Primary data saved (26661 records). [2025-09-17T03:39:41.226151] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-17T03:39:41.226251] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVTC took 36.0s. Estimated remaining: 3h 49m 41s. Rate: 6.9 symbols/min [2025-09-17T03:39:41.403859] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:41.404074] [DEBUG] [LOCAL ] EXK: No existing data file found in primary storage. [2025-09-17T03:39:41.404117] [WARN ] [MAIN ] EXK: No existing data found, performing full refresh instead. [2025-09-17T03:39:41.404226] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-17T03:39:41.404278] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-17T03:39:41.404326] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-17T03:39:41.404376] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-17T03:39:41.514576] [DEBUG] [LOCAL ] EXG: Loaded 25052 existing records from primary storage. [2025-09-17T03:39:41.540580] [INFO ] [MAIN ] EXG: Loaded 25052 existing records. [2025-09-17T03:39:41.883625] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:41.910353] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-17T03:39:41.967273] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-17T03:39:41.967024] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:41.967940] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-11. [2025-09-17T03:39:41.982351] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-17T03:39:41.983633] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T03:39:41.985877] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-17T03:39:42.187010] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T03:39:42.295189] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-17T03:39:42.404262] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:43.090157] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-11. [2025-09-17T03:39:43.590423] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T03:39:43.835748] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:39:43.890087] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-17T03:39:44.441472] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:39:44.690129] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-17T03:39:45.490142] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-17T03:39:45.597055] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T03:39:46.290257] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-17T03:39:46.390553] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T03:39:46.685545] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:39:47.090144] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-17T03:39:47.890158] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-17T03:39:47.991896] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T03:39:48.690191] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-17T03:39:48.883917] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T03:39:49.092154] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T03:39:49.096729] [INFO ] [REMOTE ] EVTR: Full fetch complete (30897 records). [2025-09-17T03:39:49.096823] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-17T03:39:49.470834] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-17T03:39:49.470955] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-17T03:39:49.471494] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-17T03:39:49.471574] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-17T03:39:49.472473] [DEBUG] [LOCAL ] EVTR: Trimmed 30897 records to 22682 (keeping 200 days of data) [2025-09-17T03:39:49.527555] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-17T03:39:49.619184] [DEBUG] [LOCAL ] EVTR: Primary data saved (22682 records). [2025-09-17T03:39:49.619385] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-17T03:39:49.619498] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTR took 37.0s. Estimated remaining: 3h 49m 32s. Rate: 6.9 symbols/min [2025-09-17T03:39:49.791264] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:49.791510] [DEBUG] [LOCAL ] EXP: No existing data file found in primary storage. [2025-09-17T03:39:49.791559] [WARN ] [MAIN ] EXP: No existing data found, performing full refresh instead. [2025-09-17T03:39:49.791710] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-17T03:39:49.791763] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-17T03:39:49.791809] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-09-17T03:39:49.791866] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-17T03:39:50.149479] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:50.290104] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-17T03:39:50.333718] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:39:51.090175] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-11. [2025-09-17T03:39:51.281077] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:39:51.287839] [INFO ] [REMOTE ] EW: Full fetch complete (77185 records). [2025-09-17T03:39:51.288041] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-17T03:39:51.702506] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-17T03:39:51.702707] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-17T03:39:51.703741] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-17T03:39:51.703814] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-17T03:39:51.712804] [DEBUG] [LOCAL ] EW: Trimmed 77185 records to 53396 (keeping 200 days of data) [2025-09-17T03:39:51.727054] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:39:51.909065] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-17T03:39:52.065733] [DEBUG] [LOCAL ] EW: Primary data saved (53396 records). [2025-09-17T03:39:52.065920] [INFO ] [MAIN ] EW: Full history saved. [2025-09-17T03:39:52.066032] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EW took 39.3s. Estimated remaining: 3h 49m 11s. Rate: 6.9 symbols/min [2025-09-17T03:39:52.264761] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:52.281257] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:39:52.320078] [DEBUG] [LOCAL ] EXPD: Loaded 35628 existing records from primary storage. [2025-09-17T03:39:52.320269] [INFO ] [MAIN ] EXPD: Loaded 35628 existing records. [2025-09-17T03:39:52.498718] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:52.498965] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-17T03:39:52.499026] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-17T03:39:52.499783] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-17T03:39:52.499845] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-17T03:39:52.697100] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-17T03:39:52.858852] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:53.490146] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-17T03:39:53.764077] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:39:54.091167] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:39:54.290144] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-17T03:39:54.856013] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:39:55.090176] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-11. [2025-09-17T03:39:55.691032] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:39:55.890150] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-17T03:39:56.441730] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:39:56.690143] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-17T03:39:57.490132] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-17T03:39:57.878551] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T03:39:58.145287] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T03:39:58.290130] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-17T03:39:58.994519] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:39:59.090142] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-17T03:39:59.636033] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:39:59.890124] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-17T03:40:00.690116] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-17T03:40:00.771422] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:40:01.431420] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T03:40:01.490169] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-17T03:40:02.290193] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-17T03:40:02.652342] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T03:40:02.999983] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T03:40:03.090160] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-17T03:40:03.746410] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:40:03.890115] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-17T03:40:04.690140] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-17T03:40:04.931547] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:40:05.106260] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T03:40:05.490141] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-17T03:40:05.704359] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T03:40:06.290172] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-17T03:40:06.767757] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:40:07.090143] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-17T03:40:07.890140] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-17T03:40:08.294147] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:40:08.379416] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T03:40:08.690131] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-17T03:40:09.223204] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:40:09.490184] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-17T03:40:10.290144] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-17T03:40:10.518536] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T03:40:10.890082] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T03:40:11.090154] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-17T03:40:11.442507] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:40:11.446586] [INFO ] [REMOTE ] EXG: Full fetch complete (50136 records). [2025-09-17T03:40:11.446719] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-17T03:40:11.872717] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-17T03:40:11.872854] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-17T03:40:11.873597] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-17T03:40:11.873673] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-17T03:40:11.874796] [DEBUG] [LOCAL ] EXG: Trimmed 50136 records to 34986 (keeping 200 days of data) [2025-09-17T03:40:11.926338] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-17T03:40:12.090484] [DEBUG] [LOCAL ] EXG: Primary data saved (34986 records). [2025-09-17T03:40:12.090721] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-17T03:40:12.090874] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EXG took 31.1s. Estimated remaining: 3h 49m 24s. Rate: 6.9 symbols/min [2025-09-17T03:40:12.265062] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:12.299279] [DEBUG] [LOCAL ] EXR: Loaded 33814 existing records from primary storage. [2025-09-17T03:40:12.299445] [INFO ] [MAIN ] EXR: Loaded 33814 existing records. [2025-09-17T03:40:12.482225] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:12.482486] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-17T03:40:12.482544] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-17T03:40:12.483309] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-17T03:40:12.483371] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-17T03:40:12.695283] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-17T03:40:12.854099] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:12.889958] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:40:13.490160] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-11. [2025-09-17T03:40:13.732024] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T03:40:13.739150] [INFO ] [REMOTE ] EXK: Full fetch complete (76236 records). [2025-09-17T03:40:13.739390] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-17T03:40:14.145045] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-17T03:40:14.145256] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-17T03:40:14.146348] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-17T03:40:14.146520] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-17T03:40:14.167538] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T03:40:14.166208] [DEBUG] [LOCAL ] EXK: Trimmed 76236 records to 53059 (keeping 200 days of data) [2025-09-17T03:40:14.290223] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-17T03:40:14.477028] [DEBUG] [LOCAL ] EXK: Primary data saved (53059 records). [2025-09-17T03:40:14.477193] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-17T03:40:14.477277] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXK took 33.3s. Estimated remaining: 3h 49m 3s. Rate: 6.9 symbols/min [2025-09-17T03:40:15.106073] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-17T03:40:15.109012] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T03:40:15.601462] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T03:40:15.890175] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-17T03:40:16.670440] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:40:16.690069] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-17T03:40:17.080244] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:40:17.083912] [INFO ] [REMOTE ] EXP: Full fetch complete (42889 records). [2025-09-17T03:40:17.084012] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-17T03:40:17.462281] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-17T03:40:17.462408] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-17T03:40:17.463062] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-17T03:40:17.463135] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-17T03:40:17.464306] [DEBUG] [LOCAL ] EXP: Trimmed 42889 records to 30245 (keeping 200 days of data) [2025-09-17T03:40:17.522635] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-17T03:40:17.656913] [DEBUG] [LOCAL ] EXP: Primary data saved (30245 records). [2025-09-17T03:40:17.657076] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-17T03:40:17.657182] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXP took 28.0s. Estimated remaining: 3h 48m 43s. Rate: 6.9 symbols/min [2025-09-17T03:40:18.471265] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:40:18.482115] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-17T03:40:19.155847] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:40:19.164802] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-17T03:40:20.241123] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T03:40:20.251822] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-17T03:40:20.770087] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T03:40:20.779617] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-17T03:40:21.914717] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:40:21.924341] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-17T03:40:22.392665] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T03:40:22.401918] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-17T03:40:23.686804] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T03:40:23.698575] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-17T03:40:24.128158] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:40:24.138180] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-17T03:40:25.765976] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T03:40:25.777429] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-17T03:40:25.971068] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T03:40:25.981718] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-17T03:40:26.990959] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:40:26.997161] [INFO ] [REMOTE ] EXPD: Full fetch complete (68908 records). [2025-09-17T03:40:26.997350] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-17T03:40:27.419747] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-17T03:40:27.419923] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-17T03:40:27.420877] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-17T03:40:27.420940] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-17T03:40:27.422765] [DEBUG] [LOCAL ] EXPD: Trimmed 68908 records to 48243 (keeping 200 days of data) [2025-09-17T03:40:27.700680] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:40:27.714049] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-17T03:40:27.787552] [DEBUG] [LOCAL ] EXPD: Primary data saved (48243 records). [2025-09-17T03:40:27.787791] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-17T03:40:27.787973] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXPD took 35.7s. Estimated remaining: 3h 48m 37s. Rate: 6.9 symbols/min [2025-09-17T03:40:29.440639] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:40:29.450683] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-17T03:40:31.243725] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:40:31.254791] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-17T03:40:32.934361] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T03:40:32.944991] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-17T03:40:34.513857] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:40:34.521503] [INFO ] [REMOTE ] EXR: Full fetch complete (65551 records). [2025-09-17T03:40:34.521789] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-17T03:40:34.915974] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-17T03:40:34.916095] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-17T03:40:34.916892] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-17T03:40:34.916976] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-17T03:40:34.918905] [DEBUG] [LOCAL ] EXR: Trimmed 65551 records to 45648 (keeping 200 days of data) [2025-09-17T03:40:35.215286] [DEBUG] [LOCAL ] EXR: Primary data saved (45648 records). [2025-09-17T03:40:35.215460] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-17T03:40:35.215575] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXR took 23.1s. Estimated remaining: 3h 48m 26s. Rate: 6.9 symbols/min [2025-09-17T03:40:35.959684] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.891518] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.927867] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.986269] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.984961] [DEBUG] [LOCAL ] FAF: No existing data file found in primary storage. [2025-09-17T03:40:35.987167] [WARN ] [MAIN ] FAF: No existing data found, performing full refresh instead. [2025-09-17T03:40:35.988005] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-17T03:40:35.988074] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-17T03:40:35.988234] [DEBUG] [LOCAL ] FAF: No primary data file found to delete. [2025-09-17T03:40:35.988277] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-17T03:40:36.198979] [DEBUG] [LOCAL ] FBK: Loaded 19358 existing records from primary storage. [2025-09-17T03:40:36.280507] [INFO ] [MAIN ] FBK: Loaded 19358 existing records. [2025-09-17T03:40:36.316953] [DEBUG] [LOCAL ] F: Loaded 40170 existing records from primary storage. [2025-09-17T03:40:36.343690] [INFO ] [MAIN ] F: Loaded 40170 existing records. [2025-09-17T03:40:36.553638] [DEBUG] [LOCAL ] FBIN: Loaded 37713 existing records from primary storage. [2025-09-17T03:40:36.622930] [INFO ] [MAIN ] FBIN: Loaded 37713 existing records. [2025-09-17T03:40:36.650746] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:36.717611] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-11. [2025-09-17T03:40:36.849415] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:36.859560] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:36.879933] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-17T03:40:36.900463] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-17T03:40:36.879984] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-17T03:40:36.923307] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-17T03:40:36.920024] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-17T03:40:36.923443] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-17T03:40:36.934909] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-17T03:40:36.956544] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-17T03:40:37.247820] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:37.300861] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-17T03:40:37.383188] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-17T03:40:37.564850] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-17T03:40:37.599306] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-17T03:40:37.890185] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:37.890668] [INFO ] [REMOTE ] F: Fetching primary data for 2024-11. [2025-09-17T03:40:37.898515] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:37.939424] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-11. [2025-09-17T03:40:38.158321] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:38.158700] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-11. [2025-09-17T03:40:38.297283] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:40:38.305588] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-17T03:40:38.652048] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T03:40:38.656803] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-17T03:40:39.383343] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T03:40:39.387191] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-17T03:40:39.658778] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T03:40:39.666521] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-17T03:40:39.767938] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:40:39.778015] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-17T03:40:40.288847] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-11 (2.40 seconds). [2025-09-17T03:40:40.299816] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-17T03:40:40.486788] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:40:40.491262] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-17T03:40:40.932785] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:40:40.940533] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-17T03:40:41.159843] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:40:41.169747] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-17T03:40:41.376167] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T03:40:41.379882] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-17T03:40:41.932180] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T03:40:41.939374] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-17T03:40:42.547783] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T03:40:42.552368] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-17T03:40:42.732947] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-17T03:40:42.744733] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-17T03:40:42.851813] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:40:43.090200] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-17T03:40:43.430158] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:40:43.874194] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:40:43.890094] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-17T03:40:44.429886] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T03:40:44.690153] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-17T03:40:45.028284] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T03:40:45.251590] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T03:40:45.490199] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-17T03:40:46.290127] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-17T03:40:46.561453] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:40:46.743402] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T03:40:47.090168] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-17T03:40:47.890239] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-17T03:40:48.539543] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:40:48.695305] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-17T03:40:48.719055] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-17T03:40:49.490152] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-17T03:40:49.684035] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:40:50.290186] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-17T03:40:50.389991] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:40:51.090136] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-17T03:40:51.890113] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-17T03:40:52.000943] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T03:40:52.089838] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:40:52.385031] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T03:40:52.690182] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-17T03:40:53.424553] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:40:53.444210] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T03:40:53.448474] [INFO ] [REMOTE ] FBK: Full fetch complete (32271 records). [2025-09-17T03:40:53.448679] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-17T03:40:53.495335] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-17T03:40:53.852024] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-17T03:40:53.852157] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-17T03:40:53.852793] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-17T03:40:53.852852] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-17T03:40:53.853935] [DEBUG] [LOCAL ] FBK: Trimmed 32271 records to 25177 (keeping 200 days of data) [2025-09-17T03:40:54.008340] [DEBUG] [LOCAL ] FBK: Primary data saved (25177 records). [2025-09-17T03:40:54.008523] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-17T03:40:54.008636] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FBK took 18.8s. Estimated remaining: 3h 48m 37s. Rate: 6.9 symbols/min [2025-09-17T03:40:54.180901] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:54.181149] [DEBUG] [LOCAL ] FBP: No existing data file found in primary storage. [2025-09-17T03:40:54.181194] [WARN ] [MAIN ] FBP: No existing data found, performing full refresh instead. [2025-09-17T03:40:54.181300] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-17T03:40:54.181366] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-17T03:40:54.181423] [DEBUG] [LOCAL ] FBP: No primary data file found to delete. [2025-09-17T03:40:54.181469] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-17T03:40:54.295295] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-17T03:40:54.544303] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:55.090126] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-11. [2025-09-17T03:40:55.890167] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-17T03:40:55.991975] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:40:56.072140] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-17T03:40:56.683217] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T03:40:56.691956] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-17T03:40:57.490155] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-17T03:40:57.532023] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:40:58.290164] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-17T03:40:59.090180] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-17T03:40:59.152460] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:40:59.329194] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-17T03:40:59.895255] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-17T03:40:59.908473] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T03:41:00.690143] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-17T03:41:00.856956] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:41:01.490169] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-17T03:41:02.232569] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:41:02.290153] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-17T03:41:02.355743] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-17T03:41:02.593619] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:41:03.090130] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-17T03:41:03.860532] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T03:41:03.890139] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-17T03:41:04.544303] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:41:04.690160] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-17T03:41:05.088538] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T03:41:05.095004] [INFO ] [REMOTE ] FBIN: Full fetch complete (72350 records). [2025-09-17T03:41:05.095214] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-17T03:41:05.495553] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-17T03:41:05.519631] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-17T03:41:05.519766] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-17T03:41:05.520820] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-17T03:41:05.520904] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-17T03:41:05.522598] [DEBUG] [LOCAL ] FBIN: Trimmed 72350 records to 50474 (keeping 200 days of data) [2025-09-17T03:41:05.849459] [DEBUG] [LOCAL ] FBIN: Primary data saved (50474 records). [2025-09-17T03:41:05.849666] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-17T03:41:05.849771] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. FBIN took 30.6s. Estimated remaining: 3h 48m 34s. Rate: 6.9 symbols/min [2025-09-17T03:41:06.025304] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:06.050740] [DEBUG] [LOCAL ] FBRT: Loaded 25233 existing records from primary storage. [2025-09-17T03:41:06.050905] [INFO ] [MAIN ] FBRT: Loaded 25233 existing records. [2025-09-17T03:41:06.225798] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:41:06.226049] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-17T03:41:06.226110] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-17T03:41:06.226838] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-17T03:41:06.226903] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-17T03:41:06.295669] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-17T03:41:06.587943] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:06.620043] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:41:07.090178] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-17T03:41:07.715037] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T03:41:07.719955] [INFO ] [REMOTE ] FAF: Full fetch complete (57299 records). [2025-09-17T03:41:07.720095] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-17T03:41:07.901374] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-11. [2025-09-17T03:41:08.113465] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-17T03:41:08.113573] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-17T03:41:08.114780] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-17T03:41:08.115082] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-17T03:41:08.116875] [DEBUG] [LOCAL ] FAF: Trimmed 57299 records to 42029 (keeping 200 days of data) [2025-09-17T03:41:08.261098] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-17T03:41:08.409047] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:41:08.462360] [DEBUG] [LOCAL ] FAF: Primary data saved (42029 records). [2025-09-17T03:41:08.462521] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-17T03:41:08.462604] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. FAF took 33.2s. Estimated remaining: 3h 48m 14s. Rate: 6.9 symbols/min [2025-09-17T03:41:08.633532] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:08.633773] [DEBUG] [LOCAL ] FC: No existing data file found in primary storage. [2025-09-17T03:41:08.633843] [WARN ] [MAIN ] FC: No existing data found, performing full refresh instead. [2025-09-17T03:41:08.633986] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-17T03:41:08.634053] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-17T03:41:08.634196] [DEBUG] [LOCAL ] FC: No primary data file found to delete. [2025-09-17T03:41:08.634265] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-17T03:41:08.695834] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-17T03:41:08.993905] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:09.215498] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T03:41:09.490147] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-11. [2025-09-17T03:41:10.286859] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:41:10.290074] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-17T03:41:10.938676] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T03:41:11.090180] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-17T03:41:11.168237] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T03:41:11.189316] [DEBUG] [REMOTE ] FBRT: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T03:41:11.189744] [WARN ] [REMOTE ] FBRT: No data returned for month 2024-12 [2025-09-17T03:41:11.890146] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-17T03:41:12.690092] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-17T03:41:13.152259] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T03:41:13.490201] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-17T03:41:14.290137] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-17T03:41:14.998200] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:41:15.025845] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-17T03:41:15.034100] [INFO ] [REMOTE ] F: Full fetch complete (77998 records). [2025-09-17T03:41:15.034319] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-17T03:41:15.095259] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-17T03:41:15.452230] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-17T03:41:15.452872] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-17T03:41:15.453219] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T03:41:15.454320] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-17T03:41:15.458262] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-17T03:41:15.459862] [DEBUG] [LOCAL ] F: Trimmed 77998 records to 53820 (keeping 200 days of data) [2025-09-17T03:41:15.807475] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-17T03:41:15.807660] [INFO ] [MAIN ] F: Full history saved. [2025-09-17T03:41:15.807757] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 40.6s. Estimated remaining: 3h 48m 2s. Rate: 6.9 symbols/min [2025-09-17T03:41:15.896737] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-17T03:41:15.977549] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:16.005704] [DEBUG] [LOCAL ] FCF: Loaded 28310 existing records from primary storage. [2025-09-17T03:41:16.005873] [INFO ] [MAIN ] FCF: Loaded 28310 existing records. [2025-09-17T03:41:16.180985] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:41:16.181223] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-17T03:41:16.181274] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-17T03:41:16.182082] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-17T03:41:16.182145] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-17T03:41:16.557612] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:16.690132] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-11. [2025-09-17T03:41:16.830136] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:41:17.301960] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:41:17.490158] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-17T03:41:17.792387] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T03:41:18.290152] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-17T03:41:18.859213] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T03:41:19.090141] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-17T03:41:19.890148] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-17T03:41:20.026029] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:41:20.224063] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:41:20.690126] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-17T03:41:21.393132] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T03:41:21.490112] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-17T03:41:21.583244] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T03:41:22.290188] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-17T03:41:22.817756] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:41:23.090119] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-17T03:41:23.896073] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-17T03:41:23.917271] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:41:24.472234] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:41:24.690170] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-17T03:41:25.481665] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T03:41:25.490904] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-17T03:41:25.961860] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:41:25.967235] [INFO ] [REMOTE ] FBP: Full fetch complete (66183 records). [2025-09-17T03:41:25.967388] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-17T03:41:26.295198] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-17T03:41:26.379523] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-17T03:41:26.379690] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-17T03:41:26.380625] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-17T03:41:26.380731] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-17T03:41:26.382328] [DEBUG] [LOCAL ] FBP: Trimmed 66183 records to 46372 (keeping 200 days of data) [2025-09-17T03:41:26.633071] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T03:41:26.709443] [DEBUG] [LOCAL ] FBP: Primary data saved (46372 records). [2025-09-17T03:41:26.709624] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-17T03:41:26.709738] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBP took 32.7s. Estimated remaining: 3h 47m 58s. Rate: 6.9 symbols/min [2025-09-17T03:41:26.879669] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:26.879905] [DEBUG] [LOCAL ] FCN: No existing data file found in primary storage. [2025-09-17T03:41:26.879957] [WARN ] [MAIN ] FCN: No existing data found, performing full refresh instead. [2025-09-17T03:41:26.880061] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-17T03:41:26.880116] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-17T03:41:26.880169] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-17T03:41:26.880216] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-17T03:41:27.095213] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-17T03:41:27.240867] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:27.835232] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T03:41:27.890113] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-17T03:41:28.300607] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T03:41:28.690156] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-17T03:41:29.242755] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T03:41:29.490163] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-11. [2025-09-17T03:41:29.754092] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T03:41:30.290154] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-17T03:41:30.644902] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T03:41:31.090149] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-17T03:41:31.900123] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-17T03:41:31.906158] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T03:41:32.267678] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:41:32.271722] [INFO ] [REMOTE ] FBRT: Full fetch complete (43288 records). [2025-09-17T03:41:32.271862] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-17T03:41:32.457862] [WARN ] [VALIDATOR ] FBRT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:41:32.458370] [FATAL] [MAIN ] FBRT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:41:32.458423] [WARN ] [MAIN ] FBRT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:41:32.458467] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-17T03:41:32.458529] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-09-17T03:41:32.458579] [INFO ] [LOCAL ] FBRT: Starting deletion of derivative data. [2025-09-17T03:41:32.459085] [DEBUG] [LOCAL ] FBRT: Deleted derivative data file. [2025-09-17T03:41:32.459190] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FBRT took 26.6s. Estimated remaining: 3h 47m 43s. Rate: 6.9 symbols/min [2025-09-17T03:41:32.631461] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:32.631680] [DEBUG] [LOCAL ] FCPT: No existing data file found in primary storage. [2025-09-17T03:41:32.631745] [WARN ] [MAIN ] FCPT: No existing data found, performing full refresh instead. [2025-09-17T03:41:32.631849] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-17T03:41:32.631902] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-17T03:41:32.631951] [DEBUG] [LOCAL ] FCPT: No primary data file found to delete. [2025-09-17T03:41:32.631997] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-17T03:41:32.695334] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-17T03:41:32.967694] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:41:33.004638] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:33.490141] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-17T03:41:34.290131] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-11. [2025-09-17T03:41:34.384529] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T03:41:34.487143] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:41:35.090239] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-17T03:41:35.728351] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:41:35.890168] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-17T03:41:36.166632] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T03:41:36.690138] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-17T03:41:37.405631] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T03:41:37.490773] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-17T03:41:37.698443] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T03:41:38.290146] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-17T03:41:38.654103] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T03:41:39.090193] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-17T03:41:39.721351] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:41:39.890196] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-17T03:41:39.934426] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:41:39.937051] [INFO ] [REMOTE ] FC: Full fetch complete (21376 records). [2025-09-17T03:41:39.937188] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-17T03:41:40.303140] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-17T03:41:40.303259] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-17T03:41:40.303875] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-17T03:41:40.303969] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-17T03:41:40.304713] [DEBUG] [LOCAL ] FC: Trimmed 21376 records to 15411 (keeping 200 days of data) [2025-09-17T03:41:40.396227] [DEBUG] [LOCAL ] FC: Primary data saved (15411 records). [2025-09-17T03:41:40.396399] [INFO ] [MAIN ] FC: Full history saved. [2025-09-17T03:41:40.396491] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FC took 31.9s. Estimated remaining: 3h 47m 33s. Rate: 6.9 symbols/min [2025-09-17T03:41:40.566725] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:40.566954] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-17T03:41:40.567009] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-17T03:41:40.567112] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-17T03:41:40.567167] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-17T03:41:40.567220] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-17T03:41:40.567266] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-17T03:41:40.709836] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-17T03:41:40.964332] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:41.092619] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:41:41.490138] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-17T03:41:42.290165] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-11. [2025-09-17T03:41:42.431787] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T03:41:42.485622] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T03:41:42.621913] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T03:41:43.090255] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-17T03:41:43.890195] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-17T03:41:44.225182] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T03:41:44.242042] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:41:44.690219] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-17T03:41:45.490152] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-17T03:41:46.120886] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:41:46.290144] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-17T03:41:46.807087] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T03:41:46.867282] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:41:47.090165] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-17T03:41:47.890149] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-17T03:41:48.371753] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T03:41:48.435619] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:41:48.690184] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-17T03:41:49.490213] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-17T03:41:50.011330] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T03:41:50.017612] [INFO ] [REMOTE ] FCF: Full fetch complete (57773 records). [2025-09-17T03:41:50.017840] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-17T03:41:50.295306] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-17T03:41:50.414345] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-17T03:41:50.414480] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-17T03:41:50.415284] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-17T03:41:50.415351] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-17T03:41:50.416624] [DEBUG] [LOCAL ] FCF: Trimmed 57773 records to 39936 (keeping 200 days of data) [2025-09-17T03:41:50.669112] [DEBUG] [LOCAL ] FCF: Primary data saved (39936 records). [2025-09-17T03:41:50.669307] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-17T03:41:50.669421] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FCF took 34.9s. Estimated remaining: 3h 47m 27s. Rate: 6.9 symbols/min [2025-09-17T03:41:50.699825] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T03:41:50.852219] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:50.863924] [DEBUG] [LOCAL ] FCT: Loaded 10467 existing records from primary storage. [2025-09-17T03:41:50.864074] [INFO ] [MAIN ] FCT: Loaded 10467 existing records. [2025-09-17T03:41:51.047993] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:41:51.048340] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-17T03:41:51.048776] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-17T03:41:51.049537] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-17T03:41:51.049726] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-17T03:41:51.111292] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-17T03:41:51.182254] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T03:41:51.455099] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:51.890125] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-11. [2025-09-17T03:41:52.423814] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T03:41:52.690176] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-17T03:41:52.831860] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T03:41:53.490141] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-17T03:41:54.226269] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T03:41:54.290133] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-17T03:41:54.516513] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T03:41:55.090185] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-17T03:41:55.723479] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T03:41:55.741320] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T03:41:55.890135] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-17T03:41:56.333447] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T03:41:56.690130] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-17T03:41:57.490146] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-17T03:41:57.819085] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T03:41:58.044832] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T03:41:58.290162] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-17T03:41:59.090171] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-17T03:41:59.753591] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:41:59.890168] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-17T03:42:00.500179] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:42:00.690188] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-17T03:42:01.118773] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:42:01.415058] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:42:01.490138] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-17T03:42:02.290125] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-17T03:42:03.090198] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-17T03:42:03.267250] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T03:42:03.890175] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-17T03:42:04.604847] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-17T03:42:04.617552] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:42:04.628848] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T03:42:04.690131] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-17T03:42:05.490147] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-17T03:42:05.851580] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T03:42:05.852526] [INFO ] [REMOTE ] FCRX: Full fetch complete (1649 records). [2025-09-17T03:42:05.852611] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-17T03:42:06.038967] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-17T03:42:06.039260] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:42:06.039405] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:42:06.039541] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-17T03:42:06.039700] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-17T03:42:06.053669] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-17T03:42:06.054255] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-17T03:42:06.054797] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:42:06.054998] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FCRX took 25.7s. Estimated remaining: 3h 47m 31s. Rate: 6.9 symbols/min [2025-09-17T03:42:06.236161] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:06.279539] [DEBUG] [LOCAL ] FCX: Loaded 40052 existing records from primary storage. [2025-09-17T03:42:06.279755] [INFO ] [MAIN ] FCX: Loaded 40052 existing records. [2025-09-17T03:42:06.295197] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-17T03:42:06.468885] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:06.469120] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-17T03:42:06.469207] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-17T03:42:06.470148] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-17T03:42:06.470226] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-17T03:42:06.839958] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:07.078591] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:42:07.090075] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-17T03:42:07.890160] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-11. [2025-09-17T03:42:08.159824] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T03:42:08.690135] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-17T03:42:09.490149] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-17T03:42:09.863700] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T03:42:09.990841] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:42:10.010188] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T03:42:10.290147] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-17T03:42:11.090196] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-17T03:42:11.157330] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:42:11.890136] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-17T03:42:12.046374] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:42:12.690142] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-17T03:42:12.840367] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:42:12.843499] [INFO ] [REMOTE ] FCN: Full fetch complete (35310 records). [2025-09-17T03:42:12.843599] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-17T03:42:13.218691] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-17T03:42:13.218798] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-17T03:42:13.219359] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-17T03:42:13.219420] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-17T03:42:13.220293] [DEBUG] [LOCAL ] FCN: Trimmed 35310 records to 26388 (keeping 200 days of data) [2025-09-17T03:42:13.388619] [DEBUG] [LOCAL ] FCN: Primary data saved (26388 records). [2025-09-17T03:42:13.388839] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-17T03:42:13.388938] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCN took 46.7s. Estimated remaining: 3h 47m 19s. Rate: 6.9 symbols/min [2025-09-17T03:42:13.495204] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-17T03:42:13.560294] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:13.581986] [DEBUG] [LOCAL ] FDP: Loaded 22537 existing records from primary storage. [2025-09-17T03:42:13.582173] [INFO ] [MAIN ] FDP: Loaded 22537 existing records. [2025-09-17T03:42:13.763216] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:13.763702] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-17T03:42:13.763832] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-17T03:42:13.775493] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T03:42:13.775555] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-17T03:42:13.779307] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-17T03:42:14.144180] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:14.290166] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-11. [2025-09-17T03:42:15.090172] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-17T03:42:15.474755] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T03:42:15.512363] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T03:42:15.890138] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-17T03:42:15.938680] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T03:42:16.690180] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-17T03:42:17.023350] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T03:42:17.490143] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-17T03:42:17.604213] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T03:42:17.606912] [INFO ] [REMOTE ] FCT: Full fetch complete (21272 records). [2025-09-17T03:42:17.607015] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-17T03:42:17.981738] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-17T03:42:17.981857] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-17T03:42:17.982372] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-17T03:42:17.982442] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-17T03:42:17.983125] [DEBUG] [LOCAL ] FCT: Trimmed 21272 records to 14388 (keeping 200 days of data) [2025-09-17T03:42:18.071386] [DEBUG] [LOCAL ] FCT: Primary data saved (14388 records). [2025-09-17T03:42:18.071585] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-17T03:42:18.071752] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCT took 27.4s. Estimated remaining: 3h 47m 3s. Rate: 6.9 symbols/min [2025-09-17T03:42:18.242898] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:18.261251] [DEBUG] [LOCAL ] FDS: Loaded 18492 existing records from primary storage. [2025-09-17T03:42:18.261429] [INFO ] [MAIN ] FDS: Loaded 18492 existing records. [2025-09-17T03:42:18.295248] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-17T03:42:18.442775] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:18.443069] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-17T03:42:18.443148] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-17T03:42:18.443801] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-17T03:42:18.443872] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-17T03:42:18.801134] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:19.090101] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-17T03:42:19.548973] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:42:19.609327] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T03:42:19.890128] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-17T03:42:20.373325] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:42:20.378285] [INFO ] [REMOTE ] FCPT: Full fetch complete (53094 records). [2025-09-17T03:42:20.378419] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-17T03:42:20.695363] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-11. [2025-09-17T03:42:20.774787] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-17T03:42:20.774965] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-17T03:42:20.775804] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-17T03:42:20.775893] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-17T03:42:20.777342] [DEBUG] [LOCAL ] FCPT: Trimmed 53094 records to 37569 (keeping 200 days of data) [2025-09-17T03:42:21.010371] [DEBUG] [LOCAL ] FCPT: Primary data saved (37569 records). [2025-09-17T03:42:21.010559] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-17T03:42:21.010661] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCPT took 48.6s. Estimated remaining: 3h 46m 43s. Rate: 6.9 symbols/min [2025-09-17T03:42:21.198078] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:21.240165] [DEBUG] [LOCAL ] FDX: Loaded 38297 existing records from primary storage. [2025-09-17T03:42:21.240346] [INFO ] [MAIN ] FDX: Loaded 38297 existing records. [2025-09-17T03:42:21.423232] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:21.423510] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-17T03:42:21.423571] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-17T03:42:21.424746] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-17T03:42:21.424821] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-17T03:42:21.495521] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-17T03:42:21.795694] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:22.290135] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-11. [2025-09-17T03:42:22.851749] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.96 seconds). [2025-09-17T03:42:23.095167] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-17T03:42:23.103062] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-17T03:42:23.783617] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T03:42:23.890087] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-17T03:42:24.408448] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T03:42:24.686427] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T03:42:24.691345] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-17T03:42:25.217276] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T03:42:25.490137] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-17T03:42:26.068631] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:42:26.290147] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-17T03:42:27.090091] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-17T03:42:27.434826] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:42:27.459778] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T03:42:27.890171] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-17T03:42:28.690258] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-17T03:42:29.276135] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T03:42:29.490186] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-17T03:42:29.705248] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:42:29.758722] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T03:42:30.290220] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-17T03:42:31.090175] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-17T03:42:31.505142] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T03:42:31.643042] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T03:42:31.890165] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-17T03:42:32.608096] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:42:32.690153] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-17T03:42:33.490135] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-17T03:42:33.704538] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:42:33.772186] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T03:42:34.290148] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-17T03:42:35.090553] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-17T03:42:35.331303] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T03:42:35.503159] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:42:35.890169] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-17T03:42:36.454373] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T03:42:36.690156] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-17T03:42:37.490807] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-17T03:42:37.490722] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T03:42:37.525235] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:42:38.290145] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-17T03:42:39.090162] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-17T03:42:39.771131] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T03:42:39.890147] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-17T03:42:40.352623] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:42:40.492720] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T03:42:40.690142] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-17T03:42:41.490199] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-17T03:42:42.008850] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T03:42:42.290120] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-17T03:42:42.666124] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:42:42.849613] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T03:42:43.090155] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-17T03:42:43.890141] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-17T03:42:44.156117] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T03:42:44.162676] [INFO ] [REMOTE ] FCX: Full fetch complete (77652 records). [2025-09-17T03:42:44.162843] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-17T03:42:44.562975] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-17T03:42:44.563093] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-17T03:42:44.564085] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-17T03:42:44.564150] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-17T03:42:44.565825] [DEBUG] [LOCAL ] FCX: Trimmed 77652 records to 53699 (keeping 200 days of data) [2025-09-17T03:42:44.693509] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-17T03:42:44.898383] [DEBUG] [LOCAL ] FCX: Primary data saved (53699 records). [2025-09-17T03:42:44.898562] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-17T03:42:44.898678] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCX took 38.8s. Estimated remaining: 3h 47m 3s. Rate: 6.9 symbols/min [2025-09-17T03:42:45.075444] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:45.091720] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:42:45.127411] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T03:42:45.164676] [DEBUG] [LOCAL ] FE: Loaded 39837 existing records from primary storage. [2025-09-17T03:42:45.164848] [INFO ] [MAIN ] FE: Loaded 39837 existing records. [2025-09-17T03:42:45.345686] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:45.345937] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-17T03:42:45.346000] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-17T03:42:45.346921] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-17T03:42:45.346985] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-17T03:42:45.495259] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-17T03:42:45.717021] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:46.058705] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:42:46.290174] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-17T03:42:46.925353] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:42:47.090134] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-17T03:42:47.890111] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-17T03:42:48.366908] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T03:42:48.388691] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T03:42:48.392394] [INFO ] [REMOTE ] FDP: Full fetch complete (42570 records). [2025-09-17T03:42:48.392518] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-17T03:42:48.695267] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-11. [2025-09-17T03:42:48.774880] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-17T03:42:48.774995] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-17T03:42:48.775691] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-17T03:42:48.775765] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-17T03:42:48.776862] [DEBUG] [LOCAL ] FDP: Trimmed 42570 records to 30448 (keeping 200 days of data) [2025-09-17T03:42:48.973937] [DEBUG] [LOCAL ] FDP: Primary data saved (30448 records). [2025-09-17T03:42:48.974173] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-17T03:42:48.974342] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FDP took 35.6s. Estimated remaining: 3h 46m 46s. Rate: 6.9 symbols/min [2025-09-17T03:42:49.152396] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:49.152670] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-17T03:42:49.152751] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-17T03:42:49.152896] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-17T03:42:49.152954] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-17T03:42:49.153013] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-17T03:42:49.153099] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-17T03:42:49.507317] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-17T03:42:49.511682] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:49.523832] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:42:49.527959] [INFO ] [REMOTE ] FDS: Full fetch complete (35640 records). [2025-09-17T03:42:49.528088] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-17T03:42:49.897688] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-17T03:42:49.897795] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-17T03:42:49.898366] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-17T03:42:49.898433] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-17T03:42:49.899301] [DEBUG] [LOCAL ] FDS: Trimmed 35640 records to 25360 (keeping 200 days of data) [2025-09-17T03:42:50.079070] [DEBUG] [LOCAL ] FDS: Primary data saved (25360 records). [2025-09-17T03:42:50.079406] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-17T03:42:50.079605] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FDS took 32.0s. Estimated remaining: 3h 46m 22s. Rate: 6.9 symbols/min [2025-09-17T03:42:50.253180] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:50.253413] [DEBUG] [LOCAL ] FERG: No existing data file found in primary storage. [2025-09-17T03:42:50.253464] [WARN ] [MAIN ] FERG: No existing data found, performing full refresh instead. [2025-09-17T03:42:50.253590] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-17T03:42:50.253671] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-17T03:42:50.253721] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-09-17T03:42:50.253767] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-17T03:42:50.296285] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-11. [2025-09-17T03:42:50.629810] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:50.660836] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T03:42:50.675591] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-11 (0.38 seconds). [2025-09-17T03:42:51.090182] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-17T03:42:51.472620] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T03:42:51.890192] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-11. [2025-09-17T03:42:52.690144] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-17T03:42:52.776844] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:42:53.490181] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-17T03:42:53.663567] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:42:54.290132] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-17T03:42:54.512846] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T03:42:54.519258] [INFO ] [REMOTE ] FDX: Full fetch complete (74190 records). [2025-09-17T03:42:54.519440] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-17T03:42:54.914405] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-17T03:42:54.914517] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-17T03:42:54.915412] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-17T03:42:54.915495] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-17T03:42:54.916987] [DEBUG] [LOCAL ] FDX: Trimmed 74190 records to 51550 (keeping 200 days of data) [2025-09-17T03:42:55.110869] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-17T03:42:55.263632] [DEBUG] [LOCAL ] FDX: Primary data saved (51550 records). [2025-09-17T03:42:55.264127] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-17T03:42:55.264296] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FDX took 34.3s. Estimated remaining: 3h 46m 7s. Rate: 6.9 symbols/min [2025-09-17T03:42:55.444935] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:55.482095] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T03:42:55.499755] [DEBUG] [LOCAL ] FET: Loaded 9003 existing records from primary storage. [2025-09-17T03:42:55.499985] [INFO ] [MAIN ] FET: Loaded 9003 existing records. [2025-09-17T03:42:55.606152] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T03:42:55.690367] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:55.690762] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-17T03:42:55.690843] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-17T03:42:55.691299] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-17T03:42:55.691368] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-17T03:42:55.895569] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-17T03:42:56.068076] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:56.098269] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T03:42:56.429780] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T03:42:56.690137] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-11. [2025-09-17T03:42:57.490167] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-17T03:42:57.503748] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:42:57.929184] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T03:42:58.290162] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-17T03:42:59.090151] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-17T03:42:59.549899] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:42:59.890116] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-17T03:42:59.973971] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T03:43:00.231612] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T03:43:00.690188] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-17T03:43:01.490146] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-17T03:43:02.290133] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-17T03:43:02.525147] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T03:43:02.772503] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T03:43:03.090184] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-17T03:43:03.386536] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:43:03.437280] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:43:03.890241] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-17T03:43:04.690146] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-17T03:43:05.060497] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-17T03:43:05.490135] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-17T03:43:05.729236] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:43:05.865044] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T03:43:06.290140] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-17T03:43:07.090139] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-17T03:43:07.890146] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-17T03:43:07.955321] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:43:08.690209] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-17T03:43:08.913875] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:43:08.914319] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:43:09.490126] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-17T03:43:10.290128] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-17T03:43:10.593788] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:43:11.090213] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-17T03:43:11.208856] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T03:43:11.304103] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:43:11.890143] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-17T03:43:12.690156] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-17T03:43:12.813408] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T03:43:13.016841] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T03:43:13.490140] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-17T03:43:14.300681] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-17T03:43:14.327169] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T03:43:14.435322] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T03:43:14.685383] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T03:43:14.686530] [INFO ] [REMOTE ] FENG: Full fetch complete (2143 records). [2025-09-17T03:43:14.686630] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-17T03:43:14.935370] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T03:43:14.935661] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:43:14.935716] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:43:14.935763] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-17T03:43:14.935857] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-17T03:43:14.935905] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-17T03:43:14.935956] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-17T03:43:14.936036] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FENG took 26.0s. Estimated remaining: 3h 46m 19s. Rate: 6.9 symbols/min [2025-09-17T03:43:15.093907] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-17T03:43:15.113264] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:15.113482] [DEBUG] [LOCAL ] FF: No existing data file found in primary storage. [2025-09-17T03:43:15.113533] [WARN ] [MAIN ] FF: No existing data found, performing full refresh instead. [2025-09-17T03:43:15.113876] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-17T03:43:15.113925] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-17T03:43:15.113969] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-09-17T03:43:15.114007] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-17T03:43:15.473808] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:15.890153] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-11. [2025-09-17T03:43:16.690132] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-17T03:43:16.997274] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T03:43:17.311532] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:43:17.490136] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-17T03:43:18.290104] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-17T03:43:18.334749] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T03:43:18.695858] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T03:43:19.090124] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-17T03:43:19.890119] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-17T03:43:20.079830] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:43:20.323920] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T03:43:20.527335] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T03:43:20.690104] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-17T03:43:21.490136] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-17T03:43:21.538666] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T03:43:22.290196] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-17T03:43:22.643518] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:43:23.090159] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-17T03:43:23.890152] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-17T03:43:24.008508] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T03:43:24.018452] [INFO ] [REMOTE ] FE: Full fetch complete (77020 records). [2025-09-17T03:43:24.018709] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-17T03:43:24.464437] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-17T03:43:24.464590] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-17T03:43:24.465608] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-17T03:43:24.465696] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-17T03:43:24.467253] [DEBUG] [LOCAL ] FE: Trimmed 77020 records to 53453 (keeping 200 days of data) [2025-09-17T03:43:24.691682] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-17T03:43:24.724442] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T03:43:24.824365] [DEBUG] [LOCAL ] FE: Primary data saved (53453 records). [2025-09-17T03:43:24.824674] [INFO ] [MAIN ] FE: Full history saved. [2025-09-17T03:43:24.824806] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FE took 39.9s. Estimated remaining: 3h 46m 12s. Rate: 6.9 symbols/min [2025-09-17T03:43:25.033820] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:25.034635] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-09-17T03:43:25.035628] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T03:43:25.035817] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-09-17T03:43:25.046035] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-17T03:43:25.046340] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-17T03:43:25.046515] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-17T03:43:25.046573] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-17T03:43:25.433603] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:25.490106] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-17T03:43:25.661032] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T03:43:26.290181] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-17T03:43:26.507191] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T03:43:27.090153] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-11. [2025-09-17T03:43:27.658257] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:43:27.682024] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T03:43:27.890130] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-17T03:43:28.690139] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-17T03:43:29.207386] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T03:43:29.484287] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:43:29.493973] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-17T03:43:30.290148] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-17T03:43:30.774536] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:43:31.030945] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T03:43:31.090163] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-17T03:43:31.748739] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T03:43:31.890126] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-17T03:43:32.690149] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-17T03:43:33.472468] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T03:43:33.480057] [INFO ] [REMOTE ] FERG: Full fetch complete (70809 records). [2025-09-17T03:43:33.480215] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-17T03:43:33.495408] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-17T03:43:33.842461] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:43:33.898110] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-17T03:43:33.898520] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-17T03:43:33.899478] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-17T03:43:33.899552] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-17T03:43:33.900954] [DEBUG] [LOCAL ] FERG: Trimmed 70809 records to 49021 (keeping 200 days of data) [2025-09-17T03:43:34.215453] [DEBUG] [LOCAL ] FERG: Primary data saved (49021 records). [2025-09-17T03:43:34.215625] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-17T03:43:34.215742] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FERG took 44.1s. Estimated remaining: 3h 46m 5s. Rate: 6.9 symbols/min [2025-09-17T03:43:34.293075] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-17T03:43:34.336815] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T03:43:34.402453] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:34.402734] [DEBUG] [LOCAL ] FFC: No existing data file found in primary storage. [2025-09-17T03:43:34.402790] [WARN ] [MAIN ] FFC: No existing data found, performing full refresh instead. [2025-09-17T03:43:34.402919] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-17T03:43:34.402975] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-17T03:43:34.403025] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-09-17T03:43:34.403069] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-17T03:43:34.759993] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:35.090139] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-11. [2025-09-17T03:43:35.228176] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:43:35.232093] [INFO ] [REMOTE ] FET: Full fetch complete (17843 records). [2025-09-17T03:43:35.232282] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-17T03:43:35.607523] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-17T03:43:35.607685] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-17T03:43:35.608229] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-17T03:43:35.608286] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-17T03:43:35.609232] [DEBUG] [LOCAL ] FET: Trimmed 17843 records to 12577 (keeping 200 days of data) [2025-09-17T03:43:35.692017] [DEBUG] [LOCAL ] FET: Primary data saved (12577 records). [2025-09-17T03:43:35.692256] [INFO ] [MAIN ] FET: Full history saved. [2025-09-17T03:43:35.692383] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FET took 40.4s. Estimated remaining: 3h 45m 42s. Rate: 6.9 symbols/min [2025-09-17T03:43:35.865944] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:35.866253] [DEBUG] [LOCAL ] FFWM: No existing data file found in primary storage. [2025-09-17T03:43:35.866309] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-09-17T03:43:35.866478] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-17T03:43:35.866535] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-17T03:43:35.866596] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-09-17T03:43:35.866677] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-17T03:43:35.898070] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-17T03:43:36.238576] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:36.249760] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T03:43:36.690106] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-11. [2025-09-17T03:43:36.841510] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T03:43:37.490143] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-17T03:43:38.027683] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T03:43:38.290117] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-17T03:43:38.531802] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:43:38.950527] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:43:39.090117] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-17T03:43:39.692747] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:43:39.890140] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-17T03:43:40.485213] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:43:40.690155] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-17T03:43:41.490147] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-17T03:43:42.025583] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T03:43:42.126151] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T03:43:42.290170] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-17T03:43:42.879954] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T03:43:42.881176] [INFO ] [REMOTE ] FFA: Full fetch complete (8118 records). [2025-09-17T03:43:42.881262] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-17T03:43:43.095203] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-17T03:43:43.264371] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-17T03:43:43.264503] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-17T03:43:43.264763] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-17T03:43:43.264839] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-17T03:43:43.265310] [DEBUG] [LOCAL ] FFA: Trimmed 8118 records to 5581 (keeping 200 days of data) [2025-09-17T03:43:43.301796] [DEBUG] [LOCAL ] FFA: Primary data saved (5581 records). [2025-09-17T03:43:43.301945] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-17T03:43:43.302040] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FFA took 18.5s. Estimated remaining: 3h 45m 31s. Rate: 6.9 symbols/min [2025-09-17T03:43:43.485108] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:43.501704] [DEBUG] [LOCAL ] FG: Loaded 15335 existing records from primary storage. [2025-09-17T03:43:43.501859] [INFO ] [MAIN ] FG: Loaded 15335 existing records. [2025-09-17T03:43:43.686911] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:43:43.687157] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-17T03:43:43.687223] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-17T03:43:43.687773] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-17T03:43:43.687841] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-17T03:43:43.901274] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-17T03:43:44.058744] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:44.554384] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T03:43:44.690095] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-17T03:43:45.040579] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T03:43:45.490140] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-17T03:43:45.701773] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:43:46.290097] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-17T03:43:46.691064] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:43:47.090141] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-17T03:43:47.347953] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T03:43:47.890139] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-17T03:43:48.406055] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:43:48.690154] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-11. [2025-09-17T03:43:48.844878] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T03:43:49.473784] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T03:43:49.490094] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-17T03:43:50.290151] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-17T03:43:50.342243] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T03:43:51.090177] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-17T03:43:51.724964] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:43:51.783168] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:43:51.890211] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-17T03:43:52.690102] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-17T03:43:53.036737] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:43:53.490124] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-17T03:43:53.726734] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T03:43:54.290183] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-17T03:43:54.487880] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:43:54.491580] [INFO ] [REMOTE ] FF: Full fetch complete (37384 records). [2025-09-17T03:43:54.491704] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-17T03:43:54.863479] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-17T03:43:54.863581] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-17T03:43:54.864240] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-17T03:43:54.864320] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-17T03:43:54.865237] [DEBUG] [LOCAL ] FF: Trimmed 37384 records to 25945 (keeping 200 days of data) [2025-09-17T03:43:55.019318] [DEBUG] [LOCAL ] FF: Primary data saved (25945 records). [2025-09-17T03:43:55.019481] [INFO ] [MAIN ] FF: Full history saved. [2025-09-17T03:43:55.019567] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FF took 40.1s. Estimated remaining: 3h 45m 28s. Rate: 6.9 symbols/min [2025-09-17T03:43:55.095262] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-17T03:43:55.194494] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:55.199072] [DEBUG] [LOCAL ] FGN: Loaded 2748 existing records from primary storage. [2025-09-17T03:43:55.199168] [INFO ] [MAIN ] FGN: Loaded 2748 existing records. [2025-09-17T03:43:55.379933] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:43:55.380216] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-17T03:43:55.380281] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-17T03:43:55.380562] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-17T03:43:55.380635] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-17T03:43:55.734381] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:55.890302] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-17T03:43:55.890239] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:43:56.212526] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T03:43:56.426179] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T03:43:56.690147] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-17T03:43:57.490137] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-11. [2025-09-17T03:43:57.724955] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:43:57.822306] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T03:43:58.290138] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-17T03:43:58.949154] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T03:43:59.090131] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-17T03:43:59.890147] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-17T03:43:59.908409] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T03:44:00.690135] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-17T03:44:01.300518] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T03:44:01.490112] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-17T03:44:01.868609] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:44:02.080089] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:44:02.290146] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-17T03:44:03.090160] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-17T03:44:03.278073] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T03:44:03.890141] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-17T03:44:04.545752] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T03:44:04.690133] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-17T03:44:05.255346] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T03:44:05.490134] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-17T03:44:05.932900] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T03:44:06.058481] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T03:44:06.290141] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-17T03:44:06.892981] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:44:07.090146] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-17T03:44:07.890107] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-17T03:44:08.141860] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:44:08.690132] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-17T03:44:08.859238] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T03:44:08.861665] [INFO ] [REMOTE ] FFC: Full fetch complete (24709 records). [2025-09-17T03:44:08.861770] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-17T03:44:09.228290] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-17T03:44:09.228396] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-17T03:44:09.228937] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-17T03:44:09.229014] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-17T03:44:09.229800] [DEBUG] [LOCAL ] FFC: Trimmed 24709 records to 16522 (keeping 200 days of data) [2025-09-17T03:44:09.330454] [DEBUG] [LOCAL ] FFC: Primary data saved (16522 records). [2025-09-17T03:44:09.330656] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-17T03:44:09.330778] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFC took 35.1s. Estimated remaining: 3h 45m 30s. Rate: 6.9 symbols/min [2025-09-17T03:44:09.498838] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:09.496311] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-17T03:44:09.504533] [DEBUG] [LOCAL ] FGSN: Loaded 3526 existing records from primary storage. [2025-09-17T03:44:09.504698] [INFO ] [MAIN ] FGSN: Loaded 3526 existing records. [2025-09-17T03:44:09.683743] [WARN ] [MAIN ] FGSN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:09.683986] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-17T03:44:09.684052] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-17T03:44:09.684334] [DEBUG] [LOCAL ] FGSN: Deleted primary data file. [2025-09-17T03:44:09.684394] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-17T03:44:10.049964] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:10.271556] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:44:10.290078] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-17T03:44:10.597842] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T03:44:11.090179] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-17T03:44:11.682356] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T03:44:11.699944] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T03:44:11.890164] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-17T03:44:12.458074] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:44:12.690179] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-17T03:44:13.490153] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-17T03:44:13.850887] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T03:44:14.123666] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:44:14.290183] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-11. [2025-09-17T03:44:14.507424] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:44:14.507818] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-11 [2025-09-17T03:44:15.090230] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-17T03:44:15.684943] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:44:15.890207] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-17T03:44:16.690157] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-17T03:44:16.809250] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:44:16.812073] [INFO ] [REMOTE ] FG: Full fetch complete (26644 records). [2025-09-17T03:44:16.812182] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-17T03:44:17.180856] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-17T03:44:17.180957] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-17T03:44:17.181376] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-17T03:44:17.181429] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-17T03:44:17.182260] [DEBUG] [LOCAL ] FG: Trimmed 26644 records to 22162 (keeping 200 days of data) [2025-09-17T03:44:17.323792] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T03:44:17.327505] [DEBUG] [LOCAL ] FG: Primary data saved (22162 records). [2025-09-17T03:44:17.327677] [INFO ] [MAIN ] FG: Full history saved. [2025-09-17T03:44:17.327781] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FG took 34.0s. Estimated remaining: 3h 45m 20s. Rate: 6.9 symbols/min [2025-09-17T03:44:17.495100] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-17T03:44:17.496879] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:17.535152] [DEBUG] [LOCAL ] FHI: Loaded 30062 existing records from primary storage. [2025-09-17T03:44:17.535325] [INFO ] [MAIN ] FHI: Loaded 30062 existing records. [2025-09-17T03:44:17.718096] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:44:17.718236] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:17.718756] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-17T03:44:17.718843] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-17T03:44:17.719412] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-17T03:44:17.720620] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-17T03:44:17.720704] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-17T03:44:18.070680] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:18.290134] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-17T03:44:18.771972] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T03:44:18.772947] [INFO ] [REMOTE ] FGN: Full fetch complete (5803 records). [2025-09-17T03:44:18.773030] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-17T03:44:19.095309] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-17T03:44:19.191878] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-17T03:44:19.192005] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-17T03:44:19.192235] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-17T03:44:19.192308] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-17T03:44:19.192897] [DEBUG] [LOCAL ] FGN: Trimmed 5803 records to 4076 (keeping 200 days of data) [2025-09-17T03:44:19.220335] [DEBUG] [LOCAL ] FGN: Primary data saved (4076 records). [2025-09-17T03:44:19.220536] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-17T03:44:19.220700] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FGN took 24.2s. Estimated remaining: 3h 44m 58s. Rate: 6.9 symbols/min [2025-09-17T03:44:19.390426] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:19.431256] [DEBUG] [LOCAL ] FHN: Loaded 39754 existing records from primary storage. [2025-09-17T03:44:19.431431] [INFO ] [MAIN ] FHN: Loaded 39754 existing records. [2025-09-17T03:44:19.609738] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:19.609981] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-17T03:44:19.610034] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-17T03:44:19.611084] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-17T03:44:19.611150] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-17T03:44:19.900247] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-17T03:44:19.984924] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:19.993295] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T03:44:20.690134] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-17T03:44:20.832951] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T03:44:20.837760] [INFO ] [REMOTE ] FFWM: Full fetch complete (51432 records). [2025-09-17T03:44:20.837903] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-17T03:44:21.228793] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-17T03:44:21.228915] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-17T03:44:21.229697] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-17T03:44:21.229766] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-17T03:44:21.230990] [DEBUG] [LOCAL ] FFWM: Trimmed 51432 records to 36298 (keeping 200 days of data) [2025-09-17T03:44:21.419532] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T03:44:21.449450] [DEBUG] [LOCAL ] FFWM: Primary data saved (36298 records). [2025-09-17T03:44:21.449620] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-17T03:44:21.449736] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FFWM took 45.8s. Estimated remaining: 3h 44m 37s. Rate: 6.9 symbols/min [2025-09-17T03:44:21.498144] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-11. [2025-09-17T03:44:21.633847] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:21.674200] [DEBUG] [LOCAL ] FI: Loaded 39987 existing records from primary storage. [2025-09-17T03:44:21.674382] [INFO ] [MAIN ] FI: Loaded 39987 existing records. [2025-09-17T03:44:21.860029] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:21.860301] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-17T03:44:21.860364] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-17T03:44:21.861319] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-17T03:44:21.861384] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-17T03:44:22.227112] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:22.290139] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-11. [2025-09-17T03:44:22.913956] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:44:23.090135] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-17T03:44:23.694398] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:44:23.890126] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-17T03:44:24.042209] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:44:24.690155] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-17T03:44:25.337704] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T03:44:25.360170] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:44:25.490192] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-17T03:44:26.290174] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-17T03:44:26.840923] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T03:44:27.090176] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-17T03:44:27.253214] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T03:44:27.890157] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-11. [2025-09-17T03:44:28.291414] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:44:28.690224] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-17T03:44:29.309325] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T03:44:29.490383] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-17T03:44:29.780202] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T03:44:30.290150] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-17T03:44:31.090190] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-17T03:44:31.367901] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T03:44:31.743427] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:44:31.890143] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-17T03:44:32.690166] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-17T03:44:32.897530] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T03:44:33.288705] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:44:33.490142] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-17T03:44:33.589443] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:44:34.080227] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T03:44:34.290199] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-17T03:44:35.090149] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-17T03:44:35.494897] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T03:44:35.496566] [INFO ] [REMOTE ] FGSN: Full fetch complete (7409 records). [2025-09-17T03:44:35.496715] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-17T03:44:35.683225] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-17T03:44:35.683465] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:44:35.683518] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:44:35.683560] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-17T03:44:35.683633] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-17T03:44:35.683698] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-17T03:44:35.684109] [DEBUG] [LOCAL ] FGSN: Deleted derivative data file. [2025-09-17T03:44:35.684208] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FGSN took 26.4s. Estimated remaining: 3h 44m 39s. Rate: 6.9 symbols/min [2025-09-17T03:44:35.850731] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:35.867834] [DEBUG] [LOCAL ] FICO: Loaded 16209 existing records from primary storage. [2025-09-17T03:44:35.867985] [INFO ] [MAIN ] FICO: Loaded 16209 existing records. [2025-09-17T03:44:35.898225] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-17T03:44:36.074168] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:36.074575] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-17T03:44:36.074721] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-17T03:44:36.075382] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-17T03:44:36.075528] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-17T03:44:36.395130] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T03:44:36.494545] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:36.690130] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-11. [2025-09-17T03:44:37.490152] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-17T03:44:37.614520] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T03:44:37.632026] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T03:44:38.290166] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-17T03:44:39.090142] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-17T03:44:39.217064] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:44:39.344691] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T03:44:39.890145] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-17T03:44:40.399604] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T03:44:40.690144] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-17T03:44:41.026676] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T03:44:41.490177] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-17T03:44:42.290175] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-17T03:44:42.530571] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T03:44:43.050153] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T03:44:43.090127] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-17T03:44:43.432373] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T03:44:43.890139] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-17T03:44:44.690158] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-17T03:44:44.831568] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:44:45.056271] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:44:45.490202] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-17T03:44:46.290191] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-17T03:44:46.622779] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T03:44:46.697115] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T03:44:47.090158] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-17T03:44:47.890152] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-17T03:44:48.302966] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T03:44:48.611158] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T03:44:48.690141] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-17T03:44:49.118394] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:44:49.490206] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-17T03:44:50.011075] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T03:44:50.227747] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T03:44:50.290144] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-17T03:44:51.090127] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-17T03:44:51.812343] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:44:51.890150] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-17T03:44:52.690134] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-17T03:44:53.101119] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T03:44:53.490174] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-17T03:44:53.666107] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:44:54.057408] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:44:54.290218] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-17T03:44:55.090112] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-17T03:44:55.330267] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T03:44:55.332944] [INFO ] [REMOTE ] FICO: Full fetch complete (27944 records). [2025-09-17T03:44:55.333045] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-17T03:44:55.763287] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-17T03:44:55.761700] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-17T03:44:55.763446] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-17T03:44:55.774230] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-17T03:44:55.774583] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-17T03:44:55.775855] [DEBUG] [LOCAL ] FICO: Trimmed 27944 records to 20354 (keeping 200 days of data) [2025-09-17T03:44:55.891437] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-17T03:44:55.907403] [DEBUG] [LOCAL ] FICO: Primary data saved (20354 records). [2025-09-17T03:44:55.907523] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-17T03:44:55.907612] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FICO took 20.2s. Estimated remaining: 3h 44m 51s. Rate: 6.9 symbols/min [2025-09-17T03:44:56.078115] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:56.078311] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-17T03:44:56.078362] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-17T03:44:56.078468] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-17T03:44:56.078513] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-17T03:44:56.078559] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-17T03:44:56.078604] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-17T03:44:56.439905] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:56.620537] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T03:44:56.690078] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-17T03:44:57.490157] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-17T03:44:57.656872] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T03:44:57.817974] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T03:44:57.822534] [INFO ] [REMOTE ] FHI: Full fetch complete (57483 records). [2025-09-17T03:44:57.822694] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-17T03:44:58.206744] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-17T03:44:58.206856] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-17T03:44:58.207620] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-17T03:44:58.207713] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-17T03:44:58.209284] [DEBUG] [LOCAL ] FHI: Trimmed 57483 records to 40817 (keeping 200 days of data) [2025-09-17T03:44:58.306263] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-11. [2025-09-17T03:44:58.465676] [DEBUG] [LOCAL ] FHI: Primary data saved (40817 records). [2025-09-17T03:44:58.465827] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-17T03:44:58.465938] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FHI took 41.1s. Estimated remaining: 3h 44m 31s. Rate: 6.9 symbols/min [2025-09-17T03:44:58.634678] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:58.674544] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T03:44:58.675346] [DEBUG] [LOCAL ] FIGS: Loaded 36336 existing records from primary storage. [2025-09-17T03:44:58.676768] [INFO ] [MAIN ] FIGS: Loaded 36336 existing records. [2025-09-17T03:44:58.853779] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:58.854046] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-17T03:44:58.854111] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-17T03:44:58.854936] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-17T03:44:58.855006] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-17T03:44:59.098546] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-17T03:44:59.222337] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:59.696928] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T03:44:59.890090] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-17T03:45:00.690181] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-17T03:45:00.895882] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T03:45:01.052408] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T03:45:01.490157] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-11. [2025-09-17T03:45:02.182825] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T03:45:02.290172] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-17T03:45:03.090150] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-17T03:45:03.890131] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-17T03:45:04.930142] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-17T03:45:04.931025] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-17T03:45:05.552872] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-11 (4.06 seconds). [2025-09-17T03:45:05.563065] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-17T03:45:05.622133] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T03:45:06.290186] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-17T03:45:06.335655] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (3.25 seconds). [2025-09-17T03:45:06.369699] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-17T03:45:06.376403] [INFO ] [REMOTE ] FI: Full fetch complete (76974 records). [2025-09-17T03:45:06.376621] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-17T03:45:06.647704] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T03:45:06.776178] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-17T03:45:06.776281] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-17T03:45:06.777168] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-17T03:45:06.777228] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-17T03:45:06.778698] [DEBUG] [LOCAL ] FI: Trimmed 76974 records to 53496 (keeping 200 days of data) [2025-09-17T03:45:07.095574] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-17T03:45:07.111816] [DEBUG] [LOCAL ] FI: Primary data saved (53496 records). [2025-09-17T03:45:07.111981] [INFO ] [MAIN ] FI: Full history saved. [2025-09-17T03:45:07.112092] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FI took 45.7s. Estimated remaining: 3h 44m 22s. Rate: 6.9 symbols/min [2025-09-17T03:45:07.282981] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:07.311882] [DEBUG] [LOCAL ] FIHL: Loaded 28860 existing records from primary storage. [2025-09-17T03:45:07.312052] [INFO ] [MAIN ] FIHL: Loaded 28860 existing records. [2025-09-17T03:45:07.492093] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:07.495371] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T03:45:07.495892] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-17T03:45:07.496045] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-17T03:45:07.497749] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-17T03:45:07.497870] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-17T03:45:07.795351] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T03:45:07.906084] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:07.901607] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-17T03:45:08.268029] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T03:45:08.690163] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-11. [2025-09-17T03:45:09.490148] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-17T03:45:10.064768] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T03:45:10.290185] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-17T03:45:10.523903] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:10.524247] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-17T03:45:11.090194] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-17T03:45:11.218467] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:45:11.436040] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T03:45:11.890188] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-17T03:45:12.690150] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-17T03:45:13.490136] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-17T03:45:14.132459] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:45:14.290102] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-17T03:45:14.566455] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-17T03:45:14.765276] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:45:14.771896] [INFO ] [REMOTE ] FHN: Full fetch complete (77098 records). [2025-09-17T03:45:14.772078] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-17T03:45:15.105962] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-17T03:45:15.166600] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-17T03:45:15.166804] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-17T03:45:15.168305] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-17T03:45:15.168431] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-17T03:45:15.170787] [DEBUG] [LOCAL ] FHN: Trimmed 77098 records to 53367 (keeping 200 days of data) [2025-09-17T03:45:15.524275] [DEBUG] [LOCAL ] FHN: Primary data saved (53367 records). [2025-09-17T03:45:15.524534] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-17T03:45:15.524690] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FHN took 56.3s. Estimated remaining: 3h 44m 13s. Rate: 6.9 symbols/min [2025-09-17T03:45:15.700716] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:15.721345] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:45:15.732293] [DEBUG] [LOCAL ] FINS: Loaded 6435 existing records from primary storage. [2025-09-17T03:45:15.732489] [INFO ] [MAIN ] FINS: Loaded 6435 existing records. [2025-09-17T03:45:15.895267] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-17T03:45:15.925750] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:15.926084] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-17T03:45:15.926164] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-17T03:45:15.926506] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-17T03:45:15.926568] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-17T03:45:16.289762] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:16.696213] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-17T03:45:16.701427] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T03:45:17.490137] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-11. [2025-09-17T03:45:18.066439] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:45:18.290129] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-17T03:45:18.377019] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T03:45:18.579407] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-17T03:45:18.585748] [INFO ] [REMOTE ] FIG: Full fetch complete (13090 records). [2025-09-17T03:45:18.585844] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-17T03:45:18.767252] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-17T03:45:18.767556] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:45:18.767611] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:45:18.767676] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-17T03:45:18.767742] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-17T03:45:18.767788] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-17T03:45:18.767853] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-17T03:45:18.767926] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FIG took 22.9s. Estimated remaining: 3h 43m 54s. Rate: 6.9 symbols/min [2025-09-17T03:45:18.936743] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:18.967810] [DEBUG] [LOCAL ] FINV: Loaded 33313 existing records from primary storage. [2025-09-17T03:45:18.967998] [INFO ] [MAIN ] FINV: Loaded 33313 existing records. [2025-09-17T03:45:19.099367] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-17T03:45:19.177196] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:19.177463] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-17T03:45:19.177537] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-17T03:45:19.178227] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-17T03:45:19.178293] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-17T03:45:19.532072] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:19.726982] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:45:19.890126] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-17T03:45:20.690132] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-17T03:45:20.900503] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T03:45:21.350245] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T03:45:21.438178] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:45:21.490142] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-17T03:45:22.290132] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-17T03:45:23.090138] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-11. [2025-09-17T03:45:23.852381] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T03:45:23.890099] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-17T03:45:23.962165] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:45:24.690142] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-17T03:45:24.877447] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T03:45:25.415131] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T03:45:25.490129] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-17T03:45:25.547010] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T03:45:26.108287] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T03:45:26.290193] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-17T03:45:27.090283] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-17T03:45:27.873042] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T03:45:27.890149] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-17T03:45:27.930943] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:45:28.690176] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-17T03:45:29.362394] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T03:45:29.490160] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-17T03:45:30.170978] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:45:30.290123] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-17T03:45:31.029937] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:45:31.090089] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-17T03:45:31.146622] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:45:31.890168] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-17T03:45:32.547122] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:45:32.690166] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-17T03:45:32.710416] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:45:33.490168] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-17T03:45:34.184038] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:45:34.290183] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-17T03:45:34.297627] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T03:45:35.090153] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-17T03:45:35.881152] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:45:35.890468] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-17T03:45:36.613528] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T03:45:36.690209] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-17T03:45:36.795387] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:45:37.490187] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-17T03:45:38.294318] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-17T03:45:38.299123] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T03:45:39.090161] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-17T03:45:39.208579] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:45:39.890189] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-17T03:45:39.921833] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:45:40.439293] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T03:45:40.444925] [INFO ] [REMOTE ] FIHL: Full fetch complete (55402 records). [2025-09-17T03:45:40.445107] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-17T03:45:40.695173] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-17T03:45:40.860253] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-17T03:45:40.860372] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-17T03:45:40.861200] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-17T03:45:40.861263] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-17T03:45:40.862517] [DEBUG] [LOCAL ] FIHL: Trimmed 55402 records to 40510 (keeping 200 days of data) [2025-09-17T03:45:41.123578] [DEBUG] [LOCAL ] FIHL: Primary data saved (40510 records). [2025-09-17T03:45:41.123759] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-17T03:45:41.123872] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FIHL took 34.0s. Estimated remaining: 3h 44m 10s. Rate: 6.9 symbols/min [2025-09-17T03:45:41.308691] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:41.349235] [DEBUG] [LOCAL ] FIS: Loaded 39736 existing records from primary storage. [2025-09-17T03:45:41.349446] [INFO ] [MAIN ] FIS: Loaded 39736 existing records. [2025-09-17T03:45:41.485667] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:45:41.490943] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-17T03:45:41.537796] [INFO ] [REMOTE ] FINS: Full fetch complete (12903 records). [2025-09-17T03:45:41.560725] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-17T03:45:41.560615] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:41.589496] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-17T03:45:41.615365] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-17T03:45:41.627061] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-17T03:45:41.651190] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-17T03:45:41.738543] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T03:45:41.871719] [INFO ] [REMOTE ] FIGS: Full fetch complete (71051 records). [2025-09-17T03:45:42.000763] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-17T03:45:42.490477] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-17T03:45:42.546637] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:42.560515] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-17T03:45:42.631412] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-17T03:45:42.636966] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-11. [2025-09-17T03:45:42.661363] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-17T03:45:42.675301] [DEBUG] [LOCAL ] FINS: Trimmed 12903 records to 8211 (keeping 200 days of data) [2025-09-17T03:45:42.818287] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-17T03:45:42.823421] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-17T03:45:42.826986] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-17T03:45:42.830494] [DEBUG] [LOCAL ] FINS: Primary data saved (8211 records). [2025-09-17T03:45:42.830656] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-17T03:45:42.830711] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-17T03:45:42.831040] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FINS took 27.3s. Estimated remaining: 3h 43m 49s. Rate: 6.9 symbols/min [2025-09-17T03:45:42.938873] [DEBUG] [LOCAL ] FIGS: Trimmed 71051 records to 49138 (keeping 200 days of data) [2025-09-17T03:45:43.096211] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:43.128514] [DEBUG] [LOCAL ] FIX: Loaded 21252 existing records from primary storage. [2025-09-17T03:45:43.130534] [INFO ] [MAIN ] FIX: Loaded 21252 existing records. [2025-09-17T03:45:43.336207] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:43.338981] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-17T03:45:43.339075] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-17T03:45:43.341933] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-17T03:45:43.345708] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-17T03:45:43.848626] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:43.856489] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-11. [2025-09-17T03:45:43.875716] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T03:45:43.913925] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-17T03:45:43.949170] [DEBUG] [LOCAL ] FIGS: Primary data saved (49138 records). [2025-09-17T03:45:43.949329] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-17T03:45:43.949479] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FIGS took 45.5s. Estimated remaining: 3h 43m 26s. Rate: 6.9 symbols/min [2025-09-17T03:45:44.125544] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:44.125823] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-17T03:45:44.125876] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-17T03:45:44.125985] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-17T03:45:44.126036] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-17T03:45:44.126083] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-17T03:45:44.126124] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-17T03:45:44.507877] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:44.540321] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T03:45:44.690126] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-17T03:45:45.369156] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T03:45:45.456967] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T03:45:45.490152] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-17T03:45:46.290173] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-17T03:45:46.619162] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T03:45:47.052140] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:45:47.090069] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-17T03:45:47.324576] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T03:45:47.890131] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-11. [2025-09-17T03:45:48.103610] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:48.104029] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-11 [2025-09-17T03:45:48.690131] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-17T03:45:48.824665] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T03:45:49.490153] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-17T03:45:49.710360] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:49.710715] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-17T03:45:50.290138] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-17T03:45:50.412437] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T03:45:50.508113] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:50.508434] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-17T03:45:51.090146] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-17T03:45:51.890193] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-17T03:45:52.096093] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:52.096451] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-17T03:45:52.690155] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-17T03:45:52.892942] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:45:53.490189] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-17T03:45:54.290194] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-17T03:45:54.518317] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T03:45:55.090173] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-17T03:45:55.438921] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T03:45:55.865091] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T03:45:55.890105] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-17T03:45:56.107079] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:56.107321] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-17T03:45:56.367902] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:45:56.374787] [INFO ] [REMOTE ] FINV: Full fetch complete (63345 records). [2025-09-17T03:45:56.374932] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-17T03:45:56.695375] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-17T03:45:56.764124] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-17T03:45:56.764235] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-17T03:45:56.765190] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-17T03:45:56.765321] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-17T03:45:56.766931] [DEBUG] [LOCAL ] FINV: Trimmed 63345 records to 44869 (keeping 200 days of data) [2025-09-17T03:45:57.032766] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:57.034146] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-17T03:45:57.038516] [DEBUG] [LOCAL ] FINV: Primary data saved (44869 records). [2025-09-17T03:45:57.038596] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-17T03:45:57.038725] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FINV took 38.3s. Estimated remaining: 3h 43m 25s. Rate: 6.9 symbols/min [2025-09-17T03:45:57.216481] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:57.224136] [DEBUG] [LOCAL ] FLC: Loaded 3942 existing records from primary storage. [2025-09-17T03:45:57.224292] [INFO ] [MAIN ] FLC: Loaded 3942 existing records. [2025-09-17T03:45:57.406011] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:57.406261] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-17T03:45:57.406322] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-17T03:45:57.406559] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-17T03:45:57.406627] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-17T03:45:57.495292] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-17T03:45:57.771148] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:58.290146] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-17T03:45:58.512116] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:58.512466] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-17T03:45:59.090181] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-11. [2025-09-17T03:45:59.457285] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T03:45:59.814282] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T03:45:59.890151] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-17T03:46:00.690170] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-17T03:46:01.490132] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-17T03:46:01.767899] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T03:46:02.057419] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T03:46:02.295532] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-17T03:46:02.310713] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T03:46:03.031937] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T03:46:03.090168] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-17T03:46:03.694500] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:46:03.890124] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-17T03:46:04.350354] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T03:46:04.690162] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-17T03:46:05.173671] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T03:46:05.174921] [INFO ] [REMOTE ] FIXT: Full fetch complete (1654 records). [2025-09-17T03:46:05.175020] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-17T03:46:05.372225] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 64 unique days, need 200 days [2025-09-17T03:46:05.372467] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:46:05.372531] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:46:05.372598] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-17T03:46:05.372698] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-17T03:46:05.372755] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-17T03:46:05.372811] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-17T03:46:05.372900] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 21.4s. Estimated remaining: 3h 43m 15s. Rate: 6.9 symbols/min [2025-09-17T03:46:05.490167] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-17T03:46:06.118134] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T03:46:06.290147] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-17T03:46:07.090136] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-17T03:46:07.890160] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-17T03:46:08.034549] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T03:46:08.505261] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T03:46:08.690173] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-17T03:46:08.784616] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T03:46:09.490201] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-17T03:46:10.146735] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:46:10.290170] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-17T03:46:10.648038] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T03:46:11.090132] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-17T03:46:11.835813] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T03:46:11.890115] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-17T03:46:11.942699] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:46:12.547842] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:46:12.690178] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-17T03:46:13.324504] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:46:13.490132] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-17T03:46:14.290202] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-17T03:46:14.982317] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T03:46:15.090164] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-17T03:46:15.271870] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T03:46:15.890179] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-17T03:46:16.558759] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T03:46:16.570249] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T03:46:16.690125] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-17T03:46:17.490117] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-17T03:46:17.950892] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:46:18.290159] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-17T03:46:19.090182] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-17T03:46:19.166842] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T03:46:19.181995] [INFO ] [REMOTE ] FIS: Full fetch complete (76998 records). [2025-09-17T03:46:19.183068] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-17T03:46:19.634302] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:46:19.714134] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T03:46:19.718310] [INFO ] [REMOTE ] FLC: Full fetch complete (8178 records). [2025-09-17T03:46:19.738106] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-17T03:46:19.898221] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-17T03:46:19.994427] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-17T03:46:19.994635] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-17T03:46:19.996026] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-17T03:46:20.017303] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-17T03:46:20.113202] [DEBUG] [LOCAL ] FIS: Trimmed 76998 records to 53373 (keeping 200 days of data) [2025-09-17T03:46:20.413392] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-17T03:46:20.414728] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-17T03:46:20.416043] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-17T03:46:20.416551] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-17T03:46:20.418840] [DEBUG] [LOCAL ] FLC: Trimmed 8178 records to 5733 (keeping 200 days of data) [2025-09-17T03:46:20.466816] [DEBUG] [LOCAL ] FLC: Primary data saved (5733 records). [2025-09-17T03:46:20.468162] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-17T03:46:20.468750] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FLC took 23.4s. Estimated remaining: 3h 43m 18s. Rate: 6.9 symbols/min [2025-09-17T03:46:20.693801] [DEBUG] [LOCAL ] FIS: Primary data saved (53373 records). [2025-09-17T03:46:20.693989] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-17T03:46:20.694142] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FIS took 39.6s. Estimated remaining: 3h 42m 54s. Rate: 6.9 symbols/min [2025-09-17T03:46:21.303115] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T03:46:21.309737] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-17T03:46:22.591505] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:46:22.596580] [INFO ] [REMOTE ] FIX: Full fetch complete (45740 records). [2025-09-17T03:46:22.596713] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-17T03:46:22.981363] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-17T03:46:22.981505] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-17T03:46:22.982267] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-17T03:46:22.982334] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-17T03:46:22.983795] [DEBUG] [LOCAL ] FIX: Trimmed 45740 records to 31072 (keeping 200 days of data) [2025-09-17T03:46:23.194125] [DEBUG] [LOCAL ] FIX: Primary data saved (31072 records). [2025-09-17T03:46:23.194301] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-17T03:46:23.194421] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIX took 40.4s. Estimated remaining: 3h 42m 34s. Rate: 6.9 symbols/min [2025-09-17T03:46:23.740441] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.799623] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.875521] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.897349] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.935623] [DEBUG] [LOCAL ] FLNG: Loaded 25121 existing records from primary storage. [2025-09-17T03:46:23.944518] [INFO ] [MAIN ] FLNG: Loaded 25121 existing records. [2025-09-17T03:46:23.945451] [DEBUG] [LOCAL ] FLOC: Loaded 20716 existing records from primary storage. [2025-09-17T03:46:23.967863] [INFO ] [MAIN ] FLOC: Loaded 20716 existing records. [2025-09-17T03:46:24.014909] [DEBUG] [LOCAL ] FLO: Loaded 38799 existing records from primary storage. [2025-09-17T03:46:24.058658] [INFO ] [MAIN ] FLO: Loaded 38799 existing records. [2025-09-17T03:46:24.319253] [DEBUG] [LOCAL ] FLG: Loaded 39734 existing records from primary storage. [2025-09-17T03:46:24.428265] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:24.457400] [INFO ] [MAIN ] FLG: Loaded 39734 existing records. [2025-09-17T03:46:24.457449] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-17T03:46:24.460272] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:24.465600] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-17T03:46:24.525198] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-17T03:46:24.563729] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-09-17T03:46:24.570940] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-17T03:46:24.600843] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:24.600888] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-17T03:46:24.627723] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-17T03:46:24.606790] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-17T03:46:24.654122] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-17T03:46:24.653995] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-17T03:46:24.741838] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-17T03:46:24.788876] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-17T03:46:24.955597] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:25.086342] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-17T03:46:25.086467] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-17T03:46:25.140458] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-17T03:46:25.211592] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-17T03:46:25.704088] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:25.768769] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-11. [2025-09-17T03:46:26.102128] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:26.143668] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:46:26.180001] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-11. [2025-09-17T03:46:26.179683] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-11 [2025-09-17T03:46:26.179054] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:26.196840] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-11. [2025-09-17T03:46:26.232239] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-17T03:46:26.266074] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:26.267827] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-11. [2025-09-17T03:46:26.501259] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:46:26.501604] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-17T03:46:26.502045] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-17T03:46:27.644986] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T03:46:27.649757] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-17T03:46:27.689912] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T03:46:27.697354] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-17T03:46:27.816562] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T03:46:27.890131] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-17T03:46:28.157309] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T03:46:28.573935] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T03:46:28.690102] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-17T03:46:28.851139] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:46:29.339787] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T03:46:29.490096] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-17T03:46:30.080908] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T03:46:30.290159] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-17T03:46:31.090174] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-17T03:46:31.468377] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T03:46:31.496490] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T03:46:31.890153] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-17T03:46:32.562596] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T03:46:32.690127] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-17T03:46:33.229912] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T03:46:33.490112] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-17T03:46:34.290269] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-17T03:46:34.526810] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T03:46:35.090150] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-17T03:46:35.274596] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T03:46:35.830064] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:46:35.890133] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-17T03:46:36.010068] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:46:36.690179] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-17T03:46:37.490142] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-17T03:46:37.647842] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:46:38.242402] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T03:46:38.290089] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-17T03:46:39.090176] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-17T03:46:39.359005] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T03:46:39.705388] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T03:46:39.890134] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-17T03:46:40.538607] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:46:40.690149] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-17T03:46:41.490133] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-17T03:46:41.856445] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:46:41.884485] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T03:46:42.290159] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-17T03:46:42.807334] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T03:46:43.090138] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-17T03:46:43.890171] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-17T03:46:44.226211] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:46:44.500386] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T03:46:44.690201] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-17T03:46:45.270774] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:46:45.490176] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-17T03:46:45.889775] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:46:46.290190] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-17T03:46:47.090112] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-17T03:46:47.132324] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T03:46:47.890134] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-17T03:46:48.016553] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:46:48.566994] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T03:46:48.690111] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-17T03:46:48.940391] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T03:46:48.943939] [INFO ] [REMOTE ] FLOC: Full fetch complete (36154 records). [2025-09-17T03:46:48.944066] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-17T03:46:49.141520] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-17T03:46:49.143755] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:46:49.143972] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:46:49.144030] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-17T03:46:49.144132] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-17T03:46:49.144183] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-17T03:46:49.144514] [DEBUG] [LOCAL ] FLOC: Deleted derivative data file. [2025-09-17T03:46:49.144678] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLOC took 25.9s. Estimated remaining: 3h 42m 57s. Rate: 6.9 symbols/min [2025-09-17T03:46:49.317939] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:49.358069] [DEBUG] [LOCAL ] FLR: Loaded 39691 existing records from primary storage. [2025-09-17T03:46:49.358257] [INFO ] [MAIN ] FLR: Loaded 39691 existing records. [2025-09-17T03:46:49.502782] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-17T03:46:49.543244] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:49.544037] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-17T03:46:49.544100] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-17T03:46:49.544998] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-17T03:46:49.545064] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-17T03:46:49.902721] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:50.104237] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T03:46:50.109701] [INFO ] [REMOTE ] FLNG: Full fetch complete (50843 records). [2025-09-17T03:46:50.109831] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-17T03:46:50.294607] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-17T03:46:50.497725] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-17T03:46:50.497843] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-17T03:46:50.498567] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-17T03:46:50.498658] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-17T03:46:50.499820] [DEBUG] [LOCAL ] FLNG: Trimmed 50843 records to 34281 (keeping 200 days of data) [2025-09-17T03:46:50.711809] [DEBUG] [LOCAL ] FLNG: Primary data saved (34281 records). [2025-09-17T03:46:50.712000] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-17T03:46:50.712130] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLNG took 27.5s. Estimated remaining: 3h 42m 35s. Rate: 6.9 symbols/min [2025-09-17T03:46:50.882026] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:50.916540] [DEBUG] [LOCAL ] FLS: Loaded 37213 existing records from primary storage. [2025-09-17T03:46:50.916742] [INFO ] [MAIN ] FLS: Loaded 37213 existing records. [2025-09-17T03:46:51.097719] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-11. [2025-09-17T03:46:51.128752] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:51.128918] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-17T03:46:51.128978] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-17T03:46:51.129888] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-17T03:46:51.129954] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-17T03:46:51.510692] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:51.545942] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T03:46:51.890122] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-11. [2025-09-17T03:46:52.245722] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T03:46:52.674106] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:46:52.690073] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-17T03:46:53.490138] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-17T03:46:53.651173] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T03:46:54.099820] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:46:54.290150] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-17T03:46:54.999262] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:46:55.090134] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-17T03:46:55.890112] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-17T03:46:55.974946] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:46:56.690138] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-17T03:46:56.852944] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:46:57.262565] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T03:46:57.490147] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-17T03:46:58.290132] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-17T03:46:58.380668] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T03:46:59.090155] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-17T03:46:59.224578] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T03:46:59.233013] [INFO ] [REMOTE ] FLG: Full fetch complete (77150 records). [2025-09-17T03:46:59.233292] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-17T03:46:59.657141] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-17T03:46:59.657306] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-17T03:46:59.658613] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-17T03:46:59.658715] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-17T03:46:59.660891] [DEBUG] [LOCAL ] FLG: Trimmed 77150 records to 53342 (keeping 200 days of data) [2025-09-17T03:46:59.900674] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-17T03:47:00.040535] [DEBUG] [LOCAL ] FLG: Primary data saved (53342 records). [2025-09-17T03:47:00.041104] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-17T03:47:00.041336] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLG took 36.8s. Estimated remaining: 3h 42m 27s. Rate: 6.9 symbols/min [2025-09-17T03:47:00.228728] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:00.264363] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T03:47:00.318926] [DEBUG] [LOCAL ] FLUT: Loaded 37703 existing records from primary storage. [2025-09-17T03:47:00.319350] [INFO ] [MAIN ] FLUT: Loaded 37703 existing records. [2025-09-17T03:47:00.502026] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:00.502413] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-17T03:47:00.502481] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-17T03:47:00.503580] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-17T03:47:00.503728] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-17T03:47:00.721466] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-17T03:47:00.881629] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:01.016502] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T03:47:01.490165] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-11. [2025-09-17T03:47:01.576362] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:47:02.290193] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-17T03:47:02.659704] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T03:47:03.097510] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-17T03:47:03.123389] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:47:03.890127] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-17T03:47:04.163930] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T03:47:04.690165] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-17T03:47:04.958586] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:47:05.490147] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-17T03:47:05.694168] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:47:06.290145] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-17T03:47:06.436779] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:47:06.443723] [INFO ] [REMOTE ] FLO: Full fetch complete (74552 records). [2025-09-17T03:47:06.443919] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-17T03:47:06.855987] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-17T03:47:06.856146] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-17T03:47:06.857236] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-17T03:47:06.857356] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-17T03:47:06.859069] [DEBUG] [LOCAL ] FLO: Trimmed 74552 records to 51831 (keeping 200 days of data) [2025-09-17T03:47:07.090404] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-17T03:47:07.199819] [DEBUG] [LOCAL ] FLO: Primary data saved (51831 records). [2025-09-17T03:47:07.200000] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-17T03:47:07.200122] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLO took 44.0s. Estimated remaining: 3h 42m 15s. Rate: 6.9 symbols/min [2025-09-17T03:47:07.372089] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:07.388073] [DEBUG] [LOCAL ] FLXR: Loaded 15343 existing records from primary storage. [2025-09-17T03:47:07.388219] [INFO ] [MAIN ] FLXR: Loaded 15343 existing records. [2025-09-17T03:47:07.571997] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:07.572326] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-17T03:47:07.572468] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-17T03:47:07.583765] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-17T03:47:07.606473] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-17T03:47:07.692063] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T03:47:07.895231] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-17T03:47:07.984848] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:08.106755] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:47:08.683496] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:47:08.692359] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-11. [2025-09-17T03:47:09.416834] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T03:47:09.490180] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-17T03:47:09.558302] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:47:10.290184] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-17T03:47:11.063481] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T03:47:11.090213] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-17T03:47:11.319568] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T03:47:11.596457] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T03:47:11.890210] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-17T03:47:12.690188] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-17T03:47:13.490142] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-17T03:47:13.723582] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T03:47:14.290157] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-17T03:47:14.800115] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T03:47:15.090137] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-17T03:47:15.132540] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:47:15.890170] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-17T03:47:16.016322] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:47:16.690154] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-17T03:47:16.714601] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T03:47:17.157545] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T03:47:17.490136] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-17T03:47:18.290176] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-17T03:47:18.496554] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:47:18.517593] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T03:47:19.090135] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-17T03:47:19.890138] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-17T03:47:20.292698] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T03:47:20.434633] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:47:20.690105] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-17T03:47:20.911570] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T03:47:21.490190] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-17T03:47:22.290105] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-17T03:47:22.561218] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:47:22.625129] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:47:23.090153] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-17T03:47:23.890135] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-17T03:47:24.052436] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:47:24.662679] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:47:24.669408] [INFO ] [REMOTE ] FLR: Full fetch complete (76027 records). [2025-09-17T03:47:24.669577] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-17T03:47:24.695204] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-17T03:47:25.110717] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-17T03:47:25.121912] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-17T03:47:25.123955] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T03:47:25.123386] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-17T03:47:25.128336] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-17T03:47:25.129876] [DEBUG] [LOCAL ] FLR: Trimmed 76027 records to 53122 (keeping 200 days of data) [2025-09-17T03:47:25.467096] [DEBUG] [LOCAL ] FLR: Primary data saved (53122 records). [2025-09-17T03:47:25.467322] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-17T03:47:25.467455] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLR took 36.3s. Estimated remaining: 3h 42m 24s. Rate: 6.9 symbols/min [2025-09-17T03:47:25.499159] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-17T03:47:25.643056] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:25.643295] [DEBUG] [LOCAL ] FMC: No existing data file found in primary storage. [2025-09-17T03:47:25.643361] [WARN ] [MAIN ] FMC: No existing data found, performing full refresh instead. [2025-09-17T03:47:25.643523] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-17T03:47:25.643592] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-17T03:47:25.643684] [DEBUG] [LOCAL ] FMC: No primary data file found to delete. [2025-09-17T03:47:25.643733] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-17T03:47:26.001205] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:26.290155] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-17T03:47:26.570752] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T03:47:26.752218] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T03:47:27.090154] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-11. [2025-09-17T03:47:27.859354] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:47:27.865795] [INFO ] [REMOTE ] FLS: Full fetch complete (70917 records). [2025-09-17T03:47:27.865966] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-17T03:47:27.897590] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-17T03:47:28.287542] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-17T03:47:28.287690] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-17T03:47:28.288691] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-17T03:47:28.288767] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-17T03:47:28.290410] [DEBUG] [LOCAL ] FLS: Trimmed 70917 records to 50083 (keeping 200 days of data) [2025-09-17T03:47:28.605364] [DEBUG] [LOCAL ] FLS: Primary data saved (50083 records). [2025-09-17T03:47:28.605536] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-17T03:47:28.605671] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLS took 37.9s. Estimated remaining: 3h 42m 5s. Rate: 6.9 symbols/min [2025-09-17T03:47:28.702298] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-17T03:47:28.791250] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:28.797715] [DEBUG] [LOCAL ] FMN: Loaded 3836 existing records from primary storage. [2025-09-17T03:47:28.797850] [INFO ] [MAIN ] FMN: Loaded 3836 existing records. [2025-09-17T03:47:28.993237] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:28.993707] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-17T03:47:28.993821] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-17T03:47:28.994141] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-17T03:47:28.994277] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-17T03:47:29.138985] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T03:47:29.420012] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:29.490076] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-11. [2025-09-17T03:47:29.817861] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T03:47:29.930932] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T03:47:30.278396] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T03:47:30.290071] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-17T03:47:31.022140] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T03:47:31.090106] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-17T03:47:31.890179] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-17T03:47:31.912723] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T03:47:32.690145] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-17T03:47:33.490114] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-17T03:47:33.944040] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T03:47:33.965829] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:47:33.974597] [INFO ] [REMOTE ] FLXR: Full fetch complete (24040 records). [2025-09-17T03:47:33.975290] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T03:47:33.975385] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-17T03:47:34.300403] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-17T03:47:34.344130] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-17T03:47:34.344216] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-17T03:47:34.344760] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-17T03:47:34.344829] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-17T03:47:34.345492] [DEBUG] [LOCAL ] FLXR: Trimmed 24040 records to 19502 (keeping 200 days of data) [2025-09-17T03:47:34.470479] [DEBUG] [LOCAL ] FLXR: Primary data saved (19502 records). [2025-09-17T03:47:34.470687] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-17T03:47:34.470811] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLXR took 27.3s. Estimated remaining: 3h 41m 51s. Rate: 6.9 symbols/min [2025-09-17T03:47:34.645441] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:34.666928] [DEBUG] [LOCAL ] FMS: Loaded 22350 existing records from primary storage. [2025-09-17T03:47:34.667111] [INFO ] [MAIN ] FMS: Loaded 22350 existing records. [2025-09-17T03:47:34.853300] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:34.853634] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-17T03:47:34.853772] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-17T03:47:34.854324] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-17T03:47:34.854412] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-17T03:47:35.100406] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-17T03:47:35.229973] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:35.890129] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-17T03:47:36.008466] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T03:47:36.340373] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T03:47:36.690157] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-17T03:47:37.444907] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T03:47:37.490079] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-17T03:47:37.677463] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T03:47:38.130317] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T03:47:38.290134] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-11. [2025-09-17T03:47:39.090133] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-17T03:47:39.447071] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T03:47:39.890127] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-17T03:47:40.690151] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-17T03:47:40.913431] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:47:41.490088] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-17T03:47:41.563444] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T03:47:41.570010] [INFO ] [REMOTE ] FLUT: Full fetch complete (72587 records). [2025-09-17T03:47:41.570178] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-17T03:47:41.972102] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-17T03:47:41.972337] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-17T03:47:41.973699] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-17T03:47:41.973830] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-17T03:47:41.990775] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T03:47:41.993200] [DEBUG] [LOCAL ] FLUT: Trimmed 72587 records to 51062 (keeping 200 days of data) [2025-09-17T03:47:42.295355] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-17T03:47:42.335414] [DEBUG] [LOCAL ] FLUT: Primary data saved (51062 records). [2025-09-17T03:47:42.335601] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-17T03:47:42.335723] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLUT took 42.3s. Estimated remaining: 3h 41m 41s. Rate: 6.9 symbols/min [2025-09-17T03:47:42.505071] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:42.505287] [DEBUG] [LOCAL ] FMX: No existing data file found in primary storage. [2025-09-17T03:47:42.505341] [WARN ] [MAIN ] FMX: No existing data found, performing full refresh instead. [2025-09-17T03:47:42.505454] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-17T03:47:42.505512] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-17T03:47:42.505558] [DEBUG] [LOCAL ] FMX: No primary data file found to delete. [2025-09-17T03:47:42.505603] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-17T03:47:42.856286] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:42.923508] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:47:43.090144] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-11. [2025-09-17T03:47:43.253703] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:47:43.890214] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-17T03:47:44.412007] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:47:44.690177] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-17T03:47:45.424229] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T03:47:45.490125] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-17T03:47:45.771218] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T03:47:46.220213] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T03:47:46.290102] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-17T03:47:47.090203] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-17T03:47:47.658823] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T03:47:47.890198] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-17T03:47:48.246802] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T03:47:48.529083] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:47:48.530354] [INFO ] [REMOTE ] FMN: Full fetch complete (10257 records). [2025-09-17T03:47:48.530447] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-17T03:47:48.694668] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-17T03:47:48.892837] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-17T03:47:48.892941] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-17T03:47:48.893191] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-17T03:47:48.893245] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-17T03:47:48.893721] [DEBUG] [LOCAL ] FMN: Trimmed 10257 records to 6157 (keeping 200 days of data) [2025-09-17T03:47:48.934089] [DEBUG] [LOCAL ] FMN: Primary data saved (6157 records). [2025-09-17T03:47:48.934258] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-17T03:47:48.934356] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FMN took 20.3s. Estimated remaining: 3h 41m 28s. Rate: 6.9 symbols/min [2025-09-17T03:47:49.105860] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:49.108777] [DEBUG] [LOCAL ] FMY: Loaded 1027 existing records from primary storage. [2025-09-17T03:47:49.108864] [INFO ] [MAIN ] FMY: Loaded 1027 existing records. [2025-09-17T03:47:49.291598] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:49.291926] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-17T03:47:49.291985] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-17T03:47:49.292177] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-17T03:47:49.292234] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-17T03:47:49.495504] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-17T03:47:49.657229] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:50.290129] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-11. [2025-09-17T03:47:50.714311] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T03:47:50.781726] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T03:47:51.090143] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-17T03:47:51.133805] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T03:47:51.890141] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-17T03:47:52.690152] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-17T03:47:52.914925] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:47:53.056185] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T03:47:53.073353] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T03:47:53.490136] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-17T03:47:53.918781] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T03:47:54.290180] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-17T03:47:55.090145] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-17T03:47:55.708512] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T03:47:55.890141] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-17T03:47:56.690174] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-17T03:47:56.906386] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T03:47:56.938033] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T03:47:57.141610] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T03:47:57.490155] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-17T03:47:58.290140] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-17T03:47:59.090138] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-17T03:47:59.329894] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:47:59.385030] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T03:47:59.744924] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:47:59.890139] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-17T03:48:00.690132] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-17T03:48:01.416412] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:48:01.490137] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-17T03:48:02.290202] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-17T03:48:02.945466] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T03:48:02.984687] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T03:48:03.090148] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-17T03:48:03.638612] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T03:48:03.890156] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-17T03:48:04.690400] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-17T03:48:05.175385] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T03:48:05.490180] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-17T03:48:05.596461] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T03:48:05.603673] [INFO ] [REMOTE ] FMC: Full fetch complete (74616 records). [2025-09-17T03:48:05.603887] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-17T03:48:05.948847] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (3.66 seconds). [2025-09-17T03:48:05.952213] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T03:48:06.059945] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-17T03:48:06.060063] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-17T03:48:06.060994] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-17T03:48:06.061056] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-17T03:48:06.062680] [DEBUG] [LOCAL ] FMC: Trimmed 74616 records to 51840 (keeping 200 days of data) [2025-09-17T03:48:06.290171] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-17T03:48:06.388779] [DEBUG] [LOCAL ] FMC: Primary data saved (51840 records). [2025-09-17T03:48:06.389026] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-17T03:48:06.389139] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMC took 40.9s. Estimated remaining: 3h 41m 35s. Rate: 6.9 symbols/min [2025-09-17T03:48:06.571256] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:06.604001] [DEBUG] [LOCAL ] FN: Loaded 28485 existing records from primary storage. [2025-09-17T03:48:06.604248] [INFO ] [MAIN ] FN: Loaded 28485 existing records. [2025-09-17T03:48:06.803451] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:06.803842] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-17T03:48:06.803913] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-17T03:48:06.804834] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-17T03:48:06.804902] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-17T03:48:07.095369] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-17T03:48:07.201296] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:07.594601] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T03:48:07.616202] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T03:48:07.890215] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-11. [2025-09-17T03:48:08.690359] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-17T03:48:09.081697] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:48:09.082479] [INFO ] [REMOTE ] FMY: Full fetch complete (1905 records). [2025-09-17T03:48:09.082562] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-17T03:48:09.463141] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-17T03:48:09.463459] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-17T03:48:09.463900] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-17T03:48:09.464070] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-17T03:48:09.464959] [DEBUG] [LOCAL ] FMY: Trimmed 1905 records to 1347 (keeping 200 days of data) [2025-09-17T03:48:09.474532] [DEBUG] [LOCAL ] FMY: Primary data saved (1347 records). [2025-09-17T03:48:09.474736] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-17T03:48:09.474850] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMY took 20.5s. Estimated remaining: 3h 41m 16s. Rate: 6.9 symbols/min [2025-09-17T03:48:09.495330] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-17T03:48:09.586064] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:48:09.706694] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:09.744702] [DEBUG] [LOCAL ] FNB: Loaded 38986 existing records from primary storage. [2025-09-17T03:48:09.744906] [INFO ] [MAIN ] FNB: Loaded 38986 existing records. [2025-09-17T03:48:09.934216] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:09.934540] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-17T03:48:09.934604] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-17T03:48:09.935670] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-17T03:48:09.935749] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-17T03:48:10.305582] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-17T03:48:10.311362] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:10.866688] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T03:48:11.090124] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-17T03:48:11.749407] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:48:11.890160] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-17T03:48:12.311741] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:48:12.690152] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-17T03:48:13.490108] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-11. [2025-09-17T03:48:13.577923] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:48:14.290954] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-17T03:48:14.295454] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T03:48:15.090145] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-17T03:48:15.244683] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:48:15.890096] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-17T03:48:16.058177] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T03:48:16.690132] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-17T03:48:16.984410] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T03:48:17.490146] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-17T03:48:18.291041] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-17T03:48:18.296788] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-17T03:48:18.624139] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T03:48:18.782955] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T03:48:18.787217] [INFO ] [REMOTE ] FMS: Full fetch complete (42336 records). [2025-09-17T03:48:18.787326] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-17T03:48:19.095239] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-17T03:48:19.166283] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-17T03:48:19.166390] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-17T03:48:19.167175] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-17T03:48:19.167257] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-17T03:48:19.168311] [DEBUG] [LOCAL ] FMS: Trimmed 42336 records to 30564 (keeping 200 days of data) [2025-09-17T03:48:19.355060] [DEBUG] [LOCAL ] FMS: Primary data saved (30564 records). [2025-09-17T03:48:19.355228] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-17T03:48:19.355333] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMS took 44.9s. Estimated remaining: 3h 41m 9s. Rate: 6.9 symbols/min [2025-09-17T03:48:19.526141] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:19.565324] [DEBUG] [LOCAL ] FND: Loaded 38807 existing records from primary storage. [2025-09-17T03:48:19.565496] [INFO ] [MAIN ] FND: Loaded 38807 existing records. [2025-09-17T03:48:19.752092] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:19.752418] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-17T03:48:19.752601] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-17T03:48:19.753552] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-17T03:48:19.753618] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-17T03:48:19.908234] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-17T03:48:20.144859] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T03:48:20.149372] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:20.698286] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-11. [2025-09-17T03:48:20.704178] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:48:21.495219] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-17T03:48:21.514325] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T03:48:22.290155] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-17T03:48:22.457927] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T03:48:22.575720] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T03:48:23.090148] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-17T03:48:23.890145] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-17T03:48:24.012441] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T03:48:24.522129] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:48:24.528352] [INFO ] [REMOTE ] FMX: Full fetch complete (57482 records). [2025-09-17T03:48:24.528496] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-17T03:48:24.704140] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-17T03:48:24.932168] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-17T03:48:24.932332] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-17T03:48:24.933485] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-17T03:48:24.933560] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-17T03:48:24.937160] [DEBUG] [LOCAL ] FMX: Trimmed 57482 records to 40671 (keeping 200 days of data) [2025-09-17T03:48:25.195831] [DEBUG] [LOCAL ] FMX: Primary data saved (40671 records). [2025-09-17T03:48:25.195984] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-17T03:48:25.196070] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMX took 42.9s. Estimated remaining: 3h 40m 55s. Rate: 6.9 symbols/min [2025-09-17T03:48:25.366747] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:25.406872] [DEBUG] [LOCAL ] FNF: Loaded 36510 existing records from primary storage. [2025-09-17T03:48:25.407045] [INFO ] [MAIN ] FNF: Loaded 36510 existing records. [2025-09-17T03:48:25.500062] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-17T03:48:25.596283] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:25.596593] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-17T03:48:25.596744] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-17T03:48:25.598020] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-17T03:48:25.598205] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-17T03:48:25.836456] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T03:48:25.997953] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:26.290167] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-17T03:48:26.445676] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:48:27.090146] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-17T03:48:27.128221] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:48:27.890108] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-11. [2025-09-17T03:48:27.965250] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:48:28.690176] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-17T03:48:28.863420] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:48:29.490191] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-17T03:48:29.639630] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:48:30.097890] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:48:30.290127] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-17T03:48:31.090148] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-17T03:48:31.275998] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:48:31.890153] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-17T03:48:32.188698] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:48:32.524886] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:48:32.690175] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-17T03:48:33.490164] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-17T03:48:33.602083] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T03:48:34.290202] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-17T03:48:34.530954] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:48:35.073251] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:48:35.090079] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-17T03:48:35.751189] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:48:35.890126] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-17T03:48:36.588297] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:48:36.690160] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-17T03:48:37.490229] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-17T03:48:37.667545] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T03:48:38.290196] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-17T03:48:38.541455] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T03:48:39.056824] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T03:48:39.090188] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-17T03:48:39.807222] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:48:39.890144] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-17T03:48:40.690106] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-17T03:48:40.793164] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:48:41.490193] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-17T03:48:41.773795] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T03:48:42.290202] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-17T03:48:42.424537] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T03:48:43.041666] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T03:48:43.090103] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-17T03:48:43.890189] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-17T03:48:44.139692] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T03:48:44.690138] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-17T03:48:44.903690] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:48:45.357076] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T03:48:45.490132] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-17T03:48:46.297265] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-17T03:48:46.299452] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:48:46.306258] [INFO ] [REMOTE ] FNB: Full fetch complete (75347 records). [2025-09-17T03:48:46.306433] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-17T03:48:46.706075] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-17T03:48:46.706220] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-17T03:48:46.707218] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-17T03:48:46.707330] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-17T03:48:46.708902] [DEBUG] [LOCAL ] FNB: Trimmed 75347 records to 52451 (keeping 200 days of data) [2025-09-17T03:48:46.828348] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T03:48:46.843103] [INFO ] [REMOTE ] FN: Full fetch complete (56545 records). [2025-09-17T03:48:46.844433] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-17T03:48:47.097879] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-17T03:48:47.363560] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-17T03:48:47.363999] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-17T03:48:47.365403] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-17T03:48:47.365481] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-17T03:48:47.371107] [DEBUG] [LOCAL ] FN: Trimmed 56545 records to 39796 (keeping 200 days of data) [2025-09-17T03:48:47.653625] [DEBUG] [LOCAL ] FNB: Primary data saved (52451 records). [2025-09-17T03:48:47.662689] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-17T03:48:47.688257] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FNB took 38.2s. Estimated remaining: 3h 41m 11s. Rate: 6.8 symbols/min [2025-09-17T03:48:47.877758] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:47.879021] [DEBUG] [LOCAL ] FNV: No existing data file found in primary storage. [2025-09-17T03:48:47.879946] [WARN ] [MAIN ] FNV: No existing data found, performing full refresh instead. [2025-09-17T03:48:47.881718] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-17T03:48:47.882828] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-17T03:48:47.883934] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-09-17T03:48:47.885085] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-17T03:48:48.315952] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:48.318595] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-11. [2025-09-17T03:48:48.323227] [DEBUG] [LOCAL ] FN: Primary data saved (39796 records). [2025-09-17T03:48:48.323424] [INFO ] [MAIN ] FN: Full history saved. [2025-09-17T03:48:48.323567] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 41.9s. Estimated remaining: 3h 40m 48s. Rate: 6.9 symbols/min [2025-09-17T03:48:48.490176] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T03:48:48.556394] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:48.557025] [DEBUG] [LOCAL ] FOA: No existing data file found in primary storage. [2025-09-17T03:48:48.557079] [WARN ] [MAIN ] FOA: No existing data found, performing full refresh instead. [2025-09-17T03:48:48.557192] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-17T03:48:48.557245] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-17T03:48:48.557312] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-09-17T03:48:48.557392] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-17T03:48:48.701996] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-17T03:48:48.921811] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:48.937888] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T03:48:48.944109] [INFO ] [REMOTE ] FND: Full fetch complete (74126 records). [2025-09-17T03:48:48.944255] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-17T03:48:49.365273] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-17T03:48:49.365495] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-17T03:48:49.366987] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-17T03:48:49.367066] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-17T03:48:49.369839] [DEBUG] [LOCAL ] FND: Trimmed 74126 records to 52178 (keeping 200 days of data) [2025-09-17T03:48:49.492366] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-11. [2025-09-17T03:48:49.721934] [DEBUG] [LOCAL ] FND: Primary data saved (52178 records). [2025-09-17T03:48:49.722200] [INFO ] [MAIN ] FND: Full history saved. [2025-09-17T03:48:49.722355] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FND took 30.4s. Estimated remaining: 3h 40m 26s. Rate: 6.9 symbols/min [2025-09-17T03:48:49.919620] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:49.928127] [DEBUG] [LOCAL ] FOF: Loaded 5797 existing records from primary storage. [2025-09-17T03:48:49.928237] [INFO ] [MAIN ] FOF: Loaded 5797 existing records. [2025-09-17T03:48:50.120155] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:50.120854] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-17T03:48:50.121063] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-17T03:48:50.130251] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-17T03:48:50.145119] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-17T03:48:50.168575] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T03:48:50.298570] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-17T03:48:50.485727] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T03:48:50.560114] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:50.573572] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T03:48:51.090171] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-11. [2025-09-17T03:48:51.830045] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:48:51.896217] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-17T03:48:51.911093] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:48:52.690133] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-17T03:48:52.762316] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T03:48:53.490189] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-17T03:48:53.703960] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T03:48:54.290160] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-17T03:48:55.102501] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-17T03:48:55.105817] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:48:55.527203] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:48:55.890156] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-17T03:48:56.658228] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:48:56.690078] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-17T03:48:56.937912] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:48:57.490155] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-17T03:48:57.789444] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:48:58.290159] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-17T03:48:59.090163] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-17T03:48:59.188536] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T03:48:59.233515] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T03:48:59.890179] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-17T03:49:00.690184] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-17T03:49:00.791067] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:49:01.418627] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:49:01.425926] [INFO ] [REMOTE ] FNF: Full fetch complete (69244 records). [2025-09-17T03:49:01.426113] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-17T03:49:01.495270] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-17T03:49:01.862153] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:49:01.865772] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-17T03:49:01.870266] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-17T03:49:01.871464] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-17T03:49:01.871995] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-17T03:49:01.873505] [DEBUG] [LOCAL ] FNF: Trimmed 69244 records to 49340 (keeping 200 days of data) [2025-09-17T03:49:02.107968] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:49:02.203113] [DEBUG] [LOCAL ] FNF: Primary data saved (49340 records). [2025-09-17T03:49:02.203308] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-17T03:49:02.203413] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FNF took 37.0s. Estimated remaining: 3h 40m 24s. Rate: 6.9 symbols/min [2025-09-17T03:49:02.295308] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-17T03:49:02.388085] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:02.404082] [DEBUG] [LOCAL ] FOR: Loaded 14590 existing records from primary storage. [2025-09-17T03:49:02.404255] [INFO ] [MAIN ] FOR: Loaded 14590 existing records. [2025-09-17T03:49:02.586743] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:02.587028] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-17T03:49:02.587082] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-17T03:49:02.587812] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-17T03:49:02.587881] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-17T03:49:02.946214] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:03.090082] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-11. [2025-09-17T03:49:03.104531] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T03:49:03.890202] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-17T03:49:04.064510] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T03:49:04.690229] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-17T03:49:05.491437] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T03:49:05.490382] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-17T03:49:05.788094] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:49:06.290147] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-17T03:49:06.333102] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:49:07.090149] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-17T03:49:07.890139] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-17T03:49:07.909072] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T03:49:07.959095] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:49:08.690126] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-17T03:49:08.739202] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T03:49:09.284705] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:49:09.490160] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-17T03:49:10.290164] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-17T03:49:10.551017] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T03:49:11.090165] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-17T03:49:11.097527] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:49:11.890146] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-17T03:49:11.967190] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T03:49:12.690134] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-17T03:49:13.490110] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-17T03:49:13.573214] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T03:49:13.641476] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:49:13.644317] [INFO ] [REMOTE ] FOA: Full fetch complete (22478 records). [2025-09-17T03:49:13.644453] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-17T03:49:14.037836] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-17T03:49:14.037996] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-17T03:49:14.038680] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-17T03:49:14.038744] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-17T03:49:14.039794] [DEBUG] [LOCAL ] FOA: Trimmed 22478 records to 13204 (keeping 200 days of data) [2025-09-17T03:49:14.118932] [DEBUG] [LOCAL ] FOA: Primary data saved (13204 records). [2025-09-17T03:49:14.119104] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-17T03:49:14.119196] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FOA took 25.8s. Estimated remaining: 3h 40m 21s. Rate: 6.9 symbols/min [2025-09-17T03:49:14.292419] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:14.292491] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-17T03:49:14.332536] [DEBUG] [LOCAL ] FOUR: Loaded 36659 existing records from primary storage. [2025-09-17T03:49:14.332732] [INFO ] [MAIN ] FOUR: Loaded 36659 existing records. [2025-09-17T03:49:14.512531] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:14.512831] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-17T03:49:14.512892] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-17T03:49:14.513778] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-17T03:49:14.513839] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-17T03:49:14.870248] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:14.885562] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:49:15.090134] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-11. [2025-09-17T03:49:15.114180] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T03:49:15.890207] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-17T03:49:16.690176] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-17T03:49:16.919702] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T03:49:17.044036] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:49:17.455868] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:49:17.490155] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-17T03:49:18.290182] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-17T03:49:18.586457] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:49:19.090126] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-17T03:49:19.871709] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:49:19.890104] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-17T03:49:20.690129] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-17T03:49:20.979142] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T03:49:21.261489] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:49:21.490129] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-17T03:49:22.087742] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:49:22.126050] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:49:22.127689] [INFO ] [REMOTE ] FOF: Full fetch complete (11532 records). [2025-09-17T03:49:22.127777] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-17T03:49:22.304321] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-17T03:49:22.504976] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-17T03:49:22.505147] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-17T03:49:22.505481] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-17T03:49:22.505540] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-17T03:49:22.506078] [DEBUG] [LOCAL ] FOF: Trimmed 11532 records to 8073 (keeping 200 days of data) [2025-09-17T03:49:22.557838] [DEBUG] [LOCAL ] FOF: Primary data saved (8073 records). [2025-09-17T03:49:22.558008] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-17T03:49:22.558106] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FOF took 32.8s. Estimated remaining: 3h 40m 12s. Rate: 6.9 symbols/min [2025-09-17T03:49:22.729304] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:22.744271] [DEBUG] [LOCAL ] FPF: Loaded 12881 existing records from primary storage. [2025-09-17T03:49:22.744463] [INFO ] [MAIN ] FPF: Loaded 12881 existing records. [2025-09-17T03:49:22.920489] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:22.920774] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-17T03:49:22.920835] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-17T03:49:22.921291] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-17T03:49:22.921350] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-17T03:49:23.093088] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-17T03:49:23.280718] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:23.890131] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-17T03:49:24.077929] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T03:49:24.241859] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T03:49:24.690115] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-17T03:49:25.490200] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-17T03:49:25.670936] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T03:49:26.139510] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T03:49:26.206782] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T03:49:26.212421] [INFO ] [REMOTE ] FNV: Full fetch complete (65727 records). [2025-09-17T03:49:26.212596] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-17T03:49:26.295254] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-17T03:49:26.624806] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-17T03:49:26.624938] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-17T03:49:26.625867] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-17T03:49:26.625951] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-17T03:49:26.627454] [DEBUG] [LOCAL ] FNV: Trimmed 65727 records to 46551 (keeping 200 days of data) [2025-09-17T03:49:26.930319] [DEBUG] [LOCAL ] FNV: Primary data saved (46551 records). [2025-09-17T03:49:26.930498] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-17T03:49:26.930588] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FNV took 39.2s. Estimated remaining: 3h 39m 55s. Rate: 6.9 symbols/min [2025-09-17T03:49:27.090283] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-17T03:49:27.112799] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:27.128889] [DEBUG] [LOCAL ] FPH: Loaded 14629 existing records from primary storage. [2025-09-17T03:49:27.129032] [INFO ] [MAIN ] FPH: Loaded 14629 existing records. [2025-09-17T03:49:27.304846] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:27.305075] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-17T03:49:27.305132] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-17T03:49:27.305546] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-17T03:49:27.305604] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-17T03:49:27.661982] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:27.890209] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-11. [2025-09-17T03:49:28.085001] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:49:28.150074] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T03:49:28.545803] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T03:49:28.690103] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-17T03:49:29.490182] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-11. [2025-09-17T03:49:29.692964] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T03:49:30.290255] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-17T03:49:30.526875] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T03:49:31.090195] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-17T03:49:31.550747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T03:49:31.758700] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T03:49:31.890130] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-17T03:49:32.690197] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-17T03:49:32.792828] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T03:49:32.795600] [INFO ] [REMOTE ] FOR: Full fetch complete (29547 records). [2025-09-17T03:49:32.795744] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-17T03:49:33.197916] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-17T03:49:33.198063] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-17T03:49:33.199156] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-17T03:49:33.199230] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-17T03:49:33.200303] [DEBUG] [LOCAL ] FOR: Trimmed 29547 records to 20318 (keeping 200 days of data) [2025-09-17T03:49:33.332280] [DEBUG] [LOCAL ] FOR: Primary data saved (20318 records). [2025-09-17T03:49:33.332515] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-17T03:49:33.332660] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOR took 31.1s. Estimated remaining: 3h 39m 42s. Rate: 6.9 symbols/min [2025-09-17T03:49:33.495552] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-17T03:49:33.526941] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:33.556346] [DEBUG] [LOCAL ] FPI: Loaded 23420 existing records from primary storage. [2025-09-17T03:49:33.556568] [INFO ] [MAIN ] FPI: Loaded 23420 existing records. [2025-09-17T03:49:33.759858] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:33.760279] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-17T03:49:33.760344] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-17T03:49:33.761321] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-17T03:49:33.761438] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-17T03:49:34.125192] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:34.141631] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:49:34.290153] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-17T03:49:34.703047] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T03:49:35.090215] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-17T03:49:35.414143] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:49:35.890173] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-17T03:49:36.113117] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T03:49:36.675955] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T03:49:36.690084] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-17T03:49:37.490148] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-17T03:49:37.662542] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T03:49:38.216731] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T03:49:38.290167] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-11. [2025-09-17T03:49:39.090183] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-17T03:49:39.612660] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:49:39.890191] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-17T03:49:40.690164] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-17T03:49:40.847341] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:49:40.977137] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:49:41.490139] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-17T03:49:41.680401] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:49:42.290145] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-17T03:49:42.925440] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:49:43.090201] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-17T03:49:43.890123] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-17T03:49:44.147475] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:49:44.342453] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:49:44.690133] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-17T03:49:45.027855] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T03:49:45.490112] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-17T03:49:45.794320] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T03:49:46.290130] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-17T03:49:46.643240] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:49:47.090140] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-17T03:49:47.294144] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T03:49:47.890221] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-17T03:49:48.486394] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:49:48.690131] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-17T03:49:48.853759] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T03:49:49.490212] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-17T03:49:50.109355] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T03:49:50.290144] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-17T03:49:50.611881] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T03:49:51.090155] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-17T03:49:51.196302] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T03:49:51.199401] [INFO ] [REMOTE ] FPH: Full fetch complete (31625 records). [2025-09-17T03:49:51.199501] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-17T03:49:51.584193] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-17T03:49:51.584307] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-17T03:49:51.584896] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-17T03:49:51.584952] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-17T03:49:51.585842] [DEBUG] [LOCAL ] FPH: Trimmed 31625 records to 19790 (keeping 200 days of data) [2025-09-17T03:49:51.697085] [DEBUG] [LOCAL ] FPH: Primary data saved (19790 records). [2025-09-17T03:49:51.697271] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-17T03:49:51.697370] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FPH took 24.8s. Estimated remaining: 3h 39m 50s. Rate: 6.9 symbols/min [2025-09-17T03:49:51.877186] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:51.896480] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-17T03:49:51.909320] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T03:49:51.927419] [DEBUG] [LOCAL ] FR: Loaded 34514 existing records from primary storage. [2025-09-17T03:49:51.927613] [INFO ] [MAIN ] FR: Loaded 34514 existing records. [2025-09-17T03:49:52.117190] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:52.117486] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-17T03:49:52.117541] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-17T03:49:52.118440] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-17T03:49:52.118515] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-17T03:49:52.494815] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:52.690144] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-11. [2025-09-17T03:49:53.293767] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:49:53.490205] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-17T03:49:54.290104] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-17T03:49:54.325829] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T03:49:54.838080] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T03:49:55.090141] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-17T03:49:55.890108] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-17T03:49:56.066232] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:49:56.501219] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T03:49:56.640034] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T03:49:56.690182] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-17T03:49:57.490188] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-17T03:49:58.281586] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T03:49:58.290348] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-17T03:49:59.090161] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-17T03:49:59.177274] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:49:59.179760] [INFO ] [REMOTE ] FPF: Full fetch complete (26344 records). [2025-09-17T03:49:59.179851] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-17T03:49:59.562786] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-17T03:49:59.562930] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-17T03:49:59.564277] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-17T03:49:59.578924] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-17T03:49:59.591952] [DEBUG] [LOCAL ] FPF: Trimmed 26344 records to 17657 (keeping 200 days of data) [2025-09-17T03:49:59.595221] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T03:49:59.715746] [DEBUG] [LOCAL ] FPF: Primary data saved (17657 records). [2025-09-17T03:49:59.715945] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-17T03:49:59.716049] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FPF took 37.2s. Estimated remaining: 3h 39m 40s. Rate: 6.9 symbols/min [2025-09-17T03:49:59.889097] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:59.890123] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-17T03:49:59.900675] [DEBUG] [LOCAL ] FRA: Loaded 10140 existing records from primary storage. [2025-09-17T03:49:59.900805] [INFO ] [MAIN ] FRA: Loaded 10140 existing records. [2025-09-17T03:50:00.079213] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:00.079471] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-17T03:50:00.079539] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-17T03:50:00.079997] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-17T03:50:00.080063] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-17T03:50:00.435340] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:00.454007] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:50:00.690142] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-17T03:50:01.490200] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-17T03:50:01.722862] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T03:50:01.852362] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:50:01.857252] [INFO ] [REMOTE ] FPI: Full fetch complete (43910 records). [2025-09-17T03:50:01.857445] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-17T03:50:02.295855] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-17T03:50:02.307020] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-17T03:50:02.307166] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-17T03:50:02.309241] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-17T03:50:02.309441] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-17T03:50:02.310724] [DEBUG] [LOCAL ] FPI: Trimmed 43910 records to 31234 (keeping 200 days of data) [2025-09-17T03:50:02.511480] [DEBUG] [LOCAL ] FPI: Primary data saved (31234 records). [2025-09-17T03:50:02.511744] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-17T03:50:02.511902] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPI took 29.2s. Estimated remaining: 3h 39m 21s. Rate: 6.9 symbols/min [2025-09-17T03:50:02.701527] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:02.714264] [DEBUG] [LOCAL ] FRGE: Loaded 11551 existing records from primary storage. [2025-09-17T03:50:02.714459] [INFO ] [MAIN ] FRGE: Loaded 11551 existing records. [2025-09-17T03:50:02.925262] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:02.925629] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-17T03:50:02.925718] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-17T03:50:02.926390] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-17T03:50:02.926461] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-17T03:50:03.102146] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-11. [2025-09-17T03:50:03.202066] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:50:03.375860] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:03.890127] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-17T03:50:04.196972] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:50:04.433128] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T03:50:04.690129] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-17T03:50:05.042031] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:50:05.490113] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-17T03:50:05.725562] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:50:06.290144] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-17T03:50:07.090168] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-11. [2025-09-17T03:50:07.129003] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:50:07.890157] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-17T03:50:07.949950] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T03:50:07.956284] [INFO ] [REMOTE ] FOUR: Full fetch complete (71731 records). [2025-09-17T03:50:07.956481] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-17T03:50:08.484323] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-17T03:50:08.484541] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-17T03:50:08.486152] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-17T03:50:08.486301] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-17T03:50:08.488562] [DEBUG] [LOCAL ] FOUR: Trimmed 71731 records to 49544 (keeping 200 days of data) [2025-09-17T03:50:08.668246] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:50:08.690164] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-17T03:50:09.010186] [DEBUG] [LOCAL ] FOUR: Primary data saved (49544 records). [2025-09-17T03:50:09.010430] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-17T03:50:09.010558] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FOUR took 54.9s. Estimated remaining: 3h 39m 9s. Rate: 6.9 symbols/min [2025-09-17T03:50:09.258246] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:09.315364] [DEBUG] [LOCAL ] FRO: Loaded 38509 existing records from primary storage. [2025-09-17T03:50:09.315611] [INFO ] [MAIN ] FRO: Loaded 38509 existing records. [2025-09-17T03:50:09.495344] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-17T03:50:09.569674] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:09.570137] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-17T03:50:09.570228] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-17T03:50:09.571232] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-17T03:50:09.571318] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-17T03:50:09.956485] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:10.018576] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T03:50:10.020761] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T03:50:10.290150] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-17T03:50:10.745149] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:50:11.090146] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-17T03:50:11.742278] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T03:50:11.804670] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T03:50:11.890151] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-17T03:50:12.690180] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-17T03:50:13.244084] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:50:13.490137] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-17T03:50:14.290264] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-17T03:50:14.424442] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:50:14.482696] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:50:15.090168] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-11. [2025-09-17T03:50:15.782255] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:50:15.890141] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-17T03:50:16.690172] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-17T03:50:17.027977] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T03:50:17.113558] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T03:50:17.315137] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:50:17.490210] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-17T03:50:18.290204] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-17T03:50:19.090170] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-17T03:50:19.138765] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T03:50:19.675707] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T03:50:19.890165] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-17T03:50:20.690151] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-17T03:50:21.130154] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T03:50:21.490151] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-17T03:50:21.536253] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:50:21.605668] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T03:50:22.135261] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T03:50:22.290149] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-17T03:50:23.090139] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-17T03:50:23.152619] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T03:50:23.890150] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-17T03:50:24.503029] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T03:50:24.508715] [INFO ] [REMOTE ] FR: Full fetch complete (66426 records). [2025-09-17T03:50:24.508868] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-17T03:50:24.691033] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-17T03:50:24.719593] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T03:50:24.965589] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-17T03:50:24.965744] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-17T03:50:24.966555] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-17T03:50:24.966617] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-17T03:50:24.968140] [DEBUG] [LOCAL ] FR: Trimmed 66426 records to 46885 (keeping 200 days of data) [2025-09-17T03:50:25.263053] [DEBUG] [LOCAL ] FR: Primary data saved (46885 records). [2025-09-17T03:50:25.263292] [INFO ] [MAIN ] FR: Full history saved. [2025-09-17T03:50:25.263451] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FR took 33.6s. Estimated remaining: 3h 39m 13s. Rate: 6.9 symbols/min [2025-09-17T03:50:25.435358] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:25.466237] [DEBUG] [LOCAL ] FRT: Loaded 31128 existing records from primary storage. [2025-09-17T03:50:25.466445] [INFO ] [MAIN ] FRT: Loaded 31128 existing records. [2025-09-17T03:50:25.497410] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-17T03:50:25.648806] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:25.649060] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-17T03:50:25.649122] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-17T03:50:25.649989] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-17T03:50:25.650056] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-17T03:50:26.008955] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:26.290139] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-11. [2025-09-17T03:50:26.590543] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T03:50:26.776739] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T03:50:27.090196] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-17T03:50:27.851412] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T03:50:27.890099] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-17T03:50:27.920131] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T03:50:28.690141] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-17T03:50:29.356478] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:50:29.490218] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-17T03:50:29.646302] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T03:50:30.290218] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-17T03:50:30.943263] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T03:50:31.090187] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-17T03:50:31.112558] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:50:31.115096] [INFO ] [REMOTE ] FRA: Full fetch complete (24480 records). [2025-09-17T03:50:31.115215] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-17T03:50:31.502207] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-17T03:50:31.502342] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-17T03:50:31.503171] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-17T03:50:31.503256] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-17T03:50:31.505223] [DEBUG] [LOCAL ] FRA: Trimmed 24480 records to 14810 (keeping 200 days of data) [2025-09-17T03:50:31.600577] [DEBUG] [LOCAL ] FRA: Primary data saved (14810 records). [2025-09-17T03:50:31.600816] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-17T03:50:31.600948] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FRA took 31.9s. Estimated remaining: 3h 38m 60s. Rate: 6.9 symbols/min [2025-09-17T03:50:31.773620] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:31.801737] [DEBUG] [LOCAL ] FSCO: Loaded 27172 existing records from primary storage. [2025-09-17T03:50:31.801951] [INFO ] [MAIN ] FSCO: Loaded 27172 existing records. [2025-09-17T03:50:31.897058] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-17T03:50:31.991758] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:31.992044] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-17T03:50:31.992129] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-17T03:50:31.992784] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-17T03:50:31.992863] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-17T03:50:32.368739] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:32.394415] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T03:50:32.690157] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-17T03:50:33.490235] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-17T03:50:33.695026] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T03:50:33.834043] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T03:50:34.290177] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-11. [2025-09-17T03:50:35.090158] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-17T03:50:35.196007] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T03:50:35.735354] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T03:50:35.808747] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T03:50:35.811185] [INFO ] [REMOTE ] FRGE: Full fetch complete (34845 records). [2025-09-17T03:50:35.811334] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-17T03:50:35.895262] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-17T03:50:36.201478] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-17T03:50:36.201707] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-17T03:50:36.202807] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-17T03:50:36.202892] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-17T03:50:36.205530] [DEBUG] [LOCAL ] FRGE: Trimmed 34845 records to 19255 (keeping 200 days of data) [2025-09-17T03:50:36.327391] [DEBUG] [LOCAL ] FRGE: Primary data saved (19255 records). [2025-09-17T03:50:36.327618] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-17T03:50:36.327836] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FRGE took 33.8s. Estimated remaining: 3h 38m 44s. Rate: 6.9 symbols/min [2025-09-17T03:50:36.504131] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:36.543268] [DEBUG] [LOCAL ] FSK: Loaded 36028 existing records from primary storage. [2025-09-17T03:50:36.543464] [INFO ] [MAIN ] FSK: Loaded 36028 existing records. [2025-09-17T03:50:36.697723] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-17T03:50:36.727551] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:36.728719] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-17T03:50:36.728783] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-17T03:50:36.729590] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-17T03:50:36.729694] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-17T03:50:37.108220] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:37.490179] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-17T03:50:37.668884] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:50:38.239803] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T03:50:38.290119] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-17T03:50:39.090169] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-11. [2025-09-17T03:50:39.557402] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T03:50:39.839988] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T03:50:39.890165] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-17T03:50:40.445621] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:50:40.690187] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-17T03:50:41.490161] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-17T03:50:41.910421] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T03:50:42.032393] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T03:50:42.290151] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-17T03:50:43.095262] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-17T03:50:43.116318] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:50:43.770288] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:50:43.890163] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-17T03:50:44.690139] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-17T03:50:44.811625] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T03:50:45.486949] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:50:45.495551] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-17T03:50:45.948870] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:50:46.290142] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-17T03:50:46.959709] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T03:50:47.090159] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-17T03:50:47.807669] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T03:50:47.890135] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-17T03:50:48.690182] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-17T03:50:48.730227] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:50:49.490152] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-17T03:50:49.519304] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T03:50:50.070331] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:50:50.290151] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-17T03:50:51.090152] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-17T03:50:51.461665] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T03:50:51.543852] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T03:50:51.890133] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-17T03:50:52.695226] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-17T03:50:52.712551] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T03:50:53.490176] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-17T03:50:53.679961] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:50:54.274296] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:50:54.290074] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-17T03:50:54.457005] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T03:50:55.090130] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-17T03:50:55.881462] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T03:50:55.892138] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-17T03:50:56.458876] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T03:50:56.465486] [INFO ] [REMOTE ] FRT: Full fetch complete (60139 records). [2025-09-17T03:50:56.465688] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-17T03:50:56.695307] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-17T03:50:56.882961] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-17T03:50:56.883080] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-17T03:50:56.883993] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-17T03:50:56.884089] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-17T03:50:56.885542] [DEBUG] [LOCAL ] FRT: Trimmed 60139 records to 42398 (keeping 200 days of data) [2025-09-17T03:50:57.152785] [DEBUG] [LOCAL ] FRT: Primary data saved (42398 records). [2025-09-17T03:50:57.152946] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-17T03:50:57.153060] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRT took 31.9s. Estimated remaining: 3h 38m 56s. Rate: 6.9 symbols/min [2025-09-17T03:50:57.326620] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:57.339786] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:50:57.348166] [INFO ] [REMOTE ] FSCO: Full fetch complete (53842 records). [2025-09-17T03:50:57.348393] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-17T03:50:57.506166] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-17T03:50:57.616856] [DEBUG] [LOCAL ] FSLY: Loaded 38013 existing records from primary storage. [2025-09-17T03:50:57.649929] [INFO ] [MAIN ] FSLY: Loaded 38013 existing records. [2025-09-17T03:50:57.931999] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-17T03:50:57.953382] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:57.953284] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-17T03:50:57.954389] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-17T03:50:57.954213] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-17T03:50:57.954490] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-17T03:50:57.954541] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-17T03:50:57.955401] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-17T03:50:57.955584] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-17T03:50:57.989080] [DEBUG] [LOCAL ] FSCO: Trimmed 53842 records to 36874 (keeping 200 days of data) [2025-09-17T03:50:58.423881] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:58.426071] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-11. [2025-09-17T03:50:58.543147] [DEBUG] [LOCAL ] FSCO: Primary data saved (36874 records). [2025-09-17T03:50:58.543317] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-17T03:50:58.543413] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FSCO took 26.9s. Estimated remaining: 3h 38m 35s. Rate: 6.9 symbols/min [2025-09-17T03:50:58.713493] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:58.744918] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T03:50:58.788448] [DEBUG] [LOCAL ] FSM: Loaded 39669 existing records from primary storage. [2025-09-17T03:50:58.788617] [INFO ] [MAIN ] FSM: Loaded 39669 existing records. [2025-09-17T03:50:58.969149] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:58.969416] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-17T03:50:58.969474] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-17T03:50:58.970170] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-17T03:50:58.970229] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-17T03:50:59.095226] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-17T03:50:59.325325] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:59.415961] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T03:50:59.890189] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-17T03:51:00.249523] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T03:51:00.690117] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-17T03:51:01.025076] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T03:51:01.033591] [INFO ] [REMOTE ] FRO: Full fetch complete (75403 records). [2025-09-17T03:51:01.033892] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-17T03:51:01.507958] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-11. [2025-09-17T03:51:01.677830] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-17T03:51:01.694790] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-17T03:51:01.696912] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-17T03:51:01.697051] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-17T03:51:01.693057] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:51:01.719107] [DEBUG] [LOCAL ] FRO: Trimmed 75403 records to 51942 (keeping 200 days of data) [2025-09-17T03:51:02.192530] [DEBUG] [LOCAL ] FRO: Primary data saved (51942 records). [2025-09-17T03:51:02.192776] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-17T03:51:02.192907] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FRO took 53.2s. Estimated remaining: 3h 38m 17s. Rate: 6.9 symbols/min [2025-09-17T03:51:02.295371] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-17T03:51:02.384529] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:02.384851] [DEBUG] [LOCAL ] FSS: No existing data file found in primary storage. [2025-09-17T03:51:02.384928] [WARN ] [MAIN ] FSS: No existing data found, performing full refresh instead. [2025-09-17T03:51:02.385087] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-17T03:51:02.385164] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-17T03:51:02.385246] [DEBUG] [LOCAL ] FSS: No primary data file found to delete. [2025-09-17T03:51:02.385314] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-17T03:51:02.812872] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:03.090208] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-11. [2025-09-17T03:51:03.137588] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T03:51:03.890153] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-17T03:51:04.011909] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-11 (2.50 seconds). [2025-09-17T03:51:04.690189] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-17T03:51:05.432236] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T03:51:05.494217] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-17T03:51:05.499311] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (3.20 seconds). [2025-09-17T03:51:05.711007] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:51:06.290137] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-17T03:51:06.435344] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T03:51:06.532676] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:51:07.090154] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-17T03:51:07.890147] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-17T03:51:08.003937] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:51:08.690176] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-17T03:51:08.975400] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T03:51:09.490103] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-17T03:51:09.561604] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:51:09.963776] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:51:10.290151] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-17T03:51:10.986983] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T03:51:11.090171] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-17T03:51:11.704393] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:51:11.890143] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-17T03:51:12.690187] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-17T03:51:12.850319] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:51:13.490176] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-17T03:51:13.781833] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:51:14.290187] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-17T03:51:14.614598] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T03:51:15.090138] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-17T03:51:15.307588] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:51:15.890143] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-17T03:51:16.068494] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:51:16.690158] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-17T03:51:16.747781] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:51:17.490164] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-17T03:51:18.290180] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-17T03:51:18.440022] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T03:51:19.090163] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-17T03:51:19.513941] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T03:51:19.688310] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-17T03:51:19.694665] [INFO ] [REMOTE ] FSK: Full fetch complete (71106 records). [2025-09-17T03:51:19.694814] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-17T03:51:19.895253] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-17T03:51:20.099393] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-17T03:51:20.099603] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-17T03:51:20.100565] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-17T03:51:20.100656] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-17T03:51:20.102272] [DEBUG] [LOCAL ] FSK: Trimmed 71106 records to 49332 (keeping 200 days of data) [2025-09-17T03:51:20.237918] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T03:51:20.469243] [DEBUG] [LOCAL ] FSK: Primary data saved (49332 records). [2025-09-17T03:51:20.469444] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-17T03:51:20.469579] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FSK took 44.1s. Estimated remaining: 3h 38m 25s. Rate: 6.9 symbols/min [2025-09-17T03:51:20.641159] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:20.647757] [DEBUG] [LOCAL ] FT: Loaded 4736 existing records from primary storage. [2025-09-17T03:51:20.647915] [INFO ] [MAIN ] FT: Loaded 4736 existing records. [2025-09-17T03:51:20.710268] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-17T03:51:20.827678] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:20.827972] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-17T03:51:20.828038] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-17T03:51:20.828346] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-17T03:51:20.828420] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-17T03:51:21.190093] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:21.224230] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T03:51:21.490154] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-17T03:51:21.536837] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T03:51:22.290141] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-17T03:51:22.587573] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T03:51:23.030300] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:51:23.090147] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-17T03:51:23.716200] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T03:51:23.890138] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-17T03:51:24.295515] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:51:24.301891] [INFO ] [REMOTE ] FSLY: Full fetch complete (74839 records). [2025-09-17T03:51:24.302070] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-17T03:51:24.694960] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-11. [2025-09-17T03:51:24.695463] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-17T03:51:24.696511] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-17T03:51:24.697534] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-17T03:51:24.697927] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-17T03:51:24.700020] [DEBUG] [LOCAL ] FSLY: Trimmed 74839 records to 51270 (keeping 200 days of data) [2025-09-17T03:51:25.007753] [DEBUG] [LOCAL ] FSLY: Primary data saved (51270 records). [2025-09-17T03:51:25.007938] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-17T03:51:25.008042] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSLY took 27.9s. Estimated remaining: 3h 38m 9s. Rate: 6.9 symbols/min [2025-09-17T03:51:25.188161] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:25.198341] [DEBUG] [LOCAL ] FTHY: Loaded 8557 existing records from primary storage. [2025-09-17T03:51:25.198491] [INFO ] [MAIN ] FTHY: Loaded 8557 existing records. [2025-09-17T03:51:25.320179] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T03:51:25.388718] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:25.389182] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-17T03:51:25.389299] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-17T03:51:25.389773] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-17T03:51:25.389877] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-17T03:51:25.506715] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T03:51:25.492200] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-17T03:51:25.785128] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:26.106965] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T03:51:26.290178] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-17T03:51:26.704921] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T03:51:27.090161] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-17T03:51:27.602272] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T03:51:27.890147] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-17T03:51:28.690140] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-11. [2025-09-17T03:51:29.449877] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T03:51:29.458010] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T03:51:29.490101] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-17T03:51:30.290205] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-17T03:51:31.032778] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:51:31.090140] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-17T03:51:31.850904] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T03:51:31.890181] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-17T03:51:32.257199] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T03:51:32.261058] [INFO ] [REMOTE ] FSS: Full fetch complete (47887 records). [2025-09-17T03:51:32.261261] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-17T03:51:32.660433] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-17T03:51:32.660538] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-17T03:51:32.661208] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-17T03:51:32.661263] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-17T03:51:32.662305] [DEBUG] [LOCAL ] FSS: Trimmed 47887 records to 35076 (keeping 200 days of data) [2025-09-17T03:51:32.720039] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-17T03:51:32.890277] [DEBUG] [LOCAL ] FSS: Primary data saved (35076 records). [2025-09-17T03:51:32.890483] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-17T03:51:32.890601] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSS took 30.7s. Estimated remaining: 3h 37m 59s. Rate: 6.9 symbols/min [2025-09-17T03:51:33.063322] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:33.099910] [DEBUG] [LOCAL ] FTI: Loaded 39696 existing records from primary storage. [2025-09-17T03:51:33.100111] [INFO ] [MAIN ] FTI: Loaded 39696 existing records. [2025-09-17T03:51:33.285895] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:33.286129] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-17T03:51:33.286198] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-17T03:51:33.287255] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-17T03:51:33.287324] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-17T03:51:33.496456] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-17T03:51:33.554557] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:51:33.698941] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:33.795686] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:51:34.197372] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T03:51:34.290182] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-17T03:51:35.090176] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-17T03:51:35.293731] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T03:51:35.673994] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:51:35.890209] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-11. [2025-09-17T03:51:36.690178] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-17T03:51:37.490138] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-17T03:51:37.541207] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T03:51:37.567750] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T03:51:38.290191] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-17T03:51:38.332941] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:51:39.090195] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-17T03:51:39.678196] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:51:39.890277] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-17T03:51:39.891701] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T03:51:39.899177] [INFO ] [REMOTE ] FSM: Full fetch complete (76466 records). [2025-09-17T03:51:39.899342] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-17T03:51:40.297901] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-17T03:51:40.298052] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-17T03:51:40.298997] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-17T03:51:40.299061] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-17T03:51:40.300680] [DEBUG] [LOCAL ] FSM: Trimmed 76466 records to 53267 (keeping 200 days of data) [2025-09-17T03:51:40.636153] [DEBUG] [LOCAL ] FSM: Primary data saved (53267 records). [2025-09-17T03:51:40.636420] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-17T03:51:40.636541] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FSM took 42.1s. Estimated remaining: 3h 37m 48s. Rate: 6.9 symbols/min [2025-09-17T03:51:40.702193] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-17T03:51:40.817797] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:40.818109] [DEBUG] [LOCAL ] FTK: No existing data file found in primary storage. [2025-09-17T03:51:40.818165] [WARN ] [MAIN ] FTK: No existing data found, performing full refresh instead. [2025-09-17T03:51:40.818276] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-17T03:51:40.818330] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-17T03:51:40.818382] [DEBUG] [LOCAL ] FTK: No primary data file found to delete. [2025-09-17T03:51:40.818425] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-17T03:51:41.193501] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:41.490161] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-17T03:51:41.716715] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T03:51:41.717341] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:51:42.282135] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T03:51:42.290071] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-17T03:51:43.032601] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T03:51:43.090157] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-17T03:51:43.890166] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-17T03:51:44.096442] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T03:51:44.690151] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-17T03:51:45.334371] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:51:45.335794] [INFO ] [REMOTE ] FT: Full fetch complete (9009 records). [2025-09-17T03:51:45.335878] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-17T03:51:45.490721] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-17T03:51:45.707973] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-17T03:51:45.708165] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-17T03:51:45.708448] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-17T03:51:45.708507] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-17T03:51:45.709879] [DEBUG] [LOCAL ] FT: Trimmed 9009 records to 6306 (keeping 200 days of data) [2025-09-17T03:51:45.771667] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T03:51:45.794470] [DEBUG] [LOCAL ] FT: Primary data saved (6306 records). [2025-09-17T03:51:45.794752] [INFO ] [MAIN ] FT: Full history saved. [2025-09-17T03:51:45.794918] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FT took 25.3s. Estimated remaining: 3h 37m 33s. Rate: 6.9 symbols/min [2025-09-17T03:51:46.009143] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:46.048621] [DEBUG] [LOCAL ] FTS: Loaded 31471 existing records from primary storage. [2025-09-17T03:51:46.048920] [INFO ] [MAIN ] FTS: Loaded 31471 existing records. [2025-09-17T03:51:46.229870] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:46.230219] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-17T03:51:46.230290] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-17T03:51:46.231220] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-17T03:51:46.231301] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-17T03:51:46.297979] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-11. [2025-09-17T03:51:46.557957] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:51:46.627418] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:47.090185] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-17T03:51:47.543792] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T03:51:47.890191] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-17T03:51:48.690182] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-17T03:51:48.838539] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T03:51:48.973368] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:51:49.490176] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-17T03:51:49.500945] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:51:50.290219] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-17T03:51:51.090193] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-11. [2025-09-17T03:51:51.125763] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T03:51:51.375278] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:51:51.890155] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-17T03:51:52.327926] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T03:51:52.690203] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-17T03:51:53.490218] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-17T03:51:53.747837] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:51:53.851052] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T03:51:54.290163] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-17T03:51:54.571385] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:51:55.090229] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-17T03:51:55.130601] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T03:51:55.890186] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-17T03:51:56.136188] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:51:56.690178] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-17T03:51:57.470049] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T03:51:57.493192] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-17T03:51:57.487278] [INFO ] [REMOTE ] FTHY: Full fetch complete (17618 records). [2025-09-17T03:51:57.499119] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-17T03:51:57.508739] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:51:57.919660] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-17T03:51:57.919804] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-17T03:51:57.920455] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-17T03:51:57.920514] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-17T03:51:57.921476] [DEBUG] [LOCAL ] FTHY: Trimmed 17618 records to 11685 (keeping 200 days of data) [2025-09-17T03:51:58.004193] [DEBUG] [LOCAL ] FTHY: Primary data saved (11685 records). [2025-09-17T03:51:58.004484] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-17T03:51:58.004613] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FTHY took 33.0s. Estimated remaining: 3h 37m 31s. Rate: 6.9 symbols/min [2025-09-17T03:51:58.290176] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-17T03:51:58.512479] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:51:59.090181] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-17T03:51:59.890184] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-17T03:52:00.215124] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T03:52:00.255336] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:52:00.690239] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-17T03:52:01.485800] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T03:52:01.493855] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-17T03:52:02.004105] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T03:52:02.290236] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-17T03:52:03.090193] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-17T03:52:03.277473] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T03:52:03.821210] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T03:52:03.890183] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-17T03:52:04.582035] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:52:04.690096] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-17T03:52:05.207577] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:52:05.490219] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-17T03:52:06.224675] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T03:52:06.290125] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-17T03:52:06.830833] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T03:52:07.090139] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-17T03:52:07.746539] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T03:52:07.890153] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-17T03:52:08.690171] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-17T03:52:09.010366] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T03:52:09.452921] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:52:09.490082] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-17T03:52:09.512871] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:52:09.517171] [INFO ] [REMOTE ] FTK: Full fetch complete (41907 records). [2025-09-17T03:52:09.517308] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-17T03:52:09.929017] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-17T03:52:09.929190] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-17T03:52:09.930113] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-17T03:52:09.930221] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-17T03:52:09.931961] [DEBUG] [LOCAL ] FTK: Trimmed 41907 records to 31793 (keeping 200 days of data) [2025-09-17T03:52:10.124650] [DEBUG] [LOCAL ] FTK: Primary data saved (31793 records). [2025-09-17T03:52:10.124873] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-17T03:52:10.124985] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FTK took 29.5s. Estimated remaining: 3h 37m 28s. Rate: 6.9 symbols/min [2025-09-17T03:52:10.290193] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-17T03:52:11.099537] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:52:11.110343] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-17T03:52:11.890057] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T03:52:11.901600] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-17T03:52:12.659933] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T03:52:12.690082] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-17T03:52:13.597738] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T03:52:13.604316] [INFO ] [REMOTE ] FTI: Full fetch complete (76951 records). [2025-09-17T03:52:13.604543] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-17T03:52:14.014262] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-17T03:52:14.014456] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-17T03:52:14.015714] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-17T03:52:14.015847] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-17T03:52:14.028903] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T03:52:14.035401] [DEBUG] [LOCAL ] FTI: Trimmed 76951 records to 53311 (keeping 200 days of data) [2025-09-17T03:52:14.036549] [INFO ] [REMOTE ] FTS: Full fetch complete (60043 records). [2025-09-17T03:52:14.036957] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-17T03:52:14.595857] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-17T03:52:14.596035] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-17T03:52:14.597027] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-17T03:52:14.650371] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-17T03:52:14.689917] [DEBUG] [LOCAL ] FTS: Trimmed 60043 records to 42229 (keeping 200 days of data) [2025-09-17T03:52:14.921917] [DEBUG] [LOCAL ] FTI: Primary data saved (53311 records). [2025-09-17T03:52:14.923244] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-17T03:52:14.923874] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTI took 42.0s. Estimated remaining: 3h 37m 12s. Rate: 6.9 symbols/min [2025-09-17T03:52:15.064438] [DEBUG] [LOCAL ] FTS: Primary data saved (42229 records). [2025-09-17T03:52:15.064617] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-17T03:52:15.064888] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTS took 29.3s. Estimated remaining: 3h 36m 49s. Rate: 6.9 symbols/min [2025-09-17T03:52:15.559226] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.706313] [DEBUG] [LOCAL ] FTWO: No existing data file found in primary storage. [2025-09-17T03:52:15.726287] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.774848] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.777116] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.777915] [WARN ] [MAIN ] FTWO: No existing data found, performing full refresh instead. [2025-09-17T03:52:15.778986] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-17T03:52:15.779212] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-17T03:52:15.779339] [DEBUG] [LOCAL ] FTWO: No primary data file found to delete. [2025-09-17T03:52:15.779405] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-17T03:52:15.990153] [DEBUG] [LOCAL ] FUL: Loaded 22955 existing records from primary storage. [2025-09-17T03:52:16.029444] [INFO ] [MAIN ] FUL: Loaded 22955 existing records. [2025-09-17T03:52:16.126835] [DEBUG] [LOCAL ] FUBO: Loaded 40078 existing records from primary storage. [2025-09-17T03:52:16.184148] [INFO ] [MAIN ] FUBO: Loaded 40078 existing records. [2025-09-17T03:52:16.167121] [DEBUG] [LOCAL ] FTV: Loaded 39565 existing records from primary storage. [2025-09-17T03:52:16.225585] [INFO ] [MAIN ] FTV: Loaded 39565 existing records. [2025-09-17T03:52:16.523139] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:16.545479] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:16.554190] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-11. [2025-09-17T03:52:16.565167] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-17T03:52:16.644155] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-17T03:52:16.724885] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-17T03:52:16.699058] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:16.734429] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-17T03:52:16.755219] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:16.775935] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-17T03:52:16.786195] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-17T03:52:16.786356] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-17T03:52:16.798397] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-17T03:52:16.810818] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-17T03:52:16.831336] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-17T03:52:16.836534] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-17T03:52:16.836663] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-17T03:52:17.607102] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T03:52:17.674523] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-17T03:52:17.733305] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:17.836920] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-11. [2025-09-17T03:52:17.876582] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:17.906792] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-11. [2025-09-17T03:52:17.906157] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:17.907928] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-11. [2025-09-17T03:52:18.397878] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T03:52:18.399576] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-17T03:52:19.007975] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:52:19.010033] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-17T03:52:19.026463] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:52:19.090144] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-17T03:52:19.600263] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:52:19.639848] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:52:19.846793] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T03:52:19.890128] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-17T03:52:20.367895] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T03:52:20.690127] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-17T03:52:21.490280] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-17T03:52:21.707064] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:52:22.093345] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:52:22.114735] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:52:22.290135] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-17T03:52:23.090206] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-17T03:52:23.781657] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:52:23.890113] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-17T03:52:24.569069] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T03:52:24.690151] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-17T03:52:25.490137] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-17T03:52:25.602692] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:52:25.800407] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T03:52:26.290183] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-17T03:52:26.359302] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:52:26.648502] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T03:52:27.090148] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-17T03:52:27.556026] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:52:27.890139] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-17T03:52:28.690215] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-17T03:52:29.490161] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-17T03:52:29.726607] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T03:52:29.954143] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T03:52:30.287445] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T03:52:30.295196] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-17T03:52:30.763772] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T03:52:31.090145] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-17T03:52:31.458537] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:52:31.459717] [INFO ] [REMOTE ] FTWO: Full fetch complete (3524 records). [2025-09-17T03:52:31.459824] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-17T03:52:31.846048] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-17T03:52:31.846167] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-17T03:52:31.846312] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-17T03:52:31.846365] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-17T03:52:31.846846] [DEBUG] [LOCAL ] FTWO: Trimmed 3524 records to 1789 (keeping 200 days of data) [2025-09-17T03:52:31.858278] [DEBUG] [LOCAL ] FTWO: Primary data saved (1789 records). [2025-09-17T03:52:31.858398] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-17T03:52:31.858486] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 16.8s. Estimated remaining: 3h 36m 54s. Rate: 6.9 symbols/min [2025-09-17T03:52:31.895242] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-17T03:52:32.049141] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:32.087377] [DEBUG] [LOCAL ] FUN: Loaded 38812 existing records from primary storage. [2025-09-17T03:52:32.087565] [INFO ] [MAIN ] FUN: Loaded 38812 existing records. [2025-09-17T03:52:32.274265] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:32.274601] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-17T03:52:32.274684] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-17T03:52:32.275582] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-17T03:52:32.275688] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-17T03:52:32.653877] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:32.690158] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-17T03:52:33.490200] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-17T03:52:33.837630] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:52:34.236383] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:52:34.290174] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-17T03:52:35.090216] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-17T03:52:35.497863] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:52:35.842271] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-17T03:52:35.890176] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-17T03:52:36.690253] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-17T03:52:36.884590] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T03:52:37.490265] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-17T03:52:37.957073] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:52:38.189235] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-17T03:52:38.290173] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-11. [2025-09-17T03:52:39.090239] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-17T03:52:39.260252] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T03:52:39.890163] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-17T03:52:40.017346] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:52:40.660927] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:52:40.690170] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-17T03:52:41.490176] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-17T03:52:41.737333] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T03:52:42.005847] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T03:52:42.290190] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-17T03:52:43.096616] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-17T03:52:43.103096] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:52:43.890106] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-17T03:52:43.965804] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:52:43.970872] [INFO ] [REMOTE ] FUL: Full fetch complete (46209 records). [2025-09-17T03:52:43.971060] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-17T03:52:44.393137] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-17T03:52:44.393365] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-17T03:52:44.394580] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-17T03:52:44.394839] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-17T03:52:44.430058] [DEBUG] [LOCAL ] FUL: Trimmed 46209 records to 32927 (keeping 200 days of data) [2025-09-17T03:52:44.432236] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T03:52:44.659701] [DEBUG] [LOCAL ] FUL: Primary data saved (32927 records). [2025-09-17T03:52:44.659902] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-17T03:52:44.660044] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FUL took 29.6s. Estimated remaining: 3h 36m 52s. Rate: 6.9 symbols/min [2025-09-17T03:52:44.695268] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-17T03:52:44.838529] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:44.838768] [DEBUG] [LOCAL ] FVR: No existing data file found in primary storage. [2025-09-17T03:52:44.838828] [WARN ] [MAIN ] FVR: No existing data found, performing full refresh instead. [2025-09-17T03:52:44.838976] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-17T03:52:44.839045] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-17T03:52:44.839118] [DEBUG] [LOCAL ] FVR: No primary data file found to delete. [2025-09-17T03:52:44.839178] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-17T03:52:45.197742] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:45.490102] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-11. [2025-09-17T03:52:45.553556] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:52:46.181418] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T03:52:46.290113] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-17T03:52:46.837142] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T03:52:47.090167] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-17T03:52:47.842007] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:52:47.890111] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-17T03:52:48.680881] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:52:48.688144] [INFO ] [REMOTE ] FTV: Full fetch complete (76043 records). [2025-09-17T03:52:48.688354] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-17T03:52:48.701387] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-17T03:52:49.121351] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-17T03:52:49.121467] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-17T03:52:49.122353] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-17T03:52:49.122414] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-17T03:52:49.123940] [DEBUG] [LOCAL ] FTV: Trimmed 76043 records to 52888 (keeping 200 days of data) [2025-09-17T03:52:49.454462] [DEBUG] [LOCAL ] FTV: Primary data saved (52888 records). [2025-09-17T03:52:49.454858] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-17T03:52:49.455026] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FTV took 34.4s. Estimated remaining: 3h 36m 36s. Rate: 6.9 symbols/min [2025-09-17T03:52:49.497820] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-17T03:52:49.617057] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:52:49.678045] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:49.711515] [DEBUG] [LOCAL ] FVRR: Loaded 29987 existing records from primary storage. [2025-09-17T03:52:49.711779] [INFO ] [MAIN ] FVRR: Loaded 29987 existing records. [2025-09-17T03:52:49.896171] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:49.896528] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-17T03:52:49.896593] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-17T03:52:49.897504] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-17T03:52:49.897581] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-17T03:52:50.265428] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:50.290200] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-11. [2025-09-17T03:52:50.965735] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:52:51.090056] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T03:52:51.090148] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-17T03:52:51.890162] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-17T03:52:52.034354] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T03:52:52.143582] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T03:52:52.690229] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-17T03:52:53.490170] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-17T03:52:54.081727] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T03:52:54.276317] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T03:52:54.290094] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-17T03:52:54.464284] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T03:52:55.090221] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-17T03:52:55.890125] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-17T03:52:55.963807] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:52:56.690165] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-17T03:52:56.991730] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:52:57.288520] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-17T03:52:57.490173] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-17T03:52:58.290206] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-17T03:52:58.540520] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T03:52:59.090191] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-17T03:52:59.195937] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:52:59.239746] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T03:52:59.890210] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-17T03:53:00.690222] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-17T03:53:01.201595] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T03:53:01.489196] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-17T03:53:01.500419] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-17T03:53:02.290208] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-17T03:53:02.375145] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T03:53:02.428243] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T03:53:03.090233] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-17T03:53:03.890185] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-17T03:53:04.602236] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T03:53:04.652843] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T03:53:04.690208] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-17T03:53:04.956515] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:53:05.490186] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-17T03:53:06.290244] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-17T03:53:06.658749] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T03:53:06.680136] [INFO ] [REMOTE ] FUBO: Full fetch complete (77691 records). [2025-09-17T03:53:06.680670] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-17T03:53:07.092104] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-17T03:53:07.173666] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-17T03:53:07.173932] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-17T03:53:07.175835] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-17T03:53:07.176105] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-17T03:53:07.178794] [DEBUG] [LOCAL ] FUBO: Trimmed 77691 records to 53700 (keeping 200 days of data) [2025-09-17T03:53:07.271164] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:53:07.567343] [DEBUG] [LOCAL ] FUBO: Primary data saved (53700 records). [2025-09-17T03:53:07.567606] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-17T03:53:07.567765] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 52.5s. Estimated remaining: 3h 36m 43s. Rate: 6.9 symbols/min [2025-09-17T03:53:07.750880] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:07.751286] [DEBUG] [LOCAL ] FXED: No existing data file found in primary storage. [2025-09-17T03:53:07.751619] [WARN ] [MAIN ] FXED: No existing data found, performing full refresh instead. [2025-09-17T03:53:07.751933] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-17T03:53:07.751995] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-17T03:53:07.752055] [DEBUG] [LOCAL ] FXED: No primary data file found to delete. [2025-09-17T03:53:07.752111] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-17T03:53:07.895357] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-17T03:53:08.157710] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:08.198102] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T03:53:08.291733] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T03:53:08.690176] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-17T03:53:09.335032] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:53:09.337982] [INFO ] [REMOTE ] FVR: Full fetch complete (30686 records). [2025-09-17T03:53:09.338121] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-17T03:53:09.497251] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-11. [2025-09-17T03:53:09.760022] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-17T03:53:09.760320] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-17T03:53:09.761113] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-17T03:53:09.777130] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-17T03:53:09.790405] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:53:09.800885] [DEBUG] [LOCAL ] FVR: Trimmed 30686 records to 21906 (keeping 200 days of data) [2025-09-17T03:53:09.946900] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T03:53:09.956374] [DEBUG] [LOCAL ] FVR: Primary data saved (21906 records). [2025-09-17T03:53:09.956679] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-17T03:53:09.956839] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FVR took 25.3s. Estimated remaining: 3h 36m 24s. Rate: 6.9 symbols/min [2025-09-17T03:53:10.140690] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:10.185925] [DEBUG] [LOCAL ] G: Loaded 37121 existing records from primary storage. [2025-09-17T03:53:10.186169] [INFO ] [MAIN ] G: Loaded 37121 existing records. [2025-09-17T03:53:10.295309] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-17T03:53:10.388821] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:10.389194] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-17T03:53:10.389285] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-17T03:53:10.390754] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-17T03:53:10.390843] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-17T03:53:10.776290] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:11.090172] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-17T03:53:11.449074] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T03:53:11.890572] [INFO ] [REMOTE ] G: Fetching primary data for 2024-11. [2025-09-17T03:53:11.895999] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:53:12.690184] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-17T03:53:13.490951] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-17T03:53:13.500200] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:53:14.007451] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T03:53:14.290158] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-17T03:53:14.513560] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:53:14.640882] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T03:53:15.090152] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-17T03:53:15.399062] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-17T03:53:15.890232] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-17T03:53:16.335872] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T03:53:16.690227] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-17T03:53:17.490157] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-17T03:53:18.290108] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-17T03:53:18.381478] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T03:53:18.390449] [INFO ] [REMOTE ] FUN: Full fetch complete (71867 records). [2025-09-17T03:53:18.390744] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-17T03:53:18.708126] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T03:53:18.810105] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-17T03:53:18.810263] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-17T03:53:18.811520] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-17T03:53:18.811595] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-17T03:53:18.814144] [DEBUG] [LOCAL ] FUN: Trimmed 71867 records to 51532 (keeping 200 days of data) [2025-09-17T03:53:19.059049] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T03:53:19.091047] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-17T03:53:19.182313] [DEBUG] [LOCAL ] FUN: Primary data saved (51532 records). [2025-09-17T03:53:19.182560] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-17T03:53:19.182730] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FUN took 47.3s. Estimated remaining: 3h 36m 16s. Rate: 6.9 symbols/min [2025-09-17T03:53:19.363352] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:19.386489] [DEBUG] [LOCAL ] GAB: Loaded 19527 existing records from primary storage. [2025-09-17T03:53:19.386720] [INFO ] [MAIN ] GAB: Loaded 19527 existing records. [2025-09-17T03:53:19.570200] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:19.570580] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-17T03:53:19.570672] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-17T03:53:19.571318] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-17T03:53:19.571395] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-17T03:53:19.898478] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-17T03:53:19.946872] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:20.325373] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:53:20.690224] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-17T03:53:20.752823] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:53:21.490267] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-17T03:53:22.006315] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T03:53:22.126223] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:53:22.290179] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-17T03:53:23.090181] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-17T03:53:23.904177] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-17T03:53:23.913986] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T03:53:24.374973] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T03:53:24.690165] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-17T03:53:24.743075] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:53:25.032807] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T03:53:25.033918] [INFO ] [REMOTE ] FXED: Full fetch complete (1741 records). [2025-09-17T03:53:25.034016] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-17T03:53:25.425479] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-17T03:53:25.425625] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-17T03:53:25.425784] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-17T03:53:25.425835] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-17T03:53:25.426263] [DEBUG] [LOCAL ] FXED: Trimmed 1741 records to 1193 (keeping 200 days of data) [2025-09-17T03:53:25.435604] [DEBUG] [LOCAL ] FXED: Primary data saved (1193 records). [2025-09-17T03:53:25.435777] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-17T03:53:25.435881] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FXED took 17.9s. Estimated remaining: 3h 36m 3s. Rate: 6.9 symbols/min [2025-09-17T03:53:25.495375] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-11. [2025-09-17T03:53:25.624018] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:25.631657] [DEBUG] [LOCAL ] GAM: Loaded 2806 existing records from primary storage. [2025-09-17T03:53:25.631844] [INFO ] [MAIN ] GAM: Loaded 2806 existing records. [2025-09-17T03:53:25.832765] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:25.833156] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-17T03:53:25.833238] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-17T03:53:25.833523] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-17T03:53:25.833595] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-17T03:53:26.229915] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:26.290156] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-11. [2025-09-17T03:53:26.564581] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T03:53:27.039352] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:53:27.090184] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-17T03:53:27.890206] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-17T03:53:28.690115] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-17T03:53:28.727760] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:53:29.193088] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T03:53:29.490248] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-17T03:53:30.160080] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:53:30.167655] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:53:30.170694] [INFO ] [REMOTE ] FVRR: Full fetch complete (58722 records). [2025-09-17T03:53:30.170881] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-17T03:53:30.295287] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-17T03:53:30.597960] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-17T03:53:30.598123] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-17T03:53:30.599447] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-17T03:53:30.599528] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-17T03:53:30.601268] [DEBUG] [LOCAL ] FVRR: Trimmed 58722 records to 40162 (keeping 200 days of data) [2025-09-17T03:53:30.875501] [DEBUG] [LOCAL ] FVRR: Primary data saved (40162 records). [2025-09-17T03:53:30.875739] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-17T03:53:30.875859] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FVRR took 41.4s. Estimated remaining: 3h 35m 49s. Rate: 6.9 symbols/min [2025-09-17T03:53:31.053957] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:31.101004] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-17T03:53:31.105511] [DEBUG] [LOCAL ] GAP: Loaded 40007 existing records from primary storage. [2025-09-17T03:53:31.105699] [INFO ] [MAIN ] GAP: Loaded 40007 existing records. [2025-09-17T03:53:31.282222] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:31.282518] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-17T03:53:31.282572] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-17T03:53:31.283485] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-17T03:53:31.283546] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-17T03:53:31.635756] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:31.890128] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-11. [2025-09-17T03:53:31.895828] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T03:53:32.032291] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T03:53:32.690178] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-17T03:53:33.330945] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T03:53:33.490139] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-17T03:53:33.847228] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T03:53:34.290163] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-17T03:53:34.871401] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T03:53:34.903481] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:53:35.090140] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-17T03:53:35.890193] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-17T03:53:36.244778] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T03:53:36.534800] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T03:53:36.690103] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-17T03:53:37.490127] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-17T03:53:37.865999] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T03:53:38.290127] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-17T03:53:39.090184] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-17T03:53:39.234537] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T03:53:39.597402] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T03:53:39.890162] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-17T03:53:40.478307] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:53:40.690133] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-17T03:53:40.734031] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:53:41.490198] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-17T03:53:42.290096] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-17T03:53:42.420046] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:53:42.882486] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:53:43.090195] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-17T03:53:43.321056] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T03:53:43.890160] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-17T03:53:44.690120] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-17T03:53:44.788111] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T03:53:45.490179] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-17T03:53:45.696671] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T03:53:46.074373] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:53:46.290131] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-17T03:53:46.745000] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T03:53:47.096941] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-17T03:53:47.101202] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T03:53:47.744101] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:53:47.890140] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-17T03:53:48.480062] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T03:53:48.690116] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-17T03:53:49.251970] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T03:53:49.253084] [INFO ] [REMOTE ] GAM: Full fetch complete (7010 records). [2025-09-17T03:53:49.253170] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-17T03:53:49.497590] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-17T03:53:49.617968] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-17T03:53:49.618092] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-17T03:53:49.618318] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-17T03:53:49.618411] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-17T03:53:49.619104] [DEBUG] [LOCAL ] GAM: Trimmed 7010 records to 4400 (keeping 200 days of data) [2025-09-17T03:53:49.647678] [DEBUG] [LOCAL ] GAM: Primary data saved (4400 records). [2025-09-17T03:53:49.647869] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-17T03:53:49.648005] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. GAM took 24.2s. Estimated remaining: 3h 35m 57s. Rate: 6.9 symbols/min [2025-09-17T03:53:49.817543] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:49.835867] [DEBUG] [LOCAL ] GATX: Loaded 13206 existing records from primary storage. [2025-09-17T03:53:49.836058] [INFO ] [MAIN ] GATX: Loaded 13206 existing records. [2025-09-17T03:53:50.012916] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:50.013207] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-17T03:53:50.013267] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-17T03:53:50.013772] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-17T03:53:50.013832] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-17T03:53:50.295360] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-17T03:53:50.383490] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:51.090109] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-17T03:53:51.639831] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T03:53:51.714506] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T03:53:51.890146] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-17T03:53:52.599909] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T03:53:52.606671] [INFO ] [REMOTE ] G: Full fetch complete (71349 records). [2025-09-17T03:53:52.606838] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-17T03:53:52.695271] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-11. [2025-09-17T03:53:53.021472] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-17T03:53:53.021673] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-17T03:53:53.023109] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-17T03:53:53.023214] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-17T03:53:53.025471] [DEBUG] [LOCAL ] G: Trimmed 71349 records to 49760 (keeping 200 days of data) [2025-09-17T03:53:53.190932] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:53:53.410980] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T03:53:53.426049] [DEBUG] [LOCAL ] G: Primary data saved (49760 records). [2025-09-17T03:53:53.426301] [INFO ] [MAIN ] G: Full history saved. [2025-09-17T03:53:53.426444] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. G took 43.5s. Estimated remaining: 3h 35m 40s. Rate: 6.9 symbols/min [2025-09-17T03:53:53.495271] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-17T03:53:53.609484] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:53.623833] [DEBUG] [LOCAL ] GBAB: Loaded 9666 existing records from primary storage. [2025-09-17T03:53:53.624079] [INFO ] [MAIN ] GBAB: Loaded 9666 existing records. [2025-09-17T03:53:53.822795] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:53.823168] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-17T03:53:53.823226] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-17T03:53:53.823783] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-17T03:53:53.823857] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-17T03:53:54.204929] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:54.290177] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-11. [2025-09-17T03:53:55.090228] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-17T03:53:55.323469] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:53:55.516940] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T03:53:55.777984] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:53:55.890156] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-17T03:53:56.690112] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-17T03:53:56.743215] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T03:53:57.490102] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-17T03:53:57.805491] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T03:53:58.290171] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-17T03:53:59.090200] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-17T03:53:59.409251] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T03:53:59.415026] [INFO ] [REMOTE ] GAB: Full fetch complete (38989 records). [2025-09-17T03:53:59.415249] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-17T03:53:59.810279] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-17T03:53:59.901234] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-17T03:53:59.926071] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T03:53:59.979608] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-17T03:53:59.979741] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-17T03:53:59.980363] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-17T03:53:59.980420] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-17T03:53:59.981492] [DEBUG] [LOCAL ] GAB: Trimmed 38989 records to 27670 (keeping 200 days of data) [2025-09-17T03:54:00.147603] [DEBUG] [LOCAL ] GAB: Primary data saved (27670 records). [2025-09-17T03:54:00.147789] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-17T03:54:00.147888] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAB took 41.0s. Estimated remaining: 3h 35m 28s. Rate: 6.9 symbols/min [2025-09-17T03:54:00.325370] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:00.356757] [DEBUG] [LOCAL ] GBCI: Loaded 29687 existing records from primary storage. [2025-09-17T03:54:00.356968] [INFO ] [MAIN ] GBCI: Loaded 29687 existing records. [2025-09-17T03:54:00.535923] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:00.536175] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-17T03:54:00.536248] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-17T03:54:00.537046] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-17T03:54:00.537126] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-17T03:54:00.699477] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-17T03:54:00.914462] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:01.174999] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:54:01.490143] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-17T03:54:01.916336] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T03:54:02.290203] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-17T03:54:02.548807] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T03:54:03.090133] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-17T03:54:03.890177] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-11. [2025-09-17T03:54:03.982693] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:54:04.690148] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-17T03:54:05.124355] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T03:54:05.495612] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-17T03:54:05.500147] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:54:06.290127] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-17T03:54:06.586581] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T03:54:06.633295] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T03:54:07.090136] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-17T03:54:07.712543] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T03:54:07.736784] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T03:54:07.890152] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-17T03:54:08.690200] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-17T03:54:09.055595] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:54:09.490150] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-17T03:54:10.188674] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:54:10.290093] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-17T03:54:10.575396] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T03:54:11.090128] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-17T03:54:11.803421] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:54:11.890140] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-17T03:54:12.690142] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-17T03:54:12.994412] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:54:13.105209] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T03:54:13.490191] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-17T03:54:14.192064] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T03:54:14.290168] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-17T03:54:15.090213] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-17T03:54:15.489947] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:54:15.890177] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-17T03:54:15.992190] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T03:54:16.067500] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T03:54:16.690180] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-17T03:54:16.791604] [DEBUG] [REMOTE ] GBAB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-17T03:54:16.792040] [WARN ] [REMOTE ] GBAB: No data returned for month 2025-05 [2025-09-17T03:54:17.379004] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T03:54:17.385706] [INFO ] [REMOTE ] GAP: Full fetch complete (77493 records). [2025-09-17T03:54:17.385869] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-17T03:54:17.495206] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-17T03:54:17.781362] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-17T03:54:17.781496] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-17T03:54:17.782615] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-17T03:54:17.782752] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-17T03:54:17.784550] [DEBUG] [LOCAL ] GAP: Trimmed 77493 records to 53655 (keeping 200 days of data) [2025-09-17T03:54:18.121532] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-17T03:54:18.121761] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-17T03:54:18.121896] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GAP took 47.2s. Estimated remaining: 3h 35m 34s. Rate: 6.9 symbols/min [2025-09-17T03:54:18.290686] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-17T03:54:18.292039] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:18.292980] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-17T03:54:18.293053] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-17T03:54:18.293205] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-17T03:54:18.293282] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-17T03:54:18.293355] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-17T03:54:18.293421] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-17T03:54:18.654728] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:19.063881] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T03:54:19.080675] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T03:54:19.090063] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-17T03:54:19.890149] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-17T03:54:20.120425] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:54:20.690144] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-11. [2025-09-17T03:54:20.964093] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-11 (0.27 seconds). [2025-09-17T03:54:21.330004] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T03:54:21.490175] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-17T03:54:22.290202] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-17T03:54:23.090139] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-17T03:54:23.376608] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T03:54:23.379581] [INFO ] [REMOTE ] GATX: Full fetch complete (25159 records). [2025-09-17T03:54:23.379718] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-17T03:54:23.774600] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-17T03:54:23.790716] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-17T03:54:23.791349] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-17T03:54:23.791611] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-17T03:54:23.793972] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T03:54:23.804508] [DEBUG] [LOCAL ] GATX: Trimmed 25159 records to 17895 (keeping 200 days of data) [2025-09-17T03:54:23.891694] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-17T03:54:23.924736] [DEBUG] [LOCAL ] GATX: Primary data saved (17895 records). [2025-09-17T03:54:23.924914] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-17T03:54:23.925018] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GATX took 34.3s. Estimated remaining: 3h 35m 21s. Rate: 6.9 symbols/min [2025-09-17T03:54:24.027480] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T03:54:24.100605] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:24.129005] [DEBUG] [LOCAL ] GBTG: Loaded 30025 existing records from primary storage. [2025-09-17T03:54:24.129186] [INFO ] [MAIN ] GBTG: Loaded 30025 existing records. [2025-09-17T03:54:24.315696] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:24.316001] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-17T03:54:24.316070] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-17T03:54:24.316833] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-17T03:54:24.316904] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-17T03:54:24.674775] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:24.690121] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-17T03:54:25.052472] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T03:54:25.420613] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T03:54:25.490077] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-17T03:54:26.290180] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-17T03:54:26.792752] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T03:54:26.798114] [INFO ] [REMOTE ] GBCI: Full fetch complete (57280 records). [2025-09-17T03:54:26.798271] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-17T03:54:27.096757] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-11. [2025-09-17T03:54:27.225721] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-17T03:54:27.234174] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-17T03:54:27.235676] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-17T03:54:27.235800] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-17T03:54:27.237201] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T03:54:27.242587] [DEBUG] [LOCAL ] GBCI: Trimmed 57280 records to 40052 (keeping 200 days of data) [2025-09-17T03:54:27.519765] [DEBUG] [LOCAL ] GBCI: Primary data saved (40052 records). [2025-09-17T03:54:27.519991] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-17T03:54:27.520114] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GBCI took 27.4s. Estimated remaining: 3h 35m 3s. Rate: 6.9 symbols/min [2025-09-17T03:54:27.713543] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:27.735289] [DEBUG] [LOCAL ] GBX: Loaded 20479 existing records from primary storage. [2025-09-17T03:54:27.735621] [INFO ] [MAIN ] GBX: Loaded 20479 existing records. [2025-09-17T03:54:27.895340] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-17T03:54:27.929532] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:27.929911] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-17T03:54:27.929981] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-17T03:54:27.930873] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-17T03:54:27.930944] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-17T03:54:28.309983] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:28.686172] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:54:28.688833] [INFO ] [REMOTE ] GBAB: Full fetch complete (19144 records). [2025-09-17T03:54:28.689023] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-17T03:54:28.700751] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-17T03:54:28.895722] [WARN ] [VALIDATOR ] GBAB: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:54:28.896509] [FATAL] [MAIN ] GBAB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:54:28.896579] [WARN ] [MAIN ] GBAB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:54:28.896634] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-17T03:54:28.896730] [DEBUG] [LOCAL ] GBAB: No primary data file found to delete. [2025-09-17T03:54:28.896773] [INFO ] [LOCAL ] GBAB: Starting deletion of derivative data. [2025-09-17T03:54:28.897194] [DEBUG] [LOCAL ] GBAB: Deleted derivative data file. [2025-09-17T03:54:28.897312] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBAB took 35.5s. Estimated remaining: 3h 34m 42s. Rate: 6.9 symbols/min [2025-09-17T03:54:29.008439] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T03:54:29.037070] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T03:54:29.111455] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:29.146221] [DEBUG] [LOCAL ] GCI: Loaded 32576 existing records from primary storage. [2025-09-17T03:54:29.146419] [INFO ] [MAIN ] GCI: Loaded 32576 existing records. [2025-09-17T03:54:29.323378] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:29.323662] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-17T03:54:29.323725] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-17T03:54:29.324350] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-17T03:54:29.324408] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-17T03:54:29.495388] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-17T03:54:29.709226] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:29.987610] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-17T03:54:30.290149] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-11. [2025-09-17T03:54:31.090148] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-17T03:54:31.455219] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T03:54:31.763124] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:54:31.890170] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-17T03:54:32.347449] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:54:32.690123] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-11. [2025-09-17T03:54:33.490223] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-17T03:54:33.969564] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T03:54:34.290168] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-17T03:54:34.986396] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T03:54:35.090135] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-17T03:54:35.269186] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T03:54:35.890112] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-17T03:54:36.256223] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T03:54:36.273890] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T03:54:36.690182] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-17T03:54:37.490171] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-17T03:54:38.274712] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T03:54:38.290076] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-17T03:54:38.906113] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:54:39.090172] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-17T03:54:39.770224] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T03:54:39.890163] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-17T03:54:40.467675] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T03:54:40.690134] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-17T03:54:41.186373] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T03:54:41.206179] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:54:41.490150] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-17T03:54:42.290152] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-17T03:54:43.019511] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T03:54:43.090112] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-17T03:54:43.669526] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T03:54:43.890148] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-17T03:54:44.361158] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T03:54:44.549751] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T03:54:44.690128] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-17T03:54:45.490158] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-17T03:54:46.019229] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T03:54:46.290145] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-17T03:54:46.568749] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-17T03:54:46.569536] [INFO ] [REMOTE ] GBLI: Full fetch complete (1451 records). [2025-09-17T03:54:46.569631] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-17T03:54:46.757458] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-17T03:54:46.757722] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:54:46.757797] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:54:46.757867] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-17T03:54:46.757961] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-17T03:54:46.758028] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-17T03:54:46.758102] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-17T03:54:46.758194] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GBLI took 28.6s. Estimated remaining: 3h 34m 49s. Rate: 6.9 symbols/min [2025-09-17T03:54:46.939386] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:46.979991] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:54:47.006872] [DEBUG] [LOCAL ] GCO: Loaded 17442 existing records from primary storage. [2025-09-17T03:54:47.007044] [INFO ] [MAIN ] GCO: Loaded 17442 existing records. [2025-09-17T03:54:47.095298] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-17T03:54:47.192419] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:47.192701] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-17T03:54:47.192779] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-17T03:54:47.193270] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-17T03:54:47.193343] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-17T03:54:47.549034] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:47.890147] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-11. [2025-09-17T03:54:48.484759] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T03:54:48.690139] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-17T03:54:48.918933] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:54:49.490129] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-17T03:54:50.291471] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-17T03:54:50.300061] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:54:51.090199] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-17T03:54:51.248982] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:54:51.380751] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T03:54:51.890206] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-17T03:54:52.690159] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-17T03:54:52.863514] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:54:53.013596] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T03:54:53.490145] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-17T03:54:53.540514] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T03:54:54.290171] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-17T03:54:54.586248] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:54:55.090190] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-17T03:54:55.790929] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:54:55.890142] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-17T03:54:56.170263] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:54:56.690141] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-17T03:54:57.285607] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:54:57.291197] [INFO ] [REMOTE ] GCI: Full fetch complete (62857 records). [2025-09-17T03:54:57.291396] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-17T03:54:57.504835] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-17T03:54:57.734835] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-17T03:54:57.735422] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:54:57.735612] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-17T03:54:57.741159] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-17T03:54:57.741388] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-17T03:54:57.742715] [DEBUG] [LOCAL ] GCI: Trimmed 62857 records to 44240 (keeping 200 days of data) [2025-09-17T03:54:57.991893] [DEBUG] [LOCAL ] GCI: Primary data saved (44240 records). [2025-09-17T03:54:57.992107] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-17T03:54:57.992214] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GCI took 29.1s. Estimated remaining: 3h 34m 44s. Rate: 6.9 symbols/min [2025-09-17T03:54:58.174900] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:58.192800] [DEBUG] [LOCAL ] GCTS: Loaded 15587 existing records from primary storage. [2025-09-17T03:54:58.192989] [INFO ] [MAIN ] GCTS: Loaded 15587 existing records. [2025-09-17T03:54:58.295310] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-17T03:54:58.397295] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:58.397604] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-17T03:54:58.397683] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-17T03:54:58.398174] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-17T03:54:58.398236] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-17T03:54:58.762896] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:59.000894] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T03:54:59.090147] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-11. [2025-09-17T03:54:59.873947] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T03:54:59.890750] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-17T03:54:59.894811] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:55:00.690122] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-17T03:55:01.320770] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:55:01.490192] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-17T03:55:02.220578] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T03:55:02.290132] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-17T03:55:02.792829] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T03:55:03.090147] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-17T03:55:03.533837] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T03:55:03.890134] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-17T03:55:04.605728] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:55:04.672722] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T03:55:04.690095] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-17T03:55:05.490134] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-17T03:55:05.704121] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:55:06.290144] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-17T03:55:06.723987] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T03:55:07.090136] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-17T03:55:07.441410] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:55:07.890158] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-17T03:55:08.144141] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T03:55:08.690107] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-17T03:55:08.931842] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T03:55:08.935513] [INFO ] [REMOTE ] GBX: Full fetch complete (42535 records). [2025-09-17T03:55:08.935719] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-17T03:55:09.341478] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-17T03:55:09.341623] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-17T03:55:09.342375] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-17T03:55:09.342461] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-17T03:55:09.343690] [DEBUG] [LOCAL ] GBX: Trimmed 42535 records to 29493 (keeping 200 days of data) [2025-09-17T03:55:09.498000] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-17T03:55:09.530664] [DEBUG] [LOCAL ] GBX: Primary data saved (29493 records). [2025-09-17T03:55:09.530783] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-17T03:55:09.530880] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBX took 42.0s. Estimated remaining: 3h 34m 40s. Rate: 6.9 symbols/min [2025-09-17T03:55:09.702403] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:09.702591] [DEBUG] [LOCAL ] GCV: No existing data file found in primary storage. [2025-09-17T03:55:09.702639] [WARN ] [MAIN ] GCV: No existing data found, performing full refresh instead. [2025-09-17T03:55:09.702768] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-17T03:55:09.702817] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-17T03:55:09.702876] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-09-17T03:55:09.702918] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-17T03:55:10.060379] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:10.072587] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:55:10.290122] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-17T03:55:10.506258] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:55:11.090151] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-11. [2025-09-17T03:55:11.358669] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T03:55:11.362171] [INFO ] [REMOTE ] GCO: Full fetch complete (36079 records). [2025-09-17T03:55:11.362306] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-17T03:55:11.738829] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-17T03:55:11.738934] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-17T03:55:11.739507] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-17T03:55:11.739566] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-17T03:55:11.740401] [DEBUG] [LOCAL ] GCO: Trimmed 36079 records to 25949 (keeping 200 days of data) [2025-09-17T03:55:11.848938] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T03:55:11.892974] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-17T03:55:11.903276] [DEBUG] [LOCAL ] GCO: Primary data saved (25949 records). [2025-09-17T03:55:11.903377] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-17T03:55:11.903468] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GCO took 25.1s. Estimated remaining: 3h 34m 21s. Rate: 6.9 symbols/min [2025-09-17T03:55:12.075053] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:12.109609] [DEBUG] [LOCAL ] GD: Loaded 34593 existing records from primary storage. [2025-09-17T03:55:12.109811] [INFO ] [MAIN ] GD: Loaded 34593 existing records. [2025-09-17T03:55:12.290049] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:12.290365] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-17T03:55:12.290425] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-17T03:55:12.291236] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-17T03:55:12.291299] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-17T03:55:12.653307] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:12.690107] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-11. [2025-09-17T03:55:13.320167] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:55:13.490166] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-17T03:55:14.160688] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T03:55:14.290135] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-17T03:55:14.468587] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T03:55:15.090194] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-17T03:55:15.176528] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T03:55:15.890153] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-17T03:55:16.239878] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:55:16.245062] [INFO ] [REMOTE ] GBTG: Full fetch complete (56594 records). [2025-09-17T03:55:16.245197] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-17T03:55:16.626662] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-17T03:55:16.626771] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-17T03:55:16.627542] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-17T03:55:16.627611] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-17T03:55:16.629079] [DEBUG] [LOCAL ] GBTG: Trimmed 56594 records to 40681 (keeping 200 days of data) [2025-09-17T03:55:16.713176] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-17T03:55:16.867054] [DEBUG] [LOCAL ] GBTG: Primary data saved (40681 records). [2025-09-17T03:55:16.867259] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-17T03:55:16.867392] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GBTG took 52.9s. Estimated remaining: 3h 34m 6s. Rate: 6.9 symbols/min [2025-09-17T03:55:17.038403] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:17.053716] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:55:17.095897] [DEBUG] [LOCAL ] GDDY: Loaded 36908 existing records from primary storage. [2025-09-17T03:55:17.096093] [INFO ] [MAIN ] GDDY: Loaded 36908 existing records. [2025-09-17T03:55:17.272974] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:17.273258] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-17T03:55:17.273335] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-17T03:55:17.274241] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-17T03:55:17.274347] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-17T03:55:17.496219] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-17T03:55:17.642099] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:18.143939] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T03:55:18.290207] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-17T03:55:18.595218] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T03:55:18.885993] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:55:19.090176] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-17T03:55:19.890149] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-17T03:55:20.322114] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:55:20.690124] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-17T03:55:21.490168] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-11. [2025-09-17T03:55:21.759295] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T03:55:22.178921] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:55:22.290135] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-17T03:55:23.090101] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-17T03:55:23.173049] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T03:55:23.194030] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T03:55:23.890138] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-17T03:55:24.690202] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-17T03:55:24.892492] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:55:25.160804] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:55:25.490170] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-17T03:55:25.777510] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T03:55:26.169485] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T03:55:26.290148] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-17T03:55:27.090166] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-17T03:55:27.890151] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-17T03:55:28.123888] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T03:55:28.156078] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T03:55:28.158953] [INFO ] [REMOTE ] GCTS: Full fetch complete (26486 records). [2025-09-17T03:55:28.159095] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-17T03:55:28.540705] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-17T03:55:28.540811] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-17T03:55:28.541315] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-17T03:55:28.541368] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-17T03:55:28.542255] [DEBUG] [LOCAL ] GCTS: Trimmed 26486 records to 19249 (keeping 200 days of data) [2025-09-17T03:55:28.650764] [DEBUG] [LOCAL ] GCTS: Primary data saved (19249 records). [2025-09-17T03:55:28.650954] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-17T03:55:28.651054] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCTS took 30.7s. Estimated remaining: 3h 34m 2s. Rate: 6.9 symbols/min [2025-09-17T03:55:28.695257] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-17T03:55:28.790808] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:55:28.868903] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:28.873662] [DEBUG] [LOCAL ] GDIV: Loaded 2606 existing records from primary storage. [2025-09-17T03:55:28.873771] [INFO ] [MAIN ] GDIV: Loaded 2606 existing records. [2025-09-17T03:55:29.059711] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:29.060026] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-17T03:55:29.060088] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-17T03:55:29.060346] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-17T03:55:29.060404] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-17T03:55:29.414748] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:29.490132] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-11. [2025-09-17T03:55:30.002538] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T03:55:30.290120] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-17T03:55:30.354173] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:55:30.869272] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T03:55:31.090186] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-17T03:55:31.890176] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-17T03:55:32.462923] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T03:55:32.690220] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-17T03:55:32.865789] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T03:55:33.490186] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-17T03:55:34.290202] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-17T03:55:34.647967] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T03:55:34.948914] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:55:35.090168] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-17T03:55:35.224498] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:55:35.890173] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-17T03:55:35.908043] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:55:36.480214] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:55:36.690181] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-17T03:55:37.490211] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-17T03:55:38.105018] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T03:55:38.290173] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-17T03:55:38.460013] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:55:38.979090] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:55:39.090160] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-17T03:55:39.673595] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T03:55:39.890128] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-17T03:55:40.690224] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-17T03:55:41.490104] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-17T03:55:41.604159] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T03:55:42.073617] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T03:55:42.290118] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-17T03:55:42.349156] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T03:55:42.819218] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T03:55:43.090159] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-17T03:55:43.840059] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T03:55:43.890188] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-17T03:55:44.690252] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-17T03:55:45.490149] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-17T03:55:45.616318] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:55:45.875695] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T03:55:46.290201] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-17T03:55:46.378677] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T03:55:47.090154] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-17T03:55:47.105500] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:55:47.107341] [INFO ] [REMOTE ] GCV: Full fetch complete (9271 records). [2025-09-17T03:55:47.107458] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-17T03:55:47.478276] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-17T03:55:47.478437] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-17T03:55:47.478805] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-17T03:55:47.478871] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-17T03:55:47.479792] [DEBUG] [LOCAL ] GCV: Trimmed 9271 records to 7027 (keeping 200 days of data) [2025-09-17T03:55:47.523425] [DEBUG] [LOCAL ] GCV: Primary data saved (7027 records). [2025-09-17T03:55:47.523593] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-17T03:55:47.523741] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GCV took 38.0s. Estimated remaining: 3h 34m 10s. Rate: 6.9 symbols/min [2025-09-17T03:55:47.693725] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:47.693956] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-17T03:55:47.694001] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-17T03:55:47.694111] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-17T03:55:47.694168] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-17T03:55:47.694219] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-17T03:55:47.694268] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-17T03:55:47.901449] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-17T03:55:48.060131] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:48.479382] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T03:55:48.690107] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-17T03:55:48.853483] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T03:55:49.158452] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T03:55:49.159473] [INFO ] [REMOTE ] GDIV: Full fetch complete (5445 records). [2025-09-17T03:55:49.159584] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-17T03:55:49.495360] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-17T03:55:49.534678] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-17T03:55:49.534785] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-17T03:55:49.534999] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-17T03:55:49.535075] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-17T03:55:49.535562] [DEBUG] [LOCAL ] GDIV: Trimmed 5445 records to 3794 (keeping 200 days of data) [2025-09-17T03:55:49.560890] [DEBUG] [LOCAL ] GDIV: Primary data saved (3794 records). [2025-09-17T03:55:49.561086] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-17T03:55:49.561218] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GDIV took 20.9s. Estimated remaining: 3h 33m 50s. Rate: 6.9 symbols/min [2025-09-17T03:55:49.729965] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:49.738658] [DEBUG] [LOCAL ] GDO: Loaded 4393 existing records from primary storage. [2025-09-17T03:55:49.738790] [INFO ] [MAIN ] GDO: Loaded 4393 existing records. [2025-09-17T03:55:49.918500] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:49.918808] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-17T03:55:49.918882] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-17T03:55:49.919223] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-17T03:55:49.919297] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-17T03:55:50.274396] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:50.290135] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-11. [2025-09-17T03:55:51.090151] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-11. [2025-09-17T03:55:51.145005] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T03:55:51.409558] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T03:55:51.417554] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T03:55:51.890137] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-17T03:55:52.447096] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T03:55:52.690155] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-17T03:55:53.185444] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:55:53.490155] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-17T03:55:53.947036] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:55:54.290194] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-17T03:55:54.802086] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T03:55:55.090160] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-17T03:55:55.586406] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T03:55:55.890175] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-17T03:55:56.690182] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-17T03:55:57.213730] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T03:55:57.490133] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-17T03:55:57.734468] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T03:55:57.962217] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:55:58.290143] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-17T03:55:59.092686] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-17T03:55:59.095247] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:55:59.890148] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-17T03:56:00.476564] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:56:00.690183] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-17T03:56:00.751956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T03:56:01.490317] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-17T03:56:01.539440] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T03:56:02.047554] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T03:56:02.290189] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-17T03:56:02.746035] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T03:56:02.747122] [INFO ] [REMOTE ] GDL: Full fetch complete (3530 records). [2025-09-17T03:56:02.747210] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-17T03:56:02.931078] [WARN ] [VALIDATOR ] GDL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T03:56:02.931329] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:56:02.931418] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:56:02.931489] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-17T03:56:02.931626] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-17T03:56:02.931737] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-17T03:56:02.931813] [DEBUG] [LOCAL ] GDL: No derivative data file found to delete. [2025-09-17T03:56:02.931926] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GDL took 15.4s. Estimated remaining: 3h 33m 49s. Rate: 6.9 symbols/min [2025-09-17T03:56:03.095962] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-17T03:56:03.109609] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:03.110821] [DEBUG] [LOCAL ] GDOT: No existing data file found in primary storage. [2025-09-17T03:56:03.110917] [WARN ] [MAIN ] GDOT: No existing data found, performing full refresh instead. [2025-09-17T03:56:03.111050] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-17T03:56:03.111113] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-17T03:56:03.111165] [DEBUG] [LOCAL ] GDOT: No primary data file found to delete. [2025-09-17T03:56:03.111208] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-17T03:56:03.482512] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:03.890156] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-17T03:56:04.491750] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:56:04.690108] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-17T03:56:04.735210] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T03:56:04.742967] [INFO ] [REMOTE ] GD: Full fetch complete (70526 records). [2025-09-17T03:56:04.743175] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-17T03:56:05.144455] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-17T03:56:05.144624] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-17T03:56:05.145687] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-17T03:56:05.145773] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-17T03:56:05.147416] [DEBUG] [LOCAL ] GD: Trimmed 70526 records to 47545 (keeping 200 days of data) [2025-09-17T03:56:05.452847] [DEBUG] [LOCAL ] GD: Primary data saved (47545 records). [2025-09-17T03:56:05.453033] [INFO ] [MAIN ] GD: Full history saved. [2025-09-17T03:56:05.453148] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GD took 53.5s. Estimated remaining: 3h 33m 30s. Rate: 6.9 symbols/min [2025-09-17T03:56:05.496978] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-17T03:56:05.630070] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:05.645594] [DEBUG] [LOCAL ] GDV: Loaded 14371 existing records from primary storage. [2025-09-17T03:56:05.645791] [INFO ] [MAIN ] GDV: Loaded 14371 existing records. [2025-09-17T03:56:05.829499] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:05.829903] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-17T03:56:05.829988] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-17T03:56:05.830516] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-17T03:56:05.830577] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-17T03:56:06.249899] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:06.256841] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T03:56:06.290111] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-11. [2025-09-17T03:56:06.345838] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T03:56:06.353059] [INFO ] [REMOTE ] GDDY: Full fetch complete (71087 records). [2025-09-17T03:56:06.353228] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-17T03:56:06.780397] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-17T03:56:06.780540] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-17T03:56:06.781507] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-17T03:56:06.781588] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-17T03:56:06.783190] [DEBUG] [LOCAL ] GDDY: Trimmed 71087 records to 49859 (keeping 200 days of data) [2025-09-17T03:56:07.090388] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-11. [2025-09-17T03:56:07.106773] [DEBUG] [LOCAL ] GDDY: Primary data saved (49859 records). [2025-09-17T03:56:07.106949] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-17T03:56:07.107069] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDDY took 50.2s. Estimated remaining: 3h 33m 10s. Rate: 6.9 symbols/min [2025-09-17T03:56:07.291209] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:07.291517] [DEBUG] [LOCAL ] GE: No existing data file found in primary storage. [2025-09-17T03:56:07.291620] [WARN ] [MAIN ] GE: No existing data found, performing full refresh instead. [2025-09-17T03:56:07.298483] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-17T03:56:07.309753] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-17T03:56:07.309941] [DEBUG] [LOCAL ] GE: No primary data file found to delete. [2025-09-17T03:56:07.310281] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-17T03:56:07.317060] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:56:07.695170] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:07.890138] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-11. [2025-09-17T03:56:08.537529] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T03:56:08.690133] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-17T03:56:09.490154] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-17T03:56:10.002697] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T03:56:10.033191] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T03:56:10.290180] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-17T03:56:10.563788] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T03:56:11.090137] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-17T03:56:11.890123] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-17T03:56:12.070755] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T03:56:12.508387] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T03:56:12.690125] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-17T03:56:12.921296] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T03:56:13.401370] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T03:56:13.490148] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-17T03:56:14.136198] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T03:56:14.290183] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-17T03:56:14.940318] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T03:56:15.090130] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-17T03:56:15.683187] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:56:15.890154] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-17T03:56:16.690149] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-17T03:56:16.886190] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T03:56:17.490180] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-17T03:56:18.290182] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-17T03:56:18.395377] [DEBUG] [REMOTE ] GDO: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-17T03:56:18.395838] [WARN ] [REMOTE ] GDO: No data returned for month 2025-08 [2025-09-17T03:56:18.708123] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T03:56:18.822871] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T03:56:19.090135] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-17T03:56:19.890137] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-17T03:56:20.553242] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:56:20.554771] [INFO ] [REMOTE ] GDO: Full fetch complete (8596 records). [2025-09-17T03:56:20.554866] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-17T03:56:20.694968] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-17T03:56:20.755287] [WARN ] [VALIDATOR ] GDO: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:56:20.756106] [FATAL] [MAIN ] GDO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:56:20.756242] [WARN ] [MAIN ] GDO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:56:20.756306] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-17T03:56:20.756404] [DEBUG] [LOCAL ] GDO: No primary data file found to delete. [2025-09-17T03:56:20.756586] [INFO ] [LOCAL ] GDO: Starting deletion of derivative data. [2025-09-17T03:56:20.757006] [DEBUG] [LOCAL ] GDO: Deleted derivative data file. [2025-09-17T03:56:20.757127] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDO took 31.2s. Estimated remaining: 3h 33m 9s. Rate: 6.9 symbols/min [2025-09-17T03:56:20.959261] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T03:56:20.961634] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:20.989678] [DEBUG] [LOCAL ] GEF: Loaded 15462 existing records from primary storage. [2025-09-17T03:56:20.989925] [INFO ] [MAIN ] GEF: Loaded 15462 existing records. [2025-09-17T03:56:21.170910] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:21.171182] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-17T03:56:21.171241] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-17T03:56:21.171758] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-17T03:56:21.171818] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-17T03:56:21.496159] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-17T03:56:21.537890] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:22.290152] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-17T03:56:22.614892] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:56:22.773200] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T03:56:23.090197] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-11. [2025-09-17T03:56:23.407278] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T03:56:23.839056] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:56:23.890135] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-17T03:56:24.690121] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-17T03:56:25.012757] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T03:56:25.490172] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-17T03:56:26.065615] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:56:26.290209] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-17T03:56:27.090118] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-17T03:56:27.401451] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T03:56:27.451806] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T03:56:27.890156] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-17T03:56:28.185760] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T03:56:28.690154] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-17T03:56:28.950169] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T03:56:29.490146] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-17T03:56:29.561665] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T03:56:30.290133] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-17T03:56:31.090156] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-17T03:56:31.401130] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T03:56:31.536587] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T03:56:31.890154] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-17T03:56:32.166635] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:56:32.690182] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-17T03:56:33.490188] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-17T03:56:33.815211] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T03:56:34.119521] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T03:56:34.290162] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-17T03:56:34.899716] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T03:56:35.090135] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-17T03:56:35.396848] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T03:56:35.890140] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-17T03:56:36.602911] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:56:36.690144] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-17T03:56:37.490141] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-17T03:56:38.138636] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T03:56:38.178578] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T03:56:38.290121] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-17T03:56:38.515544] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T03:56:39.090127] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-17T03:56:39.466877] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:56:39.471792] [INFO ] [REMOTE ] GDOT: Full fetch complete (51958 records). [2025-09-17T03:56:39.471935] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-17T03:56:39.856698] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-17T03:56:39.856813] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-17T03:56:39.857523] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-17T03:56:39.857581] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-17T03:56:39.859360] [DEBUG] [LOCAL ] GDOT: Trimmed 51958 records to 38629 (keeping 200 days of data) [2025-09-17T03:56:39.913811] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-17T03:56:40.095021] [DEBUG] [LOCAL ] GDOT: Primary data saved (38629 records). [2025-09-17T03:56:40.095219] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-17T03:56:40.095313] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDOT took 37.2s. Estimated remaining: 3h 33m 17s. Rate: 6.9 symbols/min [2025-09-17T03:56:40.265073] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:40.289106] [DEBUG] [LOCAL ] GEL: Loaded 24970 existing records from primary storage. [2025-09-17T03:56:40.289282] [INFO ] [MAIN ] GEL: Loaded 24970 existing records. [2025-09-17T03:56:40.469125] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:40.469484] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-17T03:56:40.469727] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-17T03:56:40.476277] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-17T03:56:40.485503] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-17T03:56:40.532528] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T03:56:40.695265] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-17T03:56:40.812222] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:56:40.885491] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:41.490190] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-17T03:56:42.290224] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-17T03:56:42.418176] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T03:56:42.421594] [INFO ] [REMOTE ] GDV: Full fetch complete (28932 records). [2025-09-17T03:56:42.421833] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-17T03:56:42.814751] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-17T03:56:42.814860] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-17T03:56:42.815527] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-17T03:56:42.815582] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-17T03:56:42.816317] [DEBUG] [LOCAL ] GDV: Trimmed 28932 records to 20043 (keeping 200 days of data) [2025-09-17T03:56:42.937208] [DEBUG] [LOCAL ] GDV: Primary data saved (20043 records). [2025-09-17T03:56:42.937373] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-17T03:56:42.937473] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDV took 37.5s. Estimated remaining: 3h 32m 59s. Rate: 6.9 symbols/min [2025-09-17T03:56:43.099729] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-11. [2025-09-17T03:56:43.112054] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:43.154738] [DEBUG] [LOCAL ] GENI: Loaded 39386 existing records from primary storage. [2025-09-17T03:56:43.154929] [INFO ] [MAIN ] GENI: Loaded 39386 existing records. [2025-09-17T03:56:43.350401] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-17T03:56:43.392225] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:43.392476] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-17T03:56:43.392535] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-17T03:56:43.393492] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-17T03:56:43.393555] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-17T03:56:43.777617] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:43.778869] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:56:43.890114] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-17T03:56:44.557379] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T03:56:44.690119] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-11. [2025-09-17T03:56:44.935797] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T03:56:45.490146] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-17T03:56:46.290101] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-17T03:56:46.349232] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:56:46.649966] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T03:56:47.090141] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-17T03:56:47.890134] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-17T03:56:48.430824] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T03:56:48.690181] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-17T03:56:48.754899] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:56:48.805146] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:56:48.808921] [INFO ] [REMOTE ] GEF: Full fetch complete (29203 records). [2025-09-17T03:56:48.809082] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-17T03:56:49.194866] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-17T03:56:49.195004] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-17T03:56:49.195671] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-17T03:56:49.195835] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-17T03:56:49.196733] [DEBUG] [LOCAL ] GEF: Trimmed 29203 records to 20730 (keeping 200 days of data) [2025-09-17T03:56:49.330105] [DEBUG] [LOCAL ] GEF: Primary data saved (20730 records). [2025-09-17T03:56:49.330275] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-17T03:56:49.330381] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GEF took 28.6s. Estimated remaining: 3h 32m 46s. Rate: 6.9 symbols/min [2025-09-17T03:56:49.502473] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-17T03:56:49.511086] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:49.554483] [DEBUG] [LOCAL ] GEO: Loaded 38814 existing records from primary storage. [2025-09-17T03:56:49.554719] [INFO ] [MAIN ] GEO: Loaded 38814 existing records. [2025-09-17T03:56:49.735737] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:49.736003] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-17T03:56:49.736069] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-17T03:56:49.736927] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-17T03:56:49.736989] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-17T03:56:50.108470] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:50.131812] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:56:50.290144] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-11. [2025-09-17T03:56:51.090145] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-17T03:56:51.277962] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T03:56:51.890198] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-17T03:56:52.470436] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-17T03:56:52.500623] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:56:52.690136] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-17T03:56:53.490183] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-17T03:56:53.991207] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T03:56:53.997905] [INFO ] [REMOTE ] GE: Full fetch complete (77671 records). [2025-09-17T03:56:53.998071] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-17T03:56:54.293790] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-17T03:56:54.423540] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-17T03:56:54.423732] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-17T03:56:54.424808] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-17T03:56:54.424896] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-17T03:56:54.452313] [DEBUG] [LOCAL ] GE: Trimmed 77671 records to 53715 (keeping 200 days of data) [2025-09-17T03:56:54.453840] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:56:54.816084] [DEBUG] [LOCAL ] GE: Primary data saved (53715 records). [2025-09-17T03:56:54.816287] [INFO ] [MAIN ] GE: Full history saved. [2025-09-17T03:56:54.816412] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GE took 47.7s. Estimated remaining: 3h 32m 32s. Rate: 6.9 symbols/min [2025-09-17T03:56:55.011586] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:55.054901] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:56:55.093897] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-17T03:56:55.095452] [DEBUG] [LOCAL ] GES: Loaded 28333 existing records from primary storage. [2025-09-17T03:56:55.096755] [INFO ] [MAIN ] GES: Loaded 28333 existing records. [2025-09-17T03:56:55.301602] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:55.301917] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-17T03:56:55.301980] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-17T03:56:55.302814] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-17T03:56:55.302882] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-17T03:56:55.660283] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:55.890165] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-17T03:56:56.196357] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T03:56:56.236824] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:56:56.690189] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-17T03:56:57.490225] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-11. [2025-09-17T03:56:57.692444] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T03:56:58.290118] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-17T03:56:58.399170] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:56:58.605887] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T03:56:59.090193] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-17T03:56:59.890159] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-17T03:57:00.300223] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T03:57:00.596776] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:57:00.690106] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-17T03:57:01.356157] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T03:57:01.490132] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-17T03:57:02.290139] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-17T03:57:02.697812] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:57:03.090137] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-17T03:57:03.890164] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-17T03:57:04.315054] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-17T03:57:04.690130] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-17T03:57:05.121333] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-17T03:57:05.490285] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-17T03:57:05.490218] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-17T03:57:05.980038] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T03:57:06.117675] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-17T03:57:06.290135] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-17T03:57:07.090149] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-17T03:57:07.353867] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:57:07.740442] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T03:57:07.890151] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-17T03:57:08.690142] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-17T03:57:08.890750] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:57:09.490164] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-17T03:57:09.859084] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T03:57:10.268764] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:57:10.290073] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-17T03:57:11.090158] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-17T03:57:11.384568] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T03:57:11.890203] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-17T03:57:12.030813] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T03:57:12.324553] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:57:12.328354] [INFO ] [REMOTE ] GEL: Full fetch complete (48705 records). [2025-09-17T03:57:12.328460] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-17T03:57:12.720079] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-17T03:57:12.739112] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-17T03:57:12.739233] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-17T03:57:12.739968] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-17T03:57:12.740029] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-17T03:57:12.741431] [DEBUG] [LOCAL ] GEL: Trimmed 48705 records to 34694 (keeping 200 days of data) [2025-09-17T03:57:12.956567] [DEBUG] [LOCAL ] GEL: Primary data saved (34694 records). [2025-09-17T03:57:12.956786] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-17T03:57:12.956899] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GEL took 32.9s. Estimated remaining: 3h 32m 39s. Rate: 6.9 symbols/min [2025-09-17T03:57:13.138062] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:13.164732] [DEBUG] [LOCAL ] GETY: Loaded 25881 existing records from primary storage. [2025-09-17T03:57:13.164952] [INFO ] [MAIN ] GETY: Loaded 25881 existing records. [2025-09-17T03:57:13.351620] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:57:13.351883] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-17T03:57:13.351945] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-17T03:57:13.352682] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-17T03:57:13.352752] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-17T03:57:13.498750] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-17T03:57:13.732889] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:13.767766] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T03:57:14.212246] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T03:57:14.290171] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-11. [2025-09-17T03:57:15.090169] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-17T03:57:15.423527] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T03:57:15.484322] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:57:15.890148] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-17T03:57:16.690181] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-17T03:57:17.035622] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T03:57:17.490199] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-17T03:57:17.635967] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:57:17.642309] [INFO ] [REMOTE ] GENI: Full fetch complete (75246 records). [2025-09-17T03:57:17.642445] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-17T03:57:18.038019] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-17T03:57:18.038131] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-17T03:57:18.039168] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-17T03:57:18.039236] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-17T03:57:18.040793] [DEBUG] [LOCAL ] GENI: Trimmed 75246 records to 52869 (keeping 200 days of data) [2025-09-17T03:57:18.267714] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:57:18.290245] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-17T03:57:18.382521] [DEBUG] [LOCAL ] GENI: Primary data saved (52869 records). [2025-09-17T03:57:18.382732] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-17T03:57:18.382864] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GENI took 35.4s. Estimated remaining: 3h 32m 24s. Rate: 6.9 symbols/min [2025-09-17T03:57:18.561404] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:18.561666] [DEBUG] [LOCAL ] GEV: No existing data file found in primary storage. [2025-09-17T03:57:18.561761] [WARN ] [MAIN ] GEV: No existing data found, performing full refresh instead. [2025-09-17T03:57:18.561902] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-17T03:57:18.561968] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-17T03:57:18.562054] [DEBUG] [LOCAL ] GEV: No primary data file found to delete. [2025-09-17T03:57:18.562115] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-17T03:57:18.945416] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:19.090138] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-17T03:57:19.857080] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T03:57:19.890208] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-17T03:57:20.656399] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T03:57:20.690081] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-17T03:57:21.310803] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T03:57:21.344063] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:57:21.490117] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-17T03:57:22.290204] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-11. [2025-09-17T03:57:22.331859] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:57:22.493549] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T03:57:23.090231] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-17T03:57:23.890187] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-17T03:57:24.496008] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T03:57:24.690163] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-17T03:57:24.780183] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T03:57:25.490154] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-17T03:57:25.536795] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T03:57:25.543226] [INFO ] [REMOTE ] GEO: Full fetch complete (75579 records). [2025-09-17T03:57:25.543368] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-17T03:57:25.941045] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-17T03:57:25.941181] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-17T03:57:25.942149] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-17T03:57:25.942222] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-17T03:57:25.943855] [DEBUG] [LOCAL ] GEO: Trimmed 75579 records to 52262 (keeping 200 days of data) [2025-09-17T03:57:26.290258] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-17T03:57:26.294821] [DEBUG] [LOCAL ] GEO: Primary data saved (52262 records). [2025-09-17T03:57:26.296634] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-17T03:57:26.296818] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEO took 37.0s. Estimated remaining: 3h 32m 14s. Rate: 6.9 symbols/min [2025-09-17T03:57:26.481430] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:26.486720] [DEBUG] [LOCAL ] GF: Loaded 2114 existing records from primary storage. [2025-09-17T03:57:26.486883] [INFO ] [MAIN ] GF: Loaded 2114 existing records. [2025-09-17T03:57:26.679690] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:57:26.680083] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-17T03:57:26.680160] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-17T03:57:26.680493] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-17T03:57:26.680558] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-17T03:57:27.065430] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:27.092742] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:57:27.090431] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-11. [2025-09-17T03:57:27.135840] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T03:57:27.720595] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T03:57:27.726571] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:57:27.890108] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-17T03:57:28.690156] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-17T03:57:29.278211] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T03:57:29.490174] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-17T03:57:30.095805] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T03:57:30.290192] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-17T03:57:30.955808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T03:57:31.090137] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-17T03:57:31.851240] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:57:31.890104] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-17T03:57:32.690156] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-17T03:57:33.189254] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:57:33.277040] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T03:57:33.490132] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-17T03:57:34.094852] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:57:34.099568] [INFO ] [REMOTE ] GES: Full fetch complete (60565 records). [2025-09-17T03:57:34.099731] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-17T03:57:34.298413] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-17T03:57:34.520225] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-17T03:57:34.520368] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-17T03:57:34.521312] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-17T03:57:34.521374] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-17T03:57:34.522866] [DEBUG] [LOCAL ] GES: Trimmed 60565 records to 40748 (keeping 200 days of data) [2025-09-17T03:57:34.772105] [DEBUG] [LOCAL ] GES: Primary data saved (40748 records). [2025-09-17T03:57:34.772272] [INFO ] [MAIN ] GES: Full history saved. [2025-09-17T03:57:34.772365] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GES took 40.0s. Estimated remaining: 3h 32m 5s. Rate: 6.9 symbols/min [2025-09-17T03:57:34.885922] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:57:34.955250] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:34.955896] [DEBUG] [LOCAL ] GFF: No existing data file found in primary storage. [2025-09-17T03:57:34.956012] [WARN ] [MAIN ] GFF: No existing data found, performing full refresh instead. [2025-09-17T03:57:34.956279] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-17T03:57:34.956438] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-17T03:57:34.956558] [DEBUG] [LOCAL ] GFF: No primary data file found to delete. [2025-09-17T03:57:34.956626] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-17T03:57:35.078814] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:57:35.094612] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-17T03:57:35.373904] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:35.652350] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:57:35.890226] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-11. [2025-09-17T03:57:36.690223] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-17T03:57:37.379702] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T03:57:37.490166] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-17T03:57:37.916882] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:57:37.921589] [INFO ] [REMOTE ] GETY: Full fetch complete (55839 records). [2025-09-17T03:57:37.921802] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-17T03:57:38.295585] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-17T03:57:38.317383] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-17T03:57:38.317511] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-17T03:57:38.318426] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-17T03:57:38.318596] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-17T03:57:38.319996] [DEBUG] [LOCAL ] GETY: Trimmed 55839 records to 36507 (keeping 200 days of data) [2025-09-17T03:57:38.531484] [DEBUG] [LOCAL ] GETY: Primary data saved (36507 records). [2025-09-17T03:57:38.531707] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-17T03:57:38.531814] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GETY took 25.6s. Estimated remaining: 3h 31m 49s. Rate: 6.9 symbols/min [2025-09-17T03:57:38.704160] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:38.745155] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T03:57:38.764049] [DEBUG] [LOCAL ] GFI: Loaded 39500 existing records from primary storage. [2025-09-17T03:57:38.764196] [INFO ] [MAIN ] GFI: Loaded 39500 existing records. [2025-09-17T03:57:38.948232] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:57:38.948487] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-17T03:57:38.948550] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-17T03:57:38.949410] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-17T03:57:38.949473] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-17T03:57:39.097582] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-17T03:57:39.308401] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:39.890150] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-11. [2025-09-17T03:57:39.931127] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:57:40.382307] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T03:57:40.690231] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-17T03:57:41.490210] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-17T03:57:41.882696] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T03:57:42.290152] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-17T03:57:42.857350] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T03:57:43.079546] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T03:57:43.090455] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-17T03:57:43.747720] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T03:57:43.890179] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-17T03:57:44.025421] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T03:57:44.459767] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:57:44.690175] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-17T03:57:45.490170] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-17T03:57:46.076915] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:57:46.245571] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T03:57:46.290166] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-17T03:57:47.090152] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-17T03:57:47.558445] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T03:57:47.890207] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-17T03:57:48.690148] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-17T03:57:48.729468] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T03:57:49.255792] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:57:49.266202] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T03:57:49.490204] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-17T03:57:50.290153] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-17T03:57:51.090157] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-17T03:57:51.508185] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T03:57:51.522378] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T03:57:51.523245] [INFO ] [REMOTE ] GF: Full fetch complete (5440 records). [2025-09-17T03:57:51.523350] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-17T03:57:51.893799] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-17T03:57:51.894314] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-17T03:57:51.895566] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-17T03:57:51.895995] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-17T03:57:51.896063] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-17T03:57:51.896965] [DEBUG] [LOCAL ] GF: Trimmed 5440 records to 3531 (keeping 200 days of data) [2025-09-17T03:57:51.921319] [DEBUG] [LOCAL ] GF: Primary data saved (3531 records). [2025-09-17T03:57:51.921485] [INFO ] [MAIN ] GF: Full history saved. [2025-09-17T03:57:51.921594] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GF took 25.6s. Estimated remaining: 3h 31m 47s. Rate: 6.9 symbols/min [2025-09-17T03:57:51.951143] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:57:52.690191] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-17T03:57:53.490152] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-17T03:57:54.398418] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-17T03:57:54.410426] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-17T03:57:54.806414] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T03:57:54.858595] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T03:57:55.090157] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-17T03:57:55.890165] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-17T03:57:56.726030] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T03:57:56.737711] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-17T03:57:57.243994] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T03:57:57.274243] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:57:57.280723] [INFO ] [REMOTE ] GEV: Full fetch complete (76899 records). [2025-09-17T03:57:57.280901] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-17T03:57:57.491866] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-17T03:57:57.695663] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-17T03:57:57.695785] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-17T03:57:57.696758] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-17T03:57:57.696849] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-17T03:57:57.719278] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T03:57:57.727114] [DEBUG] [LOCAL ] GEV: Trimmed 76899 records to 53182 (keeping 200 days of data) [2025-09-17T03:57:58.074698] [DEBUG] [LOCAL ] GEV: Primary data saved (53182 records). [2025-09-17T03:57:58.075029] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-17T03:57:58.075236] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GEV took 39.7s. Estimated remaining: 3h 31m 34s. Rate: 6.9 symbols/min [2025-09-17T03:57:58.290166] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-17T03:57:59.449166] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T03:57:59.461260] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-17T03:57:59.506798] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T03:57:59.890165] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-17T03:58:01.075807] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T03:58:01.082042] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-17T03:58:01.620949] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T03:58:01.632147] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-17T03:58:02.379932] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:58:02.386350] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-17T03:58:03.728090] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T03:58:03.739919] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-17T03:58:03.760502] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:58:03.890175] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-17T03:58:05.079533] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:58:05.084482] [INFO ] [REMOTE ] GFF: Full fetch complete (44322 records). [2025-09-17T03:58:05.084671] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-17T03:58:05.497631] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-17T03:58:05.497932] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-17T03:58:05.498901] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-17T03:58:05.499001] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-17T03:58:05.500551] [DEBUG] [LOCAL ] GFF: Trimmed 44322 records to 31300 (keeping 200 days of data) [2025-09-17T03:58:05.649752] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:58:05.667461] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-17T03:58:05.765372] [DEBUG] [LOCAL ] GFF: Primary data saved (31300 records). [2025-09-17T03:58:05.765607] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-17T03:58:05.765730] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GFF took 31.0s. Estimated remaining: 3h 31m 24s. Rate: 6.9 symbols/min [2025-09-17T03:58:07.658401] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T03:58:07.665563] [INFO ] [REMOTE ] GFI: Full fetch complete (76034 records). [2025-09-17T03:58:07.665760] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-17T03:58:08.059754] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-17T03:58:08.059912] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-17T03:58:08.060922] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-17T03:58:08.060994] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-17T03:58:08.062564] [DEBUG] [LOCAL ] GFI: Trimmed 76034 records to 53093 (keeping 200 days of data) [2025-09-17T03:58:08.405310] [DEBUG] [LOCAL ] GFI: Primary data saved (53093 records). [2025-09-17T03:58:08.405552] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-17T03:58:08.405730] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GFI took 29.9s. Estimated remaining: 3h 31m 6s. Rate: 6.9 symbols/min [2025-09-17T03:58:08.906260] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.027787] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.181590] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.215878] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.220422] [DEBUG] [LOCAL ] GFR: Loaded 5148 existing records from primary storage. [2025-09-17T03:58:09.220997] [INFO ] [MAIN ] GFR: Loaded 5148 existing records. [2025-09-17T03:58:09.330048] [DEBUG] [LOCAL ] GGG: Loaded 29913 existing records from primary storage. [2025-09-17T03:58:09.341559] [INFO ] [MAIN ] GGG: Loaded 29913 existing records. [2025-09-17T03:58:09.479944] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:09.517570] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-17T03:58:09.549563] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-17T03:58:09.574328] [DEBUG] [LOCAL ] GFL: Loaded 35126 existing records from primary storage. [2025-09-17T03:58:09.574572] [INFO ] [MAIN ] GFL: Loaded 35126 existing records. [2025-09-17T03:58:09.577118] [DEBUG] [LOCAL ] GGB: Loaded 38267 existing records from primary storage. [2025-09-17T03:58:09.577165] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-17T03:58:09.588537] [INFO ] [MAIN ] GGB: Loaded 38267 existing records. [2025-09-17T03:58:09.793987] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:09.688694] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-17T03:58:09.905697] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-17T03:58:10.013067] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-17T03:58:10.115550] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:10.139439] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-17T03:58:10.139537] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:10.145235] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-17T03:58:10.161111] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-17T03:58:10.145316] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-17T03:58:10.166622] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-17T03:58:10.186282] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-17T03:58:10.194739] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-17T03:58:10.272749] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-17T03:58:10.302638] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-17T03:58:10.434327] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-17T03:58:10.850031] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:10.974111] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-11. [2025-09-17T03:58:11.361274] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:11.403004] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-11. [2025-09-17T03:58:11.468485] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:11.515714] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-11. [2025-09-17T03:58:11.543235] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:11.544472] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-11. [2025-09-17T03:58:12.117027] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T03:58:12.120999] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-17T03:58:13.021881] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T03:58:13.030904] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-17T03:58:13.041304] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T03:58:13.045139] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-17T03:58:13.082570] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T03:58:13.092249] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-17T03:58:13.125838] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:58:13.135965] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-17T03:58:13.543546] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:58:13.546241] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-17T03:58:14.177716] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:58:14.180009] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-17T03:58:14.230275] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:58:14.298622] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-17T03:58:14.316938] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T03:58:14.928009] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T03:58:15.090103] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-17T03:58:15.135119] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T03:58:15.890163] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-17T03:58:15.919489] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:58:16.486709] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:58:16.690179] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-17T03:58:16.759991] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T03:58:17.490181] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-17T03:58:18.139808] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:58:18.290154] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-17T03:58:19.075439] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:58:19.090081] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-17T03:58:19.890183] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-17T03:58:20.124061] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T03:58:20.690136] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-17T03:58:20.903513] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:58:21.490112] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-17T03:58:21.529067] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:58:22.228192] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:58:22.290146] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-17T03:58:23.090159] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-17T03:58:23.162278] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:58:23.890140] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-17T03:58:24.038497] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T03:58:24.593742] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:58:24.690108] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-17T03:58:25.490134] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-17T03:58:25.610919] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:58:26.295170] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-17T03:58:26.311052] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T03:58:27.090166] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-17T03:58:27.133112] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:58:27.258973] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:58:27.890200] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-17T03:58:28.523587] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:58:28.690145] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-17T03:58:29.490183] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-17T03:58:29.605850] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:58:30.272218] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:58:30.286749] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T03:58:30.290256] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-17T03:58:31.090185] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-17T03:58:31.865263] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:58:31.890075] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-17T03:58:32.690210] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-17T03:58:32.749718] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:58:33.341827] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:58:33.364619] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T03:58:33.490152] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-17T03:58:34.290193] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-17T03:58:34.759592] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:58:34.764401] [INFO ] [REMOTE ] GGG: Full fetch complete (59213 records). [2025-09-17T03:58:34.764564] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-17T03:58:35.103954] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-17T03:58:35.161120] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-17T03:58:35.161276] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-17T03:58:35.162190] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-17T03:58:35.162273] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-17T03:58:35.163751] [DEBUG] [LOCAL ] GGG: Trimmed 59213 records to 41189 (keeping 200 days of data) [2025-09-17T03:58:35.423168] [DEBUG] [LOCAL ] GGG: Primary data saved (41189 records). [2025-09-17T03:58:35.423363] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-17T03:58:35.423474] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GGG took 27.0s. Estimated remaining: 3h 31m 26s. Rate: 6.8 symbols/min [2025-09-17T03:58:35.593428] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:35.605274] [DEBUG] [LOCAL ] GGT: Loaded 11129 existing records from primary storage. [2025-09-17T03:58:35.606305] [INFO ] [MAIN ] GGT: Loaded 11129 existing records. [2025-09-17T03:58:35.783139] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:35.783443] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-17T03:58:35.783536] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-17T03:58:35.783946] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-17T03:58:35.784006] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-17T03:58:35.895002] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-17T03:58:35.912601] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:58:36.158324] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:36.191117] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T03:58:36.690142] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-11. [2025-09-17T03:58:37.494955] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-17T03:58:37.496090] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:58:37.526811] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:58:38.290152] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-17T03:58:38.832271] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:58:38.833686] [INFO ] [REMOTE ] GFR: Full fetch complete (13055 records). [2025-09-17T03:58:38.833779] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-17T03:58:39.095341] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-17T03:58:39.202262] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-17T03:58:39.202377] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-17T03:58:39.202712] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-17T03:58:39.202892] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-17T03:58:39.203675] [DEBUG] [LOCAL ] GFR: Trimmed 13055 records to 8419 (keeping 200 days of data) [2025-09-17T03:58:39.276442] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T03:58:39.295003] [DEBUG] [LOCAL ] GFR: Primary data saved (8419 records). [2025-09-17T03:58:39.295144] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-17T03:58:39.295229] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GFR took 30.9s. Estimated remaining: 3h 31m 9s. Rate: 6.9 symbols/min [2025-09-17T03:58:39.463097] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:39.467048] [DEBUG] [LOCAL ] GGZ: Loaded 1704 existing records from primary storage. [2025-09-17T03:58:39.467184] [INFO ] [MAIN ] GGZ: Loaded 1704 existing records. [2025-09-17T03:58:39.648192] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:39.648487] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-17T03:58:39.648545] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-17T03:58:39.648798] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-17T03:58:39.648857] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-17T03:58:39.896953] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-17T03:58:40.001546] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:40.324258] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:58:40.330763] [INFO ] [REMOTE ] GFL: Full fetch complete (68529 records). [2025-09-17T03:58:40.330907] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-17T03:58:40.691245] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-17T03:58:40.727747] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-17T03:58:40.727880] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-17T03:58:40.728714] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-17T03:58:40.728808] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-17T03:58:40.730480] [DEBUG] [LOCAL ] GFL: Trimmed 68529 records to 48262 (keeping 200 days of data) [2025-09-17T03:58:41.029070] [DEBUG] [LOCAL ] GFL: Primary data saved (48262 records). [2025-09-17T03:58:41.029238] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-17T03:58:41.029329] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFL took 32.6s. Estimated remaining: 3h 30m 49s. Rate: 6.9 symbols/min [2025-09-17T03:58:41.202921] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:41.207182] [DEBUG] [LOCAL ] GHC: Loaded 2082 existing records from primary storage. [2025-09-17T03:58:41.207286] [INFO ] [MAIN ] GHC: Loaded 2082 existing records. [2025-09-17T03:58:41.388927] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:41.389162] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-17T03:58:41.389224] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-17T03:58:41.389460] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-17T03:58:41.389518] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-17T03:58:41.492016] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-11. [2025-09-17T03:58:41.774682] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:41.775617] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:58:41.809895] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:58:41.865863] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T03:58:42.290160] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-17T03:58:43.090222] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-17T03:58:43.777871] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T03:58:43.784049] [INFO ] [REMOTE ] GGB: Full fetch complete (73776 records). [2025-09-17T03:58:43.784188] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-17T03:58:43.890875] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-11. [2025-09-17T03:58:43.914192] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T03:58:44.211498] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-17T03:58:44.211632] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-17T03:58:44.212555] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-17T03:58:44.212611] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-17T03:58:44.214175] [DEBUG] [LOCAL ] GGB: Trimmed 73776 records to 50999 (keeping 200 days of data) [2025-09-17T03:58:44.430140] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T03:58:44.530365] [DEBUG] [LOCAL ] GGB: Primary data saved (50999 records). [2025-09-17T03:58:44.530548] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-17T03:58:44.530671] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GGB took 36.1s. Estimated remaining: 3h 30m 32s. Rate: 6.9 symbols/min [2025-09-17T03:58:44.696954] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-17T03:58:44.717182] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:44.719245] [DEBUG] [LOCAL ] GHG: No existing data file found in primary storage. [2025-09-17T03:58:44.719391] [WARN ] [MAIN ] GHG: No existing data found, performing full refresh instead. [2025-09-17T03:58:44.719580] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-17T03:58:44.719713] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-17T03:58:44.719787] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-17T03:58:44.719843] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-17T03:58:45.120176] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:45.173874] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T03:58:45.490188] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-11. [2025-09-17T03:58:45.880379] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T03:58:46.290180] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-17T03:58:46.874688] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T03:58:47.090180] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-17T03:58:47.623150] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T03:58:47.890188] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-17T03:58:48.428061] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T03:58:48.690165] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-17T03:58:49.489109] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T03:58:49.491491] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-17T03:58:49.984929] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T03:58:50.290165] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-17T03:58:51.090133] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-17T03:58:51.231565] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:58:51.646021] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:58:51.890133] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-17T03:58:52.389102] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T03:58:52.690134] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-17T03:58:53.490135] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-17T03:58:53.594735] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:58:54.107041] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:58:54.290159] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-17T03:58:54.722002] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T03:58:55.090141] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-17T03:58:55.564853] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:58:55.890165] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-17T03:58:56.400626] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T03:58:56.690140] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-17T03:58:57.159465] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T03:58:57.490188] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-17T03:58:57.971241] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T03:58:58.290132] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-17T03:58:58.825454] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T03:58:59.090148] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-17T03:58:59.477272] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:58:59.478200] [INFO ] [REMOTE ] GGZ: Full fetch complete (4120 records). [2025-09-17T03:58:59.478286] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-17T03:58:59.851489] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-17T03:58:59.851598] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-17T03:58:59.851764] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-17T03:58:59.851816] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-17T03:58:59.852206] [DEBUG] [LOCAL ] GGZ: Trimmed 4120 records to 2481 (keeping 200 days of data) [2025-09-17T03:58:59.868062] [DEBUG] [LOCAL ] GGZ: Primary data saved (2481 records). [2025-09-17T03:58:59.868158] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-17T03:58:59.868248] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GGZ took 20.6s. Estimated remaining: 3h 30m 34s. Rate: 6.9 symbols/min [2025-09-17T03:58:59.897799] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-17T03:59:00.057583] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:00.066729] [DEBUG] [LOCAL ] GHI: Loaded 5260 existing records from primary storage. [2025-09-17T03:59:00.066887] [INFO ] [MAIN ] GHI: Loaded 5260 existing records. [2025-09-17T03:59:00.264421] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:00.264783] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-17T03:59:00.264854] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-17T03:59:00.265307] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-17T03:59:00.265380] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-17T03:59:00.377132] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T03:59:00.648985] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:00.690187] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-11. [2025-09-17T03:59:01.490134] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-17T03:59:01.623805] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T03:59:02.066476] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:59:02.290134] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-17T03:59:02.817321] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T03:59:03.090137] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-17T03:59:03.549980] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:59:03.890145] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-17T03:59:04.690119] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-17T03:59:04.993134] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T03:59:05.490128] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-17T03:59:05.705130] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:59:05.963919] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:59:06.290158] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-17T03:59:07.090113] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-17T03:59:07.324678] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T03:59:07.890133] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-17T03:59:07.923532] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T03:59:08.640850] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:59:08.690129] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-17T03:59:09.291568] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T03:59:09.490144] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-17T03:59:10.077968] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:59:10.290151] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-17T03:59:10.775488] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T03:59:11.090157] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-17T03:59:11.718428] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:59:11.890232] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-17T03:59:12.690213] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-17T03:59:12.827259] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T03:59:13.277277] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:59:13.490160] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-17T03:59:14.015322] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T03:59:14.290243] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-17T03:59:15.090230] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-17T03:59:15.151802] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T03:59:15.154223] [INFO ] [REMOTE ] GGT: Full fetch complete (18602 records). [2025-09-17T03:59:15.154328] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-17T03:59:15.538999] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-17T03:59:15.539145] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-17T03:59:15.539733] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-17T03:59:15.539793] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-17T03:59:15.540584] [DEBUG] [LOCAL ] GGT: Trimmed 18602 records to 14137 (keeping 200 days of data) [2025-09-17T03:59:15.633431] [DEBUG] [LOCAL ] GGT: Primary data saved (14137 records). [2025-09-17T03:59:15.638263] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-17T03:59:15.638445] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T03:59:15.638716] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGT took 40.2s. Estimated remaining: 3h 30m 36s. Rate: 6.9 symbols/min [2025-09-17T03:59:15.820766] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:15.828027] [DEBUG] [LOCAL ] GHLD: Loaded 3340 existing records from primary storage. [2025-09-17T03:59:15.828231] [INFO ] [MAIN ] GHLD: Loaded 3340 existing records. [2025-09-17T03:59:15.895309] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-17T03:59:16.013574] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:16.013884] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-17T03:59:16.013957] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-17T03:59:16.014326] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-17T03:59:16.014391] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-17T03:59:16.397944] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:16.568260] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T03:59:16.569404] [INFO ] [REMOTE ] GHG: Full fetch complete (3903 records). [2025-09-17T03:59:16.569493] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-17T03:59:16.695218] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-17T03:59:16.948929] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-17T03:59:16.949065] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-17T03:59:16.949265] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-17T03:59:16.949321] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-17T03:59:16.949805] [DEBUG] [LOCAL ] GHG: Trimmed 3903 records to 3131 (keeping 200 days of data) [2025-09-17T03:59:16.969091] [DEBUG] [LOCAL ] GHG: Primary data saved (3131 records). [2025-09-17T03:59:16.969298] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-17T03:59:16.969406] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GHG took 32.4s. Estimated remaining: 3h 30m 16s. Rate: 6.9 symbols/min [2025-09-17T03:59:17.171038] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:17.185979] [DEBUG] [LOCAL ] GHM: Loaded 10550 existing records from primary storage. [2025-09-17T03:59:17.186241] [INFO ] [MAIN ] GHM: Loaded 10550 existing records. [2025-09-17T03:59:17.299430] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T03:59:17.390768] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:17.391545] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-17T03:59:17.391621] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-17T03:59:17.392403] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-17T03:59:17.392478] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-17T03:59:17.495411] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-17T03:59:17.813337] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:18.231677] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:59:18.290117] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-17T03:59:19.066085] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:59:19.090193] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-11. [2025-09-17T03:59:19.890195] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-17T03:59:19.943556] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T03:59:20.005408] [DEBUG] [REMOTE ] GHC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-17T03:59:20.005840] [WARN ] [REMOTE ] GHC: No data returned for month 2025-09 [2025-09-17T03:59:20.005950] [INFO ] [REMOTE ] GHC: Full fetch complete (2955 records). [2025-09-17T03:59:20.006050] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-17T03:59:20.006751] [FATAL] [VALIDATOR ] GHC: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:59:20.006837] [FATAL] [MAIN ] GHC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:59:20.006901] [WARN ] [MAIN ] GHC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:59:20.006967] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-17T03:59:20.007056] [DEBUG] [LOCAL ] GHC: No primary data file found to delete. [2025-09-17T03:59:20.007155] [INFO ] [LOCAL ] GHC: Starting deletion of derivative data. [2025-09-17T03:59:20.007525] [DEBUG] [LOCAL ] GHC: Deleted derivative data file. [2025-09-17T03:59:20.007673] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHC took 39.0s. Estimated remaining: 3h 29m 58s. Rate: 6.9 symbols/min [2025-09-17T03:59:20.205208] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:20.222357] [DEBUG] [LOCAL ] GHY: Loaded 14955 existing records from primary storage. [2025-09-17T03:59:20.222526] [INFO ] [MAIN ] GHY: Loaded 14955 existing records. [2025-09-17T03:59:20.400425] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:20.400724] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-17T03:59:20.400785] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-17T03:59:20.401537] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-17T03:59:20.401601] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-17T03:59:20.695260] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-17T03:59:20.758296] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:21.383673] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:59:21.490161] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-17T03:59:22.189435] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T03:59:22.290102] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-17T03:59:22.951140] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T03:59:23.090177] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-11. [2025-09-17T03:59:23.431852] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T03:59:23.890136] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-17T03:59:24.678066] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T03:59:24.690103] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-17T03:59:25.460373] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:59:25.490093] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-17T03:59:26.145857] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:59:26.147198] [INFO ] [REMOTE ] GHI: Full fetch complete (11870 records). [2025-09-17T03:59:26.147282] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-17T03:59:26.296833] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-17T03:59:26.516705] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-17T03:59:26.516852] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-17T03:59:26.517415] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-17T03:59:26.517476] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-17T03:59:26.518066] [DEBUG] [LOCAL ] GHI: Trimmed 11870 records to 6996 (keeping 200 days of data) [2025-09-17T03:59:26.568571] [DEBUG] [LOCAL ] GHI: Primary data saved (6996 records). [2025-09-17T03:59:26.569094] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-17T03:59:26.569312] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHI took 26.7s. Estimated remaining: 3h 29m 46s. Rate: 6.9 symbols/min [2025-09-17T03:59:26.752618] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:26.775913] [DEBUG] [LOCAL ] GIB: Loaded 22835 existing records from primary storage. [2025-09-17T03:59:26.776122] [INFO ] [MAIN ] GIB: Loaded 22835 existing records. [2025-09-17T03:59:26.968025] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:26.968300] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-17T03:59:26.968360] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-17T03:59:26.969085] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-17T03:59:26.969151] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-17T03:59:27.095252] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-17T03:59:27.338318] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:27.347545] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T03:59:27.648405] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T03:59:27.890171] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-17T03:59:28.342243] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T03:59:28.690158] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-11. [2025-09-17T03:59:29.490165] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-17T03:59:29.723858] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:59:30.200609] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T03:59:30.290197] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-17T03:59:31.090182] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-17T03:59:31.226877] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T03:59:31.382727] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T03:59:31.890163] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-11. [2025-09-17T03:59:32.690168] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-17T03:59:33.124931] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T03:59:33.490144] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-17T03:59:33.519322] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T03:59:33.821260] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T03:59:34.290372] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-17T03:59:34.725584] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T03:59:35.090214] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-17T03:59:35.890179] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-17T03:59:36.315941] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:59:36.690181] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-17T03:59:36.887606] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T03:59:37.490149] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-17T03:59:37.798590] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-17T03:59:38.125424] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:59:38.290153] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-17T03:59:38.927021] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T03:59:39.090132] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-17T03:59:39.890226] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-17T03:59:40.443135] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:59:40.690196] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-17T03:59:40.726097] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T03:59:41.392985] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T03:59:41.490277] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-17T03:59:42.290181] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-17T03:59:42.815424] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T03:59:43.090152] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-17T03:59:43.153595] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:59:43.890157] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-17T03:59:44.107910] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:59:44.690148] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-17T03:59:44.866186] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T03:59:45.422485] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T03:59:45.490162] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-17T03:59:46.290147] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-17T03:59:46.380392] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T03:59:47.090162] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-17T03:59:47.548008] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T03:59:47.628857] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:59:47.630097] [INFO ] [REMOTE ] GHLD: Full fetch complete (4612 records). [2025-09-17T03:59:47.630182] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-17T03:59:47.895397] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-17T03:59:48.014205] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-17T03:59:48.014384] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-17T03:59:48.014677] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-17T03:59:48.014778] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-17T03:59:48.015274] [DEBUG] [LOCAL ] GHLD: Trimmed 4612 records to 3990 (keeping 200 days of data) [2025-09-17T03:59:48.040982] [DEBUG] [LOCAL ] GHLD: Primary data saved (3990 records). [2025-09-17T03:59:48.041083] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-17T03:59:48.041183] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHLD took 32.4s. Estimated remaining: 3h 29m 57s. Rate: 6.9 symbols/min [2025-09-17T03:59:48.210928] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:48.222529] [DEBUG] [LOCAL ] GIC: Loaded 9935 existing records from primary storage. [2025-09-17T03:59:48.222704] [INFO ] [MAIN ] GIC: Loaded 9935 existing records. [2025-09-17T03:59:48.398837] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:48.399114] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-17T03:59:48.399174] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-17T03:59:48.399711] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-17T03:59:48.399776] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-17T03:59:48.695392] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-17T03:59:48.765277] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:49.051104] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:59:49.490134] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-11. [2025-09-17T03:59:49.561190] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:59:50.290134] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-17T03:59:50.328668] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T03:59:51.090179] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-17T03:59:51.883998] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T03:59:51.892254] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-17T03:59:52.224336] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T03:59:52.690202] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-17T03:59:52.878181] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T03:59:53.490208] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-17T03:59:54.169305] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T03:59:54.290210] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-17T03:59:54.451699] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:59:55.090177] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-17T03:59:55.299675] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:59:55.890163] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-17T03:59:56.055604] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T03:59:56.690150] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-17T03:59:57.168497] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:59:57.490124] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-17T03:59:57.535766] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T03:59:58.290129] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-17T03:59:58.534071] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T03:59:59.090161] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-17T03:59:59.592010] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T03:59:59.890126] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-17T03:59:59.975482] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:59:59.978156] [INFO ] [REMOTE ] GHY: Full fetch complete (32048 records). [2025-09-17T03:59:59.978253] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-17T04:00:00.380969] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-17T04:00:00.381076] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-17T04:00:00.381668] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-17T04:00:00.381734] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-17T04:00:00.382753] [DEBUG] [LOCAL ] GHY: Trimmed 32048 records to 21321 (keeping 200 days of data) [2025-09-17T04:00:00.515541] [DEBUG] [LOCAL ] GHY: Primary data saved (21321 records). [2025-09-17T04:00:00.515727] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-17T04:00:00.515824] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHY took 40.5s. Estimated remaining: 3h 29m 54s. Rate: 6.9 symbols/min [2025-09-17T04:00:00.686443] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:00.690132] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-17T04:00:00.720761] [DEBUG] [LOCAL ] GIL: Loaded 31974 existing records from primary storage. [2025-09-17T04:00:00.720962] [INFO ] [MAIN ] GIL: Loaded 31974 existing records. [2025-09-17T04:00:00.909287] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:00.909624] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-17T04:00:00.909717] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-17T04:00:00.910862] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-17T04:00:00.910944] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-17T04:00:01.315794] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:01.347184] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:00:01.490175] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-11. [2025-09-17T04:00:02.290175] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-17T04:00:03.090149] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-17T04:00:04.394490] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-11 (2.90 seconds). [2025-09-17T04:00:04.403487] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-17T04:00:05.352548] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-09-17T04:00:05.356218] [INFO ] [REMOTE ] GHM: Full fetch complete (21394 records). [2025-09-17T04:00:05.356418] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-17T04:00:05.573198] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (4.88 seconds). [2025-09-17T04:00:05.701320] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-17T04:00:05.805850] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-17T04:00:05.806148] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-17T04:00:05.806778] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-17T04:00:05.806850] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-17T04:00:05.808179] [DEBUG] [LOCAL ] GHM: Trimmed 21394 records to 14297 (keeping 200 days of data) [2025-09-17T04:00:05.899174] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-17T04:00:05.929994] [DEBUG] [LOCAL ] GHM: Primary data saved (14297 records). [2025-09-17T04:00:05.930469] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-17T04:00:05.930598] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GHM took 49.0s. Estimated remaining: 3h 29m 40s. Rate: 6.9 symbols/min [2025-09-17T04:00:05.966203] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-17T04:00:06.118935] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:06.157563] [DEBUG] [LOCAL ] GIS: Loaded 40031 existing records from primary storage. [2025-09-17T04:00:06.157786] [INFO ] [MAIN ] GIS: Loaded 40031 existing records. [2025-09-17T04:00:06.337262] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:06.338069] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-17T04:00:06.338149] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-17T04:00:06.339204] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-17T04:00:06.339275] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-17T04:00:06.655376] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-17T04:00:06.705121] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-17T04:00:06.747568] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:06.807065] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T04:00:07.040467] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:00:07.045964] [INFO ] [REMOTE ] GIB: Full fetch complete (44731 records). [2025-09-17T04:00:07.046268] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-17T04:00:07.095343] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-11. [2025-09-17T04:00:07.496933] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-17T04:00:07.497110] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-17T04:00:07.498146] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-17T04:00:07.498213] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-17T04:00:07.499973] [DEBUG] [LOCAL ] GIB: Trimmed 44731 records to 32607 (keeping 200 days of data) [2025-09-17T04:00:07.753783] [DEBUG] [LOCAL ] GIB: Primary data saved (32607 records). [2025-09-17T04:00:07.754038] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-17T04:00:07.754164] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GIB took 41.2s. Estimated remaining: 3h 29m 21s. Rate: 6.9 symbols/min [2025-09-17T04:00:07.895303] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-17T04:00:07.958313] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:07.991108] [DEBUG] [LOCAL ] GKOS: Loaded 31616 existing records from primary storage. [2025-09-17T04:00:07.991521] [INFO ] [MAIN ] GKOS: Loaded 31616 existing records. [2025-09-17T04:00:08.187086] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:08.187741] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-17T04:00:08.187822] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-17T04:00:08.188693] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-17T04:00:08.188762] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-17T04:00:08.376517] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T04:00:08.623566] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:08.690102] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-17T04:00:08.864533] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T04:00:08.883921] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T04:00:09.490149] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-11. [2025-09-17T04:00:10.268443] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:00:10.290085] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-17T04:00:10.573499] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:00:11.090150] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-17T04:00:11.514753] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:00:11.742476] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T04:00:11.890143] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-17T04:00:12.690168] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-17T04:00:13.490212] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-17T04:00:13.571709] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T04:00:13.760353] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T04:00:14.290376] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-17T04:00:14.806419] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:00:15.090186] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-17T04:00:15.890185] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-17T04:00:16.208415] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T04:00:16.230733] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:00:16.690191] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-17T04:00:17.490190] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-17T04:00:17.904414] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T04:00:17.927159] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T04:00:17.930010] [INFO ] [REMOTE ] GIC: Full fetch complete (20245 records). [2025-09-17T04:00:17.930112] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-17T04:00:18.295406] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-17T04:00:18.339835] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-17T04:00:18.339976] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-17T04:00:18.340730] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-17T04:00:18.340795] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-17T04:00:18.341575] [DEBUG] [LOCAL ] GIC: Trimmed 20245 records to 13894 (keeping 200 days of data) [2025-09-17T04:00:18.437703] [DEBUG] [LOCAL ] GIC: Primary data saved (13894 records). [2025-09-17T04:00:18.437951] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-17T04:00:18.438077] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIC took 30.4s. Estimated remaining: 3h 29m 15s. Rate: 6.9 symbols/min [2025-09-17T04:00:18.674139] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:18.711560] [DEBUG] [LOCAL ] GL: Loaded 27947 existing records from primary storage. [2025-09-17T04:00:18.711863] [INFO ] [MAIN ] GL: Loaded 27947 existing records. [2025-09-17T04:00:18.908151] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:18.908480] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-17T04:00:18.908547] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-17T04:00:18.909519] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-17T04:00:18.909593] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-17T04:00:19.100985] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-17T04:00:19.289453] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:19.699423] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-17T04:00:19.890157] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-17T04:00:20.206461] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:00:20.381463] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:00:20.690147] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-17T04:00:21.490193] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-11. [2025-09-17T04:00:21.787824] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:00:22.205583] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T04:00:22.290193] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-17T04:00:22.996626] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T04:00:23.090163] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-17T04:00:23.477811] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T04:00:23.890189] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-17T04:00:24.693995] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-17T04:00:24.699513] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:00:25.376231] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:00:25.490154] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-17T04:00:25.983917] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T04:00:26.290225] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-17T04:00:26.926334] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T04:00:27.090193] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-17T04:00:27.890122] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-17T04:00:27.936545] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:00:28.268546] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T04:00:28.690134] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-17T04:00:29.124492] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T04:00:29.490211] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-17T04:00:30.290659] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T04:00:30.290759] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-17T04:00:30.979558] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:00:31.090197] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-17T04:00:31.521031] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T04:00:31.890200] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-17T04:00:32.453940] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T04:00:32.690189] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-17T04:00:33.490189] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-17T04:00:33.868676] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T04:00:34.284103] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:00:34.292900] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-17T04:00:34.980927] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T04:00:35.090177] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-17T04:00:35.791311] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T04:00:35.890151] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-17T04:00:36.690177] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-17T04:00:37.089409] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T04:00:37.182060] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:00:37.189758] [INFO ] [REMOTE ] GKOS: Full fetch complete (59392 records). [2025-09-17T04:00:37.189962] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-17T04:00:37.492058] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-17T04:00:37.596038] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-17T04:00:37.596219] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-17T04:00:37.597284] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-17T04:00:37.597391] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-17T04:00:37.598921] [DEBUG] [LOCAL ] GKOS: Trimmed 59392 records to 43083 (keeping 200 days of data) [2025-09-17T04:00:37.867029] [DEBUG] [LOCAL ] GKOS: Primary data saved (43083 records). [2025-09-17T04:00:37.867258] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-17T04:00:37.867397] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GKOS took 30.1s. Estimated remaining: 3h 29m 23s. Rate: 6.8 symbols/min [2025-09-17T04:00:38.054381] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:38.077666] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:00:38.119845] [DEBUG] [LOCAL ] GLOB: Loaded 35748 existing records from primary storage. [2025-09-17T04:00:38.120103] [INFO ] [MAIN ] GLOB: Loaded 35748 existing records. [2025-09-17T04:00:38.298012] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-17T04:00:38.308657] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:38.309801] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-17T04:00:38.309888] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-17T04:00:38.310846] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-17T04:00:38.310935] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-17T04:00:38.679635] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:39.090113] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-11. [2025-09-17T04:00:39.671500] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T04:00:39.875385] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:00:39.890067] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-17T04:00:40.575203] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T04:00:40.690201] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-17T04:00:41.072385] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:00:41.080374] [INFO ] [REMOTE ] GIL: Full fetch complete (60878 records). [2025-09-17T04:00:41.080778] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-17T04:00:41.496354] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-17T04:00:41.529527] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-17T04:00:41.529673] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-17T04:00:41.530564] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-17T04:00:41.530664] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-17T04:00:41.532848] [DEBUG] [LOCAL ] GIL: Trimmed 60878 records to 43031 (keeping 200 days of data) [2025-09-17T04:00:41.827924] [DEBUG] [LOCAL ] GIL: Primary data saved (43031 records). [2025-09-17T04:00:41.829345] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-17T04:00:41.829192] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:00:41.829589] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIL took 41.3s. Estimated remaining: 3h 29m 6s. Rate: 6.9 symbols/min [2025-09-17T04:00:42.002917] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:42.003146] [DEBUG] [LOCAL ] GLP: No existing data file found in primary storage. [2025-09-17T04:00:42.003233] [WARN ] [MAIN ] GLP: No existing data found, performing full refresh instead. [2025-09-17T04:00:42.003346] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-17T04:00:42.003413] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-17T04:00:42.003466] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-09-17T04:00:42.003516] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-17T04:00:42.295210] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-17T04:00:42.361681] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:43.090152] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-17T04:00:43.134371] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:00:43.737229] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T04:00:43.890155] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-17T04:00:44.690121] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-17T04:00:45.116983] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T04:00:45.152191] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T04:00:45.490198] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-17T04:00:46.138488] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:00:46.290223] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-11. [2025-09-17T04:00:46.832846] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T04:00:47.095244] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-17T04:00:47.119353] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:00:47.890176] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-17T04:00:48.513793] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T04:00:48.521571] [INFO ] [REMOTE ] GL: Full fetch complete (55572 records). [2025-09-17T04:00:48.521832] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-17T04:00:48.704406] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-17T04:00:48.925808] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-17T04:00:48.925917] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-17T04:00:48.926693] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-17T04:00:48.926751] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-17T04:00:48.927921] [DEBUG] [LOCAL ] GL: Trimmed 55572 records to 38346 (keeping 200 days of data) [2025-09-17T04:00:49.172891] [DEBUG] [LOCAL ] GL: Primary data saved (38346 records). [2025-09-17T04:00:49.173068] [INFO ] [MAIN ] GL: Full history saved. [2025-09-17T04:00:49.173179] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GL took 30.7s. Estimated remaining: 3h 28m 56s. Rate: 6.9 symbols/min [2025-09-17T04:00:49.344251] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:49.381076] [DEBUG] [LOCAL ] GLW: Loaded 39988 existing records from primary storage. [2025-09-17T04:00:49.381246] [INFO ] [MAIN ] GLW: Loaded 39988 existing records. [2025-09-17T04:00:49.494034] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-17T04:00:49.565891] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:49.566296] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-17T04:00:49.566421] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-17T04:00:49.575835] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-17T04:00:49.589341] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-17T04:00:49.639984] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T04:00:49.965140] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:50.290154] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-11. [2025-09-17T04:00:50.316628] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:00:50.772833] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T04:00:50.780101] [INFO ] [REMOTE ] GIS: Full fetch complete (77494 records). [2025-09-17T04:00:50.780296] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-17T04:00:51.095190] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-17T04:00:51.188144] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-17T04:00:51.188266] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-17T04:00:51.189224] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-17T04:00:51.189288] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-17T04:00:51.191003] [DEBUG] [LOCAL ] GIS: Trimmed 77494 records to 53674 (keeping 200 days of data) [2025-09-17T04:00:51.553384] [DEBUG] [LOCAL ] GIS: Primary data saved (53674 records). [2025-09-17T04:00:51.553674] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-17T04:00:51.553811] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GIS took 45.6s. Estimated remaining: 3h 28m 37s. Rate: 6.9 symbols/min [2025-09-17T04:00:51.730154] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:51.770986] [DEBUG] [LOCAL ] GM: Loaded 40079 existing records from primary storage. [2025-09-17T04:00:51.771151] [INFO ] [MAIN ] GM: Loaded 40079 existing records. [2025-09-17T04:00:51.894103] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-17T04:00:51.955970] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:51.956473] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-17T04:00:51.957025] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-17T04:00:51.965025] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-17T04:00:51.965201] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-17T04:00:52.003438] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:00:52.297308] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T04:00:52.385718] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:52.690152] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-17T04:00:53.490200] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-17T04:00:53.660622] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:00:54.280887] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T04:00:54.290116] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-17T04:00:54.542960] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T04:00:55.090140] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-11. [2025-09-17T04:00:55.152029] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T04:00:55.890139] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-17T04:00:56.690135] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-17T04:00:56.703853] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T04:00:57.417308] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-11 (2.33 seconds). [2025-09-17T04:00:57.490161] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-17T04:00:58.272472] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:00:58.290115] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-17T04:00:58.637546] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T04:00:59.051749] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:00:59.090145] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-17T04:00:59.793771] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T04:00:59.890140] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-17T04:01:00.690135] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-17T04:01:01.490203] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-17T04:01:01.745388] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T04:01:02.257956] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:01:02.290146] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-17T04:01:02.811282] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T04:01:03.090142] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-17T04:01:03.890193] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-17T04:01:03.960734] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T04:01:04.051682] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T04:01:04.054480] [INFO ] [REMOTE ] GLP: Full fetch complete (14303 records). [2025-09-17T04:01:04.054582] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-17T04:01:04.441798] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-17T04:01:04.441942] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-17T04:01:04.442439] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-17T04:01:04.442498] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-17T04:01:04.443130] [DEBUG] [LOCAL ] GLP: Trimmed 14303 records to 9587 (keeping 200 days of data) [2025-09-17T04:01:04.509407] [DEBUG] [LOCAL ] GLP: Primary data saved (9587 records). [2025-09-17T04:01:04.509697] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-17T04:01:04.509836] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GLP took 22.7s. Estimated remaining: 3h 28m 35s. Rate: 6.9 symbols/min [2025-09-17T04:01:04.685996] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:04.690194] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-17T04:01:04.737723] [DEBUG] [LOCAL ] GME: Loaded 40137 existing records from primary storage. [2025-09-17T04:01:04.737975] [INFO ] [MAIN ] GME: Loaded 40137 existing records. [2025-09-17T04:01:04.923468] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:04.923866] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-17T04:01:04.923935] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-17T04:01:04.926001] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-17T04:01:04.926083] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-17T04:01:05.301999] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:05.490165] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-17T04:01:05.787195] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:01:06.290220] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-11. [2025-09-17T04:01:06.927919] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T04:01:07.090203] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-17T04:01:07.185047] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T04:01:07.890197] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-17T04:01:08.690120] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-17T04:01:08.731819] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-11 (2.44 seconds). [2025-09-17T04:01:08.963759] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:01:09.490186] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-17T04:01:09.749656] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T04:01:10.290188] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-17T04:01:10.562996] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T04:01:11.090196] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-17T04:01:11.801981] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:01:11.810037] [INFO ] [REMOTE ] GLOB: Full fetch complete (62411 records). [2025-09-17T04:01:11.810277] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-17T04:01:11.895449] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-17T04:01:12.251929] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-17T04:01:12.252245] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-17T04:01:12.253334] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-17T04:01:12.253515] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-17T04:01:12.255578] [DEBUG] [LOCAL ] GLOB: Trimmed 62411 records to 47124 (keeping 200 days of data) [2025-09-17T04:01:12.385592] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-17T04:01:12.604778] [DEBUG] [LOCAL ] GLOB: Primary data saved (47124 records). [2025-09-17T04:01:12.605192] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-17T04:01:12.605374] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLOB took 34.7s. Estimated remaining: 3h 28m 25s. Rate: 6.9 symbols/min [2025-09-17T04:01:12.695223] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-17T04:01:12.822925] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T04:01:12.841362] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:12.893836] [DEBUG] [LOCAL ] GMED: Loaded 35875 existing records from primary storage. [2025-09-17T04:01:12.894023] [INFO ] [MAIN ] GMED: Loaded 35875 existing records. [2025-09-17T04:01:13.073946] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:13.074234] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-17T04:01:13.074322] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-17T04:01:13.075102] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-17T04:01:13.075175] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-17T04:01:13.474471] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:13.490101] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-11. [2025-09-17T04:01:14.191095] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-17T04:01:14.290132] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-17T04:01:14.649901] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T04:01:15.090137] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-17T04:01:15.317544] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T04:01:15.890152] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-17T04:01:16.297117] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T04:01:16.690134] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-17T04:01:16.925374] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T04:01:17.490196] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-17T04:01:18.290116] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-17T04:01:18.331059] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-17T04:01:18.426519] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:01:18.614727] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:01:19.090155] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-17T04:01:19.890176] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-17T04:01:19.896048] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T04:01:20.690185] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-17T04:01:21.490217] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-17T04:01:21.537331] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-17T04:01:21.830610] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T04:01:22.290115] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-17T04:01:22.505028] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T04:01:23.066882] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:01:23.090090] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-17T04:01:23.890156] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-17T04:01:24.311250] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T04:01:24.697188] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-17T04:01:24.704975] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:01:25.490154] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-17T04:01:26.207117] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-17T04:01:26.290187] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-17T04:01:26.828444] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T04:01:26.837109] [INFO ] [REMOTE ] GLW: Full fetch complete (77479 records). [2025-09-17T04:01:26.837368] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-17T04:01:27.095288] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-17T04:01:27.244747] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-17T04:01:27.244864] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-17T04:01:27.246002] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-17T04:01:27.246068] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-17T04:01:27.247732] [DEBUG] [LOCAL ] GLW: Trimmed 77479 records to 53635 (keeping 200 days of data) [2025-09-17T04:01:27.392748] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T04:01:27.638121] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-17T04:01:27.638308] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-17T04:01:27.638414] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLW took 38.5s. Estimated remaining: 3h 28m 26s. Rate: 6.9 symbols/min [2025-09-17T04:01:27.825803] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:27.852942] [DEBUG] [LOCAL ] GMRE: Loaded 28154 existing records from primary storage. [2025-09-17T04:01:27.853124] [INFO ] [MAIN ] GMRE: Loaded 28154 existing records. [2025-09-17T04:01:27.895873] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-17T04:01:28.037773] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:28.038208] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-17T04:01:28.038441] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-17T04:01:28.039185] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-17T04:01:28.039263] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-17T04:01:28.245185] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T04:01:28.439710] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:28.690202] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-17T04:01:29.430783] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-17T04:01:29.461617] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T04:01:29.468762] [INFO ] [REMOTE ] GM: Full fetch complete (77793 records). [2025-09-17T04:01:29.468958] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-17T04:01:29.502520] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-17T04:01:29.876596] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-17T04:01:29.876737] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-17T04:01:29.877722] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-17T04:01:29.877784] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-17T04:01:29.880034] [DEBUG] [LOCAL ] GM: Trimmed 77793 records to 53728 (keeping 200 days of data) [2025-09-17T04:01:30.215849] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-17T04:01:30.216040] [INFO ] [MAIN ] GM: Full history saved. [2025-09-17T04:01:30.216141] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GM took 38.7s. Estimated remaining: 3h 28m 8s. Rate: 6.9 symbols/min [2025-09-17T04:01:30.292514] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-11. [2025-09-17T04:01:30.401327] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:30.435700] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T04:01:30.451551] [DEBUG] [LOCAL ] GNE: Loaded 14670 existing records from primary storage. [2025-09-17T04:01:30.451713] [INFO ] [MAIN ] GNE: Loaded 14670 existing records. [2025-09-17T04:01:30.628312] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:30.628560] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-17T04:01:30.628618] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-17T04:01:30.629204] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-17T04:01:30.629267] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-17T04:01:30.983467] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:31.090103] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-11. [2025-09-17T04:01:31.703676] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T04:01:31.777575] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-17T04:01:31.847261] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T04:01:31.890111] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-17T04:01:32.690154] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-17T04:01:32.702901] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T04:01:33.490196] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-17T04:01:33.993193] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T04:01:34.290151] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-17T04:01:35.090190] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-17T04:01:35.622532] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:01:35.871239] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T04:01:35.890110] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-17T04:01:36.201077] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-17T04:01:36.664322] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T04:01:36.690189] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-17T04:01:37.490163] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-17T04:01:37.774573] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:01:38.285020] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T04:01:38.290079] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-17T04:01:39.090202] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-17T04:01:39.790963] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T04:01:39.890166] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-17T04:01:40.477209] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:01:40.670697] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T04:01:40.690099] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-17T04:01:41.490132] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-17T04:01:41.633353] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T04:01:42.290161] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-17T04:01:42.860558] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:01:43.090114] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-17T04:01:43.445835] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T04:01:43.890140] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-17T04:01:44.531543] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T04:01:44.690197] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-17T04:01:45.490156] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-17T04:01:45.706384] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T04:01:45.926175] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T04:01:46.290114] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-17T04:01:46.612701] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T04:01:47.090204] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-17T04:01:47.890198] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-17T04:01:47.949742] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T04:01:48.158153] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:01:48.690153] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-17T04:01:49.338016] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T04:01:49.490191] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-17T04:01:50.290157] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-17T04:01:50.778461] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T04:01:51.090147] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-17T04:01:51.186542] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T04:01:51.724613] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:01:51.730372] [INFO ] [REMOTE ] GMED: Full fetch complete (68722 records). [2025-09-17T04:01:51.730537] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-17T04:01:51.902260] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-17T04:01:52.146781] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-17T04:01:52.146931] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-17T04:01:52.148071] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-17T04:01:52.148152] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-17T04:01:52.149776] [DEBUG] [LOCAL ] GMED: Trimmed 68722 records to 48301 (keeping 200 days of data) [2025-09-17T04:01:52.440896] [DEBUG] [LOCAL ] GMED: Primary data saved (48301 records). [2025-09-17T04:01:52.441072] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-17T04:01:52.441170] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GMED took 39.8s. Estimated remaining: 3h 28m 19s. Rate: 6.8 symbols/min [2025-09-17T04:01:52.619363] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:52.645205] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:01:52.677343] [DEBUG] [LOCAL ] GNK: Loaded 29717 existing records from primary storage. [2025-09-17T04:01:52.677504] [INFO ] [MAIN ] GNK: Loaded 29717 existing records. [2025-09-17T04:01:52.698184] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-17T04:01:52.871115] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:52.872228] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-17T04:01:52.872299] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-17T04:01:52.873347] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-17T04:01:52.873417] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-17T04:01:53.246002] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:53.490179] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-11. [2025-09-17T04:01:54.226829] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T04:01:54.231617] [INFO ] [REMOTE ] GMRE: Full fetch complete (53128 records). [2025-09-17T04:01:54.231771] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-17T04:01:54.295350] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-17T04:01:54.624237] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-17T04:01:54.624397] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-17T04:01:54.625405] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-17T04:01:54.625606] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-17T04:01:54.627020] [DEBUG] [LOCAL ] GMRE: Trimmed 53128 records to 37664 (keeping 200 days of data) [2025-09-17T04:01:54.645607] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-17T04:01:54.740899] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-17T04:01:54.742863] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-17T04:01:55.275813] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-17T04:01:55.277117] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-17T04:01:55.280129] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-17T04:01:55.281031] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-17T04:01:55.306742] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53759 (keeping 200 days of data) [2025-09-17T04:01:55.308724] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T04:01:55.319242] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-17T04:01:55.329073] [DEBUG] [LOCAL ] GMRE: Primary data saved (37664 records). [2025-09-17T04:01:55.379441] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-17T04:01:55.379754] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMRE took 27.7s. Estimated remaining: 3h 28m 2s. Rate: 6.9 symbols/min [2025-09-17T04:01:55.502625] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:01:55.535418] [INFO ] [REMOTE ] GNE: Full fetch complete (21950 records). [2025-09-17T04:01:55.547103] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-17T04:01:55.690549] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:55.943394] [DEBUG] [LOCAL ] GNL: Loaded 34634 existing records from primary storage. [2025-09-17T04:01:55.956151] [INFO ] [MAIN ] GNL: Loaded 34634 existing records. [2025-09-17T04:01:56.305926] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-17T04:01:56.350612] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:56.349714] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-17T04:01:56.353834] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-17T04:01:56.352374] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-17T04:01:56.356103] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-17T04:01:56.357093] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-17T04:01:56.357915] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-17T04:01:56.358508] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-17T04:01:56.405444] [DEBUG] [LOCAL ] GNE: Trimmed 21950 records to 17366 (keeping 200 days of data) [2025-09-17T04:01:56.854607] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:56.857447] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-11. [2025-09-17T04:01:56.895881] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T04:01:56.906084] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-17T04:01:56.999854] [DEBUG] [LOCAL ] GNE: Primary data saved (17366 records). [2025-09-17T04:01:57.000800] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-17T04:01:57.001950] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GNE took 26.8s. Estimated remaining: 3h 27m 42s. Rate: 6.9 symbols/min [2025-09-17T04:01:57.187955] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:57.197814] [DEBUG] [LOCAL ] GME: Primary data saved (53759 records). [2025-09-17T04:01:57.197991] [INFO ] [MAIN ] GME: Full history saved. [2025-09-17T04:01:57.198179] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GME took 52.7s. Estimated remaining: 3h 27m 21s. Rate: 6.9 symbols/min [2025-09-17T04:01:57.422264] [DEBUG] [LOCAL ] GNRC: Loaded 33506 existing records from primary storage. [2025-09-17T04:01:57.426509] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:57.426708] [INFO ] [MAIN ] GNRC: Loaded 33506 existing records. [2025-09-17T04:01:57.560443] [DEBUG] [LOCAL ] GNT: Loaded 5867 existing records from primary storage. [2025-09-17T04:01:57.584966] [INFO ] [MAIN ] GNT: Loaded 5867 existing records. [2025-09-17T04:01:57.701714] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:57.722869] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-17T04:01:57.722983] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-17T04:01:57.728888] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-17T04:01:57.744248] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-17T04:01:57.872807] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:57.909002] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-17T04:01:57.909174] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-17T04:01:57.925323] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-17T04:01:57.936167] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-17T04:01:58.378042] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:58.423081] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-11. [2025-09-17T04:01:58.544786] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:58.545334] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-11. [2025-09-17T04:01:58.565329] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:01:58.600698] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T04:01:59.090141] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-17T04:01:59.135054] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T04:01:59.890152] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-17T04:02:00.188124] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T04:02:00.461306] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T04:02:00.508993] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T04:02:00.690106] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-17T04:02:01.490135] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-17T04:02:02.210483] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T04:02:02.290125] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-17T04:02:03.090144] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-17T04:02:03.128830] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T04:02:03.685410] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T04:02:03.890134] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-17T04:02:03.964810] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T04:02:04.486697] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:02:04.690176] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-17T04:02:05.490193] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-17T04:02:06.301482] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-17T04:02:06.303753] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T04:02:07.090221] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-17T04:02:07.129799] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T04:02:07.803747] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T04:02:07.850285] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T04:02:07.890200] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-17T04:02:08.657690] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T04:02:08.690246] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-17T04:02:09.490221] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-17T04:02:10.290295] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-17T04:02:10.413400] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T04:02:11.090197] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-17T04:02:11.289861] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T04:02:11.791332] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T04:02:11.892000] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-17T04:02:11.899864] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T04:02:12.690187] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-17T04:02:13.443302] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T04:02:13.457381] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T04:02:13.490131] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-17T04:02:14.210456] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T04:02:14.290155] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-17T04:02:15.090187] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-17T04:02:15.813785] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T04:02:15.839913] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:02:15.890088] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-17T04:02:16.690174] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-17T04:02:16.867810] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:02:16.869778] [INFO ] [REMOTE ] GNT: Full fetch complete (10210 records). [2025-09-17T04:02:16.869868] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-17T04:02:17.242864] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-17T04:02:17.242995] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-17T04:02:17.243318] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-17T04:02:17.243376] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-17T04:02:17.243884] [DEBUG] [LOCAL ] GNT: Trimmed 10210 records to 7773 (keeping 200 days of data) [2025-09-17T04:02:17.289682] [DEBUG] [LOCAL ] GNT: Primary data saved (7773 records). [2025-09-17T04:02:17.289826] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-17T04:02:17.289929] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GNT took 20.1s. Estimated remaining: 3h 27m 29s. Rate: 6.9 symbols/min [2025-09-17T04:02:17.457698] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:17.464891] [DEBUG] [LOCAL ] GNTY: Loaded 5679 existing records from primary storage. [2025-09-17T04:02:17.465019] [INFO ] [MAIN ] GNTY: Loaded 5679 existing records. [2025-09-17T04:02:17.495394] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-17T04:02:17.642993] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:02:17.643219] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-17T04:02:17.643271] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-17T04:02:17.643504] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-17T04:02:17.643562] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-17T04:02:17.998591] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:18.198103] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T04:02:18.290155] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-11. [2025-09-17T04:02:18.743574] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T04:02:19.084739] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T04:02:19.092813] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-17T04:02:19.890143] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-17T04:02:20.700164] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-17T04:02:20.702106] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:02:21.500591] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-17T04:02:21.506543] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:02:21.910618] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:02:21.915662] [INFO ] [REMOTE ] GNK: Full fetch complete (57034 records). [2025-09-17T04:02:21.915807] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-17T04:02:22.301024] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-17T04:02:22.304118] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-17T04:02:22.304954] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-17T04:02:22.305858] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-17T04:02:22.305984] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-17T04:02:22.307560] [DEBUG] [LOCAL ] GNK: Trimmed 57034 records to 40999 (keeping 200 days of data) [2025-09-17T04:02:22.572788] [DEBUG] [LOCAL ] GNK: Primary data saved (40999 records). [2025-09-17T04:02:22.572948] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-17T04:02:22.573046] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNK took 30.1s. Estimated remaining: 3h 27m 15s. Rate: 6.9 symbols/min [2025-09-17T04:02:22.782841] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:22.783269] [DEBUG] [LOCAL ] GNW: No existing data file found in primary storage. [2025-09-17T04:02:22.783322] [WARN ] [MAIN ] GNW: No existing data found, performing full refresh instead. [2025-09-17T04:02:22.783435] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-17T04:02:22.783487] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-17T04:02:22.783596] [DEBUG] [LOCAL ] GNW: No primary data file found to delete. [2025-09-17T04:02:22.783673] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-17T04:02:23.094937] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-17T04:02:23.156132] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:23.209231] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:02:23.604441] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:02:23.878737] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T04:02:23.890080] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-17T04:02:24.646171] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T04:02:24.690095] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-17T04:02:25.280792] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T04:02:25.490144] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-17T04:02:26.082852] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T04:02:26.290180] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-17T04:02:27.090186] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-17T04:02:27.890137] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-11. [2025-09-17T04:02:28.010830] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T04:02:28.697969] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-17T04:02:28.720853] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T04:02:29.095748] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T04:02:29.373444] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T04:02:29.490184] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-17T04:02:29.934969] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T04:02:30.290143] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-17T04:02:30.874546] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T04:02:31.090187] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-17T04:02:31.862455] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:02:31.890219] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-17T04:02:32.690183] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-17T04:02:33.495249] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-17T04:02:33.513881] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:02:34.007600] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:02:34.288523] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T04:02:34.291398] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-17T04:02:35.090149] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-17T04:02:35.724326] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:02:35.730422] [INFO ] [REMOTE ] GNL: Full fetch complete (68524 records). [2025-09-17T04:02:35.730609] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-17T04:02:35.899059] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-17T04:02:36.145112] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-17T04:02:36.145299] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-17T04:02:36.146260] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-17T04:02:36.146326] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-17T04:02:36.147806] [DEBUG] [LOCAL ] GNL: Trimmed 68524 records to 47603 (keeping 200 days of data) [2025-09-17T04:02:36.430327] [DEBUG] [LOCAL ] GNL: Primary data saved (47603 records). [2025-09-17T04:02:36.430507] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-17T04:02:36.430611] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 41.0s. Estimated remaining: 3h 27m 14s. Rate: 6.9 symbols/min [2025-09-17T04:02:36.602120] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:36.633933] [DEBUG] [LOCAL ] GOF: Loaded 31297 existing records from primary storage. [2025-09-17T04:02:36.634103] [INFO ] [MAIN ] GOF: Loaded 31297 existing records. [2025-09-17T04:02:36.697065] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-17T04:02:36.821248] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:02:36.822930] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T04:02:36.823234] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-17T04:02:36.825057] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-17T04:02:36.825445] [INFO ] [REMOTE ] GNTY: Full fetch complete (9983 records). [2025-09-17T04:02:36.840205] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-17T04:02:36.852160] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-17T04:02:36.852331] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-17T04:02:36.875618] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T04:02:37.494115] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-17T04:02:37.576413] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:37.639047] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-17T04:02:37.639167] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-17T04:02:37.639479] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-17T04:02:37.639540] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-17T04:02:37.640128] [DEBUG] [LOCAL ] GNTY: Trimmed 9983 records to 6938 (keeping 200 days of data) [2025-09-17T04:02:37.685979] [DEBUG] [LOCAL ] GNTY: Primary data saved (6938 records). [2025-09-17T04:02:37.686187] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-17T04:02:37.686326] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNTY took 20.4s. Estimated remaining: 3h 26m 54s. Rate: 6.9 symbols/min [2025-09-17T04:02:37.876294] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:37.876547] [DEBUG] [LOCAL ] GOLF: No existing data file found in primary storage. [2025-09-17T04:02:37.876600] [WARN ] [MAIN ] GOLF: No existing data found, performing full refresh instead. [2025-09-17T04:02:37.876741] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-17T04:02:37.876810] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-17T04:02:37.876871] [DEBUG] [LOCAL ] GOLF: No primary data file found to delete. [2025-09-17T04:02:37.876912] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-17T04:02:38.243708] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:38.290087] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-11. [2025-09-17T04:02:38.368149] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T04:02:39.090154] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-11. [2025-09-17T04:02:39.249489] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T04:02:39.280138] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T04:02:39.890197] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-17T04:02:40.690204] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-17T04:02:40.740457] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T04:02:41.476207] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:02:41.490263] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-17T04:02:42.250971] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:02:42.290087] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-17T04:02:43.090137] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-17T04:02:43.116784] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T04:02:43.890130] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-17T04:02:44.025636] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T04:02:44.690143] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-17T04:02:44.814791] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:02:45.335571] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T04:02:45.490131] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-17T04:02:46.290151] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-17T04:02:46.456610] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T04:02:46.661393] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T04:02:46.667270] [INFO ] [REMOTE ] GNRC: Full fetch complete (64743 records). [2025-09-17T04:02:46.667444] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-17T04:02:47.067827] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-17T04:02:47.067958] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-17T04:02:47.068841] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-17T04:02:47.068903] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-17T04:02:47.070538] [DEBUG] [LOCAL ] GNRC: Trimmed 64743 records to 45192 (keeping 200 days of data) [2025-09-17T04:02:47.123706] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-17T04:02:47.353954] [DEBUG] [LOCAL ] GNRC: Primary data saved (45192 records). [2025-09-17T04:02:47.354157] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-17T04:02:47.354297] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNRC took 50.4s. Estimated remaining: 3h 26m 46s. Rate: 6.9 symbols/min [2025-09-17T04:02:47.542432] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:47.542877] [DEBUG] [LOCAL ] GOOS: No existing data file found in primary storage. [2025-09-17T04:02:47.543027] [WARN ] [MAIN ] GOOS: No existing data found, performing full refresh instead. [2025-09-17T04:02:47.560368] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-17T04:02:47.563260] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-17T04:02:47.564871] [DEBUG] [LOCAL ] GOOS: No primary data file found to delete. [2025-09-17T04:02:47.564782] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T04:02:47.565077] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-17T04:02:47.895237] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-17T04:02:47.936982] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:48.690134] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-11. [2025-09-17T04:02:48.980694] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T04:02:49.030706] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:02:49.490161] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-17T04:02:50.205840] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:02:50.290170] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-17T04:02:50.947843] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T04:02:51.090170] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-17T04:02:51.398894] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T04:02:51.890178] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-17T04:02:52.690200] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-17T04:02:52.749580] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:02:53.490125] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-17T04:02:53.696376] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T04:02:54.290139] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-17T04:02:54.473386] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:02:54.559754] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T04:02:55.090198] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-17T04:02:55.310448] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T04:02:55.890167] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-17T04:02:56.556454] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:02:56.690136] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-17T04:02:57.417114] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T04:02:57.490121] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-17T04:02:57.817039] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T04:02:58.290136] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-17T04:02:58.956956] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:02:59.090082] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-17T04:02:59.885713] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T04:02:59.894850] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-17T04:03:00.645090] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T04:03:00.690093] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-17T04:03:01.398805] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:03:01.490122] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-17T04:03:02.290123] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-17T04:03:02.452286] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T04:03:03.090241] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-17T04:03:03.890169] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-17T04:03:05.238779] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (3.75 seconds). [2025-09-17T04:03:05.248443] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-17T04:03:05.331382] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:03:05.490099] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-17T04:03:05.539261] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-09-17T04:03:05.594581] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T04:03:06.290140] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-17T04:03:06.920178] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T04:03:07.090198] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-17T04:03:07.319713] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T04:03:07.890169] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-17T04:03:08.044595] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T04:03:08.051150] [INFO ] [REMOTE ] GNW: Full fetch complete (73166 records). [2025-09-17T04:03:08.051349] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-17T04:03:08.474464] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-17T04:03:08.474844] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-17T04:03:08.476189] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-17T04:03:08.476346] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-17T04:03:08.502609] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T04:03:08.506628] [DEBUG] [LOCAL ] GNW: Trimmed 73166 records to 51318 (keeping 200 days of data) [2025-09-17T04:03:08.692265] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-17T04:03:08.837598] [DEBUG] [LOCAL ] GNW: Primary data saved (51318 records). [2025-09-17T04:03:08.837838] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-17T04:03:08.837983] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GNW took 46.3s. Estimated remaining: 3h 26m 57s. Rate: 6.8 symbols/min [2025-09-17T04:03:09.011758] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:09.041492] [DEBUG] [LOCAL ] GOTU: Loaded 27891 existing records from primary storage. [2025-09-17T04:03:09.041712] [INFO ] [MAIN ] GOTU: Loaded 27891 existing records. [2025-09-17T04:03:09.241842] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:09.242431] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-17T04:03:09.242520] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-17T04:03:09.243689] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-17T04:03:09.243799] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-17T04:03:09.461651] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:03:09.498883] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-17T04:03:09.703856] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:09.974517] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T04:03:10.290180] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-17T04:03:10.930536] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:03:11.090245] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-11. [2025-09-17T04:03:11.791285] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:03:11.803435] [INFO ] [REMOTE ] GOOS: Full fetch complete (66209 records). [2025-09-17T04:03:11.803699] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-17T04:03:11.895294] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-17T04:03:12.253362] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-17T04:03:12.253545] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-17T04:03:12.255123] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-17T04:03:12.255213] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-17T04:03:12.258266] [DEBUG] [LOCAL ] GOOS: Trimmed 66209 records to 45921 (keeping 200 days of data) [2025-09-17T04:03:12.557314] [DEBUG] [LOCAL ] GOOS: Primary data saved (45921 records). [2025-09-17T04:03:12.557632] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-17T04:03:12.557967] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GOOS took 25.2s. Estimated remaining: 3h 26m 40s. Rate: 6.9 symbols/min [2025-09-17T04:03:12.709375] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-17T04:03:12.736566] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:12.738064] [DEBUG] [LOCAL ] GPC: No existing data file found in primary storage. [2025-09-17T04:03:12.753332] [WARN ] [MAIN ] GPC: No existing data found, performing full refresh instead. [2025-09-17T04:03:12.769961] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-17T04:03:12.770118] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-17T04:03:12.770488] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-09-17T04:03:12.773475] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:03:12.773627] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-17T04:03:13.169116] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:13.216905] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T04:03:13.490178] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-17T04:03:14.290240] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-17T04:03:14.336295] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:03:14.343406] [INFO ] [REMOTE ] GOF: Full fetch complete (62103 records). [2025-09-17T04:03:14.343678] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-17T04:03:14.757092] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-17T04:03:14.762548] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-17T04:03:14.767896] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-17T04:03:14.769157] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T04:03:14.769283] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-17T04:03:14.774087] [DEBUG] [LOCAL ] GOF: Trimmed 62103 records to 43094 (keeping 200 days of data) [2025-09-17T04:03:14.774345] [INFO ] [REMOTE ] GOLF: Full fetch complete (44694 records). [2025-09-17T04:03:14.774504] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-17T04:03:15.095666] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-11. [2025-09-17T04:03:15.291221] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-17T04:03:15.293135] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-17T04:03:15.295228] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-17T04:03:15.295907] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-17T04:03:15.301421] [DEBUG] [LOCAL ] GOLF: Trimmed 44694 records to 32174 (keeping 200 days of data) [2025-09-17T04:03:15.612756] [DEBUG] [LOCAL ] GOF: Primary data saved (43094 records). [2025-09-17T04:03:15.615665] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-17T04:03:15.616912] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOF took 39.2s. Estimated remaining: 3h 26m 23s. Rate: 6.9 symbols/min [2025-09-17T04:03:15.862574] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:15.911468] [DEBUG] [LOCAL ] GPI: Loaded 10230 existing records from primary storage. [2025-09-17T04:03:15.912999] [INFO ] [MAIN ] GPI: Loaded 10230 existing records. [2025-09-17T04:03:15.961380] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:03:16.028151] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-17T04:03:16.134964] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:16.138442] [DEBUG] [LOCAL ] GOLF: Primary data saved (32174 records). [2025-09-17T04:03:16.138948] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-17T04:03:16.139039] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-17T04:03:16.139224] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-17T04:03:16.139464] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOLF took 38.5s. Estimated remaining: 3h 26m 2s. Rate: 6.9 symbols/min [2025-09-17T04:03:16.144998] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-17T04:03:16.172339] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-17T04:03:16.445561] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:16.510984] [DEBUG] [LOCAL ] GPJA: Loaded 3120 existing records from primary storage. [2025-09-17T04:03:16.561212] [INFO ] [MAIN ] GPJA: Loaded 3120 existing records. [2025-09-17T04:03:16.899826] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:16.929758] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-11. [2025-09-17T04:03:16.935571] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:16.936921] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-17T04:03:16.937007] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-17T04:03:16.937419] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-17T04:03:16.937507] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-17T04:03:17.313677] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:17.490198] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-11. [2025-09-17T04:03:17.731355] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-11 (2.64 seconds). [2025-09-17T04:03:18.057104] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T04:03:18.116788] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T04:03:18.283842] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T04:03:18.293145] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-17T04:03:18.764323] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T04:03:19.090199] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-17T04:03:19.890168] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-17T04:03:19.986952] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T04:03:20.545676] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:03:20.690207] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-17T04:03:21.490229] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-17T04:03:21.787882] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T04:03:22.290200] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-17T04:03:23.090202] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-17T04:03:23.201721] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T04:03:23.721915] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T04:03:23.891619] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:03:23.891831] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-17T04:03:24.690279] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-17T04:03:24.796014] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T04:03:25.490178] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-17T04:03:26.138812] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:03:26.290160] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-17T04:03:27.090122] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-17T04:03:27.173113] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:03:27.556528] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T04:03:27.812056] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:03:27.890157] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-17T04:03:28.690202] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-17T04:03:29.332681] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:03:29.490184] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-17T04:03:30.290170] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-17T04:03:30.414524] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T04:03:30.517681] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T04:03:30.851000] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T04:03:31.090174] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-17T04:03:31.487848] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T04:03:31.890205] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-17T04:03:32.690210] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-17T04:03:33.075963] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T04:03:33.295422] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T04:03:33.490167] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-17T04:03:34.290177] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-17T04:03:34.644909] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T04:03:34.862568] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T04:03:35.090186] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-17T04:03:35.890135] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-17T04:03:36.208536] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T04:03:36.690187] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-17T04:03:37.263514] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T04:03:37.414096] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:03:37.490152] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-17T04:03:38.052618] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T04:03:38.053872] [INFO ] [REMOTE ] GPJA: Full fetch complete (7292 records). [2025-09-17T04:03:38.053958] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-17T04:03:38.300233] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-17T04:03:38.463031] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-17T04:03:38.463175] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-17T04:03:38.463537] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-17T04:03:38.463590] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-17T04:03:38.464103] [DEBUG] [LOCAL ] GPJA: Trimmed 7292 records to 4018 (keeping 200 days of data) [2025-09-17T04:03:38.490485] [DEBUG] [LOCAL ] GPJA: Primary data saved (4018 records). [2025-09-17T04:03:38.490711] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-17T04:03:38.490839] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GPJA took 22.4s. Estimated remaining: 3h 26m 14s. Rate: 6.9 symbols/min [2025-09-17T04:03:38.673271] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:38.716881] [DEBUG] [LOCAL ] GPK: Loaded 39401 existing records from primary storage. [2025-09-17T04:03:38.717079] [INFO ] [MAIN ] GPK: Loaded 39401 existing records. [2025-09-17T04:03:38.900466] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:38.900848] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-17T04:03:38.900914] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-17T04:03:38.901935] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-17T04:03:38.901999] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-17T04:03:39.095392] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-17T04:03:39.269923] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:39.890210] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-17T04:03:40.126050] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T04:03:40.586571] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T04:03:40.599847] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T04:03:40.690113] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-17T04:03:41.490221] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-11. [2025-09-17T04:03:42.106585] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T04:03:42.112106] [INFO ] [REMOTE ] GOTU: Full fetch complete (60025 records). [2025-09-17T04:03:42.112268] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-17T04:03:42.296536] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-17T04:03:42.538170] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-17T04:03:42.538300] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-17T04:03:42.539285] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-17T04:03:42.539355] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-17T04:03:42.540838] [DEBUG] [LOCAL ] GOTU: Trimmed 60025 records to 39634 (keeping 200 days of data) [2025-09-17T04:03:42.780619] [DEBUG] [LOCAL ] GOTU: Primary data saved (39634 records). [2025-09-17T04:03:42.780838] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-17T04:03:42.780987] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GOTU took 33.9s. Estimated remaining: 3h 25m 58s. Rate: 6.9 symbols/min [2025-09-17T04:03:43.053115] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:03:43.090161] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-17T04:03:43.341023] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:03:43.890197] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-17T04:03:44.690265] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-17T04:03:44.778347] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T04:03:44.817392] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T04:03:45.490211] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-17T04:03:46.290143] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-17T04:03:46.400688] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:03:46.420541] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T04:03:47.090201] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-17T04:03:47.751879] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T04:03:47.782260] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T04:03:47.785132] [INFO ] [REMOTE ] GPI: Full fetch complete (20816 records). [2025-09-17T04:03:47.785276] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-17T04:03:47.895284] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-17T04:03:48.192097] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-17T04:03:48.192252] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-17T04:03:48.193389] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-17T04:03:48.193460] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-17T04:03:48.194475] [DEBUG] [LOCAL ] GPI: Trimmed 20816 records to 15155 (keeping 200 days of data) [2025-09-17T04:03:48.298397] [DEBUG] [LOCAL ] GPI: Primary data saved (15155 records). [2025-09-17T04:03:48.298660] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-17T04:03:48.298785] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GPI took 32.7s. Estimated remaining: 3h 25m 45s. Rate: 6.9 symbols/min [2025-09-17T04:03:48.690177] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-17T04:03:49.484984] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T04:03:49.496681] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-17T04:03:50.255792] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T04:03:50.290189] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-17T04:03:51.223946] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T04:03:51.235708] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-17T04:03:51.523259] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T04:03:51.890168] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-17T04:03:52.786144] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T04:03:52.796448] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-17T04:03:53.746633] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T04:03:53.758819] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-17T04:03:54.443369] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:03:54.449801] [INFO ] [REMOTE ] GPC: Full fetch complete (69061 records). [2025-09-17T04:03:54.450201] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-17T04:03:54.859816] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-17T04:03:54.859957] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-17T04:03:54.861073] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-17T04:03:54.861138] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-17T04:03:54.862856] [DEBUG] [LOCAL ] GPC: Trimmed 69061 records to 46858 (keeping 200 days of data) [2025-09-17T04:03:55.186164] [DEBUG] [LOCAL ] GPC: Primary data saved (46858 records). [2025-09-17T04:03:55.186424] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-17T04:03:55.186540] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPC took 42.6s. Estimated remaining: 3h 25m 33s. Rate: 6.9 symbols/min [2025-09-17T04:03:55.512768] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:03:55.525134] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-17T04:03:57.161885] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T04:03:57.173873] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-17T04:03:58.876632] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:03:58.889280] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-17T04:04:00.740520] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T04:04:00.753189] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-17T04:04:02.532200] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T04:04:02.542828] [INFO ] [REMOTE ] GPK: Full fetch complete (75188 records). [2025-09-17T04:04:02.543132] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-17T04:04:02.959209] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-17T04:04:02.959449] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-17T04:04:02.960606] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-17T04:04:02.960709] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-17T04:04:02.962759] [DEBUG] [LOCAL ] GPK: Trimmed 75188 records to 52679 (keeping 200 days of data) [2025-09-17T04:04:03.329400] [DEBUG] [LOCAL ] GPK: Primary data saved (52679 records). [2025-09-17T04:04:03.329677] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-17T04:04:03.329805] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 24.8s. Estimated remaining: 3h 25m 24s. Rate: 6.9 symbols/min [2025-09-17T04:04:03.931554] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.061447] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.112848] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.117590] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.118218] [DEBUG] [LOCAL ] GPN: No existing data file found in primary storage. [2025-09-17T04:04:04.125836] [WARN ] [MAIN ] GPN: No existing data found, performing full refresh instead. [2025-09-17T04:04:04.126603] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-17T04:04:04.126857] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-17T04:04:04.127076] [DEBUG] [LOCAL ] GPN: No primary data file found to delete. [2025-09-17T04:04:04.127125] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-17T04:04:04.209803] [DEBUG] [LOCAL ] GPMT: Loaded 20304 existing records from primary storage. [2025-09-17T04:04:04.259707] [INFO ] [MAIN ] GPMT: Loaded 20304 existing records. [2025-09-17T04:04:04.408205] [DEBUG] [LOCAL ] GPOR: Loaded 16532 existing records from primary storage. [2025-09-17T04:04:04.477159] [DEBUG] [LOCAL ] GPRK: Loaded 28709 existing records from primary storage. [2025-09-17T04:04:04.464110] [INFO ] [MAIN ] GPOR: Loaded 16532 existing records. [2025-09-17T04:04:04.558529] [INFO ] [MAIN ] GPRK: Loaded 28709 existing records. [2025-09-17T04:04:04.844453] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:04.948779] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-17T04:04:05.009637] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:05.045235] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-11. [2025-09-17T04:04:05.043709] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-17T04:04:05.093854] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:05.093736] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-17T04:04:05.144602] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-17T04:04:05.144706] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-17T04:04:05.149838] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-17T04:04:05.155295] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:05.172148] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-17T04:04:05.189479] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-17T04:04:05.217132] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-17T04:04:05.217247] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-17T04:04:05.355502] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-17T04:04:05.379840] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-17T04:04:06.190266] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:06.183448] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:06.237128] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-11. [2025-09-17T04:04:06.268369] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-11. [2025-09-17T04:04:06.376973] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:06.377405] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-11. [2025-09-17T04:04:06.795199] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:04:06.805533] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-17T04:04:07.536875] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T04:04:07.543350] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-17T04:04:07.629788] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T04:04:07.647487] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-17T04:04:07.649532] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T04:04:07.655872] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-17T04:04:08.545740] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T04:04:08.556458] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-17T04:04:08.629761] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T04:04:08.639313] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-17T04:04:08.878421] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T04:04:08.884715] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-17T04:04:09.033670] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:04:09.041871] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-17T04:04:09.335855] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T04:04:09.341144] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-17T04:04:09.799225] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:04:09.805491] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-17T04:04:10.039589] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:04:10.049965] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-17T04:04:10.407832] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T04:04:10.413446] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-17T04:04:10.580364] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:04:10.589818] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-17T04:04:10.728395] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T04:04:11.090141] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-17T04:04:11.302989] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T04:04:11.756487] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:04:11.792432] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T04:04:11.891801] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-17T04:04:11.898598] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T04:04:12.690151] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-17T04:04:13.490218] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-17T04:04:13.596266] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:04:13.852545] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T04:04:14.290195] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-17T04:04:14.887313] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:04:15.090188] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-17T04:04:15.890151] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-17T04:04:16.134537] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T04:04:16.690110] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-17T04:04:16.745450] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:04:17.150890] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T04:04:17.490188] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-17T04:04:18.226453] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:04:18.250689] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T04:04:18.290077] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-17T04:04:19.090146] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-17T04:04:19.890143] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-17T04:04:19.995631] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:04:20.659157] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T04:04:20.690105] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-17T04:04:20.925581] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:04:21.490170] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-17T04:04:22.290137] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-17T04:04:22.348827] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:04:22.425947] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:04:23.038089] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T04:04:23.090094] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-17T04:04:23.890173] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-17T04:04:23.940295] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:04:24.690143] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-17T04:04:25.490101] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-17T04:04:25.680911] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T04:04:25.681815] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T04:04:26.290161] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-17T04:04:27.080778] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T04:04:27.090291] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-17T04:04:27.195690] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:04:27.199550] [INFO ] [REMOTE ] GPOR: Full fetch complete (34640 records). [2025-09-17T04:04:27.199714] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-17T04:04:27.584702] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-17T04:04:27.584825] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-17T04:04:27.585476] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-17T04:04:27.585549] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-17T04:04:27.586617] [DEBUG] [LOCAL ] GPOR: Trimmed 34640 records to 22934 (keeping 200 days of data) [2025-09-17T04:04:27.729304] [DEBUG] [LOCAL ] GPOR: Primary data saved (22934 records). [2025-09-17T04:04:27.729474] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-17T04:04:27.729590] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPOR took 24.4s. Estimated remaining: 3h 25m 38s. Rate: 6.8 symbols/min [2025-09-17T04:04:27.897986] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-17T04:04:27.901942] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:27.923008] [DEBUG] [LOCAL ] GRBK: Loaded 19673 existing records from primary storage. [2025-09-17T04:04:27.923167] [INFO ] [MAIN ] GRBK: Loaded 19673 existing records. [2025-09-17T04:04:28.107684] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:28.108205] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-17T04:04:28.120602] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-17T04:04:28.121055] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T04:04:28.125449] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-17T04:04:28.125991] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-17T04:04:28.490539] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:28.690161] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-17T04:04:29.331748] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:04:29.490165] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-17T04:04:29.631807] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:04:29.635357] [INFO ] [REMOTE ] GPMT: Full fetch complete (37999 records). [2025-09-17T04:04:29.635501] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-17T04:04:30.022062] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-17T04:04:30.022168] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-17T04:04:30.022828] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-17T04:04:30.022913] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-17T04:04:30.023863] [DEBUG] [LOCAL ] GPMT: Trimmed 37999 records to 26872 (keeping 200 days of data) [2025-09-17T04:04:30.180707] [DEBUG] [LOCAL ] GPMT: Primary data saved (26872 records). [2025-09-17T04:04:30.180880] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-17T04:04:30.181015] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPMT took 26.9s. Estimated remaining: 3h 25m 20s. Rate: 6.9 symbols/min [2025-09-17T04:04:30.295234] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-17T04:04:30.353172] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:30.361620] [DEBUG] [LOCAL ] GRC: Loaded 6338 existing records from primary storage. [2025-09-17T04:04:30.361778] [INFO ] [MAIN ] GRC: Loaded 6338 existing records. [2025-09-17T04:04:30.542999] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:30.543311] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-17T04:04:30.543370] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-17T04:04:30.543806] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-17T04:04:30.543877] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-17T04:04:30.930977] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:30.990201] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T04:04:31.090099] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-11. [2025-09-17T04:04:31.890169] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-17T04:04:32.195984] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T04:04:32.202334] [INFO ] [REMOTE ] GPN: Full fetch complete (74647 records). [2025-09-17T04:04:32.202490] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-17T04:04:32.594064] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-17T04:04:32.594282] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-17T04:04:32.595255] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-17T04:04:32.595367] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-17T04:04:32.614035] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:04:32.621757] [DEBUG] [LOCAL ] GPN: Trimmed 74647 records to 52089 (keeping 200 days of data) [2025-09-17T04:04:32.695217] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-11. [2025-09-17T04:04:33.008793] [DEBUG] [LOCAL ] GPN: Primary data saved (52089 records). [2025-09-17T04:04:33.009095] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-17T04:04:33.009216] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPN took 29.7s. Estimated remaining: 3h 25m 2s. Rate: 6.9 symbols/min [2025-09-17T04:04:33.196243] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:33.221405] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:04:33.244334] [DEBUG] [LOCAL ] GRDN: Loaded 15220 existing records from primary storage. [2025-09-17T04:04:33.244596] [INFO ] [MAIN ] GRDN: Loaded 15220 existing records. [2025-09-17T04:04:33.442458] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:33.442904] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-17T04:04:33.442981] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-17T04:04:33.443725] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-17T04:04:33.443793] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-17T04:04:33.500351] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-17T04:04:33.588477] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T04:04:33.824590] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:34.290168] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-11. [2025-09-17T04:04:34.691444] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T04:04:34.698098] [INFO ] [REMOTE ] GPRK: Full fetch complete (56926 records). [2025-09-17T04:04:34.698239] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-17T04:04:35.092997] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-17T04:04:35.125344] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-17T04:04:35.125550] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-17T04:04:35.126752] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-17T04:04:35.126975] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-17T04:04:35.129934] [DEBUG] [LOCAL ] GPRK: Trimmed 56926 records to 39088 (keeping 200 days of data) [2025-09-17T04:04:35.393735] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:04:35.430622] [DEBUG] [LOCAL ] GPRK: Primary data saved (39088 records). [2025-09-17T04:04:35.430967] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-17T04:04:35.431156] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPRK took 32.1s. Estimated remaining: 3h 24m 44s. Rate: 6.9 symbols/min [2025-09-17T04:04:35.690582] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:35.743633] [DEBUG] [LOCAL ] GRMN: Loaded 30105 existing records from primary storage. [2025-09-17T04:04:35.744864] [INFO ] [MAIN ] GRMN: Loaded 30105 existing records. [2025-09-17T04:04:35.895437] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-17T04:04:36.021305] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:36.021793] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-17T04:04:36.021897] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-17T04:04:36.023936] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-17T04:04:36.024046] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-17T04:04:36.464660] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:36.525266] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:04:36.690153] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-17T04:04:36.801745] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:04:37.490121] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-17T04:04:37.574905] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T04:04:38.263213] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T04:04:38.290091] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-17T04:04:39.090132] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-11. [2025-09-17T04:04:39.145736] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T04:04:39.890158] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-17T04:04:40.392073] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T04:04:40.690137] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-17T04:04:41.215924] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:04:41.490140] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-17T04:04:42.078695] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T04:04:42.290128] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-17T04:04:42.323135] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T04:04:42.968052] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T04:04:43.090152] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-17T04:04:43.890169] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-17T04:04:44.039066] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T04:04:44.690146] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-17T04:04:45.495210] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-17T04:04:45.517538] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:04:45.816083] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T04:04:46.155230] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T04:04:46.290140] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-17T04:04:47.090147] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-17T04:04:47.283174] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T04:04:47.890170] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-17T04:04:48.503140] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T04:04:48.663065] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T04:04:48.690152] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-17T04:04:49.490201] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-17T04:04:49.505095] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T04:04:50.290162] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-17T04:04:50.363142] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T04:04:51.090158] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-17T04:04:51.151928] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T04:04:51.890158] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-17T04:04:52.402351] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T04:04:52.690149] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-17T04:04:53.282148] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:04:53.490144] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-17T04:04:53.697991] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T04:04:54.290138] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-17T04:04:55.090093] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-17T04:04:55.128331] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T04:04:55.569698] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T04:04:55.890255] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-17T04:04:56.137309] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T04:04:56.599682] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T04:04:56.690229] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-17T04:04:57.490202] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-17T04:04:57.905001] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T04:04:58.290191] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-17T04:04:58.343365] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:04:59.090151] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-17T04:04:59.455391] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T04:04:59.890160] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-17T04:05:00.659811] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T04:05:00.690168] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-17T04:05:01.303050] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T04:05:01.490139] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-17T04:05:01.581300] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:05:02.290179] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-17T04:05:02.627028] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:05:02.821423] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T04:05:02.823557] [INFO ] [REMOTE ] GRC: Full fetch complete (12802 records). [2025-09-17T04:05:02.823704] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-17T04:05:03.095299] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-17T04:05:03.190798] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-17T04:05:03.190911] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-17T04:05:03.191397] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-17T04:05:03.191456] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-17T04:05:03.192013] [DEBUG] [LOCAL ] GRC: Trimmed 12802 records to 8755 (keeping 200 days of data) [2025-09-17T04:05:03.248136] [DEBUG] [LOCAL ] GRC: Primary data saved (8755 records). [2025-09-17T04:05:03.248329] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-17T04:05:03.248432] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRC took 33.1s. Estimated remaining: 3h 25m 3s. Rate: 6.8 symbols/min [2025-09-17T04:05:03.422932] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:03.459245] [DEBUG] [LOCAL ] GRND: Loaded 37247 existing records from primary storage. [2025-09-17T04:05:03.459453] [INFO ] [MAIN ] GRND: Loaded 37247 existing records. [2025-09-17T04:05:03.638251] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:03.638550] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-17T04:05:03.638610] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-17T04:05:03.639730] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-17T04:05:03.639793] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-17T04:05:03.895369] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-17T04:05:04.001352] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:04.275506] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:05:04.279054] [INFO ] [REMOTE ] GRBK: Full fetch complete (40710 records). [2025-09-17T04:05:04.279190] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-17T04:05:04.685225] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-17T04:05:04.685376] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-17T04:05:04.686147] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-17T04:05:04.686211] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-17T04:05:04.687474] [DEBUG] [LOCAL ] GRBK: Trimmed 40710 records to 27437 (keeping 200 days of data) [2025-09-17T04:05:04.738918] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-17T04:05:04.858459] [DEBUG] [LOCAL ] GRBK: Primary data saved (27437 records). [2025-09-17T04:05:04.858660] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-17T04:05:04.858780] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRBK took 37.1s. Estimated remaining: 3h 24m 44s. Rate: 6.9 symbols/min [2025-09-17T04:05:05.032356] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:05.055878] [DEBUG] [LOCAL ] GRNT: Loaded 24876 existing records from primary storage. [2025-09-17T04:05:05.056051] [INFO ] [MAIN ] GRNT: Loaded 24876 existing records. [2025-09-17T04:05:05.240269] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:05.240555] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-17T04:05:05.240636] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-17T04:05:05.241506] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-17T04:05:05.241585] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-17T04:05:05.490607] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-11. [2025-09-17T04:05:05.613068] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:05.640695] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T04:05:05.840596] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T04:05:05.847095] [INFO ] [REMOTE ] GRDN: Full fetch complete (25340 records). [2025-09-17T04:05:05.847450] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-17T04:05:06.257806] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-17T04:05:06.257955] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-17T04:05:06.258695] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-17T04:05:06.258757] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-17T04:05:06.259684] [DEBUG] [LOCAL ] GRDN: Trimmed 25340 records to 18874 (keeping 200 days of data) [2025-09-17T04:05:06.308491] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-17T04:05:06.377280] [DEBUG] [LOCAL ] GRDN: Primary data saved (18874 records). [2025-09-17T04:05:06.377504] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-17T04:05:06.377659] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 33.4s. Estimated remaining: 3h 24m 25s. Rate: 6.9 symbols/min [2025-09-17T04:05:06.552902] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:06.561949] [DEBUG] [LOCAL ] GROV: Loaded 6863 existing records from primary storage. [2025-09-17T04:05:06.562096] [INFO ] [MAIN ] GROV: Loaded 6863 existing records. [2025-09-17T04:05:06.750678] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:06.751178] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-17T04:05:06.751334] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-17T04:05:06.751821] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-17T04:05:06.751995] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-17T04:05:06.875394] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T04:05:07.106034] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-17T04:05:07.147983] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:07.676380] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T04:05:07.890224] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-11. [2025-09-17T04:05:08.221818] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:05:08.690188] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-17T04:05:09.305485] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:05:09.490156] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-11. [2025-09-17T04:05:10.230744] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T04:05:10.282897] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T04:05:10.291986] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-17T04:05:11.090172] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-17T04:05:11.636503] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:05:11.890137] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-17T04:05:12.372293] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T04:05:12.690199] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-17T04:05:13.388259] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:05:13.394202] [INFO ] [REMOTE ] GRMN: Full fetch complete (60245 records). [2025-09-17T04:05:13.394627] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-17T04:05:13.495372] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-17T04:05:13.783905] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-17T04:05:13.784047] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-17T04:05:13.785021] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-17T04:05:13.785087] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-17T04:05:13.786704] [DEBUG] [LOCAL ] GRMN: Trimmed 60245 records to 41810 (keeping 200 days of data) [2025-09-17T04:05:13.924693] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T04:05:14.112196] [DEBUG] [LOCAL ] GRMN: Primary data saved (41810 records). [2025-09-17T04:05:14.112386] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-17T04:05:14.112555] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GRMN took 38.7s. Estimated remaining: 3h 24m 15s. Rate: 6.9 symbols/min [2025-09-17T04:05:14.296123] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-17T04:05:14.302532] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:14.312167] [DEBUG] [LOCAL ] GRX: Loaded 3340 existing records from primary storage. [2025-09-17T04:05:14.312369] [INFO ] [MAIN ] GRX: Loaded 3340 existing records. [2025-09-17T04:05:14.579228] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:14.579577] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-17T04:05:14.579668] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-17T04:05:14.580179] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-17T04:05:14.580255] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-17T04:05:14.965173] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:15.032009] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:05:15.090196] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-11. [2025-09-17T04:05:15.591547] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T04:05:15.614497] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T04:05:15.890195] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-17T04:05:16.690138] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-17T04:05:17.172784] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T04:05:17.490205] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-17T04:05:17.602561] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:05:18.290219] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-17T04:05:18.849537] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T04:05:19.090205] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-17T04:05:19.890166] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-17T04:05:19.970075] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T04:05:20.417573] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:05:20.514969] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:05:20.690153] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-17T04:05:21.490172] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-17T04:05:22.019072] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T04:05:22.290141] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-17T04:05:23.059333] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T04:05:23.090090] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-17T04:05:23.213922] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T04:05:23.548919] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T04:05:23.890138] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-17T04:05:24.690349] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-17T04:05:25.226239] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T04:05:25.447191] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T04:05:25.490148] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-17T04:05:26.290201] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-17T04:05:26.601539] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T04:05:26.908710] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T04:05:27.090152] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-17T04:05:27.890495] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-17T04:05:27.900007] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T04:05:28.498364] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T04:05:28.690207] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-17T04:05:29.490215] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-17T04:05:29.980080] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T04:05:30.065721] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T04:05:30.290206] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-17T04:05:30.889244] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T04:05:31.090158] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-17T04:05:31.890205] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-17T04:05:32.690156] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-17T04:05:32.766270] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:05:33.221774] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T04:05:33.233856] [INFO ] [REMOTE ] GRNT: Full fetch complete (48293 records). [2025-09-17T04:05:33.234214] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-17T04:05:33.499394] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-17T04:05:33.542349] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T04:05:33.674845] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-17T04:05:33.674981] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-17T04:05:33.675785] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-17T04:05:33.675903] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-17T04:05:33.678418] [DEBUG] [LOCAL ] GRNT: Trimmed 48293 records to 33961 (keeping 200 days of data) [2025-09-17T04:05:33.889540] [DEBUG] [LOCAL ] GRNT: Primary data saved (33961 records). [2025-09-17T04:05:33.889748] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-17T04:05:33.889859] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRNT took 29.0s. Estimated remaining: 3h 24m 22s. Rate: 6.9 symbols/min [2025-09-17T04:05:34.067349] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:34.111600] [DEBUG] [LOCAL ] GS: Loaded 38615 existing records from primary storage. [2025-09-17T04:05:34.111798] [INFO ] [MAIN ] GS: Loaded 38615 existing records. [2025-09-17T04:05:34.293074] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-17T04:05:34.297748] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:34.298993] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-17T04:05:34.299090] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-17T04:05:34.300439] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-17T04:05:34.300738] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-17T04:05:34.667122] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:34.922463] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T04:05:35.090141] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-11. [2025-09-17T04:05:35.259505] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T04:05:35.890139] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-17T04:05:36.690160] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-17T04:05:36.862908] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T04:05:37.117447] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T04:05:37.214160] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T04:05:37.490134] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-17T04:05:38.294389] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-17T04:05:38.296387] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T04:05:38.854892] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T04:05:39.090205] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-17T04:05:39.890133] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-17T04:05:40.690138] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-17T04:05:41.209446] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T04:05:41.251790] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T04:05:41.291306] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T04:05:41.490145] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-17T04:05:42.290154] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-17T04:05:42.745607] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T04:05:42.747030] [INFO ] [REMOTE ] GROV: Full fetch complete (15125 records). [2025-09-17T04:05:42.747126] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-17T04:05:43.098306] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-17T04:05:43.135675] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-17T04:05:43.135831] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-17T04:05:43.136375] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-17T04:05:43.136456] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-17T04:05:43.137130] [DEBUG] [LOCAL ] GROV: Trimmed 15125 records to 9293 (keeping 200 days of data) [2025-09-17T04:05:43.199562] [DEBUG] [LOCAL ] GROV: Primary data saved (9293 records). [2025-09-17T04:05:43.199857] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-17T04:05:43.199984] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GROV took 36.8s. Estimated remaining: 3h 24m 14s. Rate: 6.8 symbols/min [2025-09-17T04:05:43.376808] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:43.412863] [DEBUG] [LOCAL ] GSBD: Loaded 28138 existing records from primary storage. [2025-09-17T04:05:43.413076] [INFO ] [MAIN ] GSBD: Loaded 28138 existing records. [2025-09-17T04:05:43.602380] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:43.602828] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-17T04:05:43.602904] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-17T04:05:43.603850] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-17T04:05:43.603922] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-17T04:05:43.895438] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-17T04:05:44.006603] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-17T04:05:44.009618] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:44.522333] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T04:05:44.662251] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:05:44.668748] [INFO ] [REMOTE ] GRND: Full fetch complete (69782 records). [2025-09-17T04:05:44.668880] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-17T04:05:44.698583] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-11. [2025-09-17T04:05:45.066771] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-17T04:05:45.066893] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-17T04:05:45.067775] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-17T04:05:45.067836] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-17T04:05:45.069364] [DEBUG] [LOCAL ] GRND: Trimmed 69782 records to 50159 (keeping 200 days of data) [2025-09-17T04:05:45.381280] [DEBUG] [LOCAL ] GRND: Primary data saved (50159 records). [2025-09-17T04:05:45.381460] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-17T04:05:45.381564] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRND took 42.1s. Estimated remaining: 3h 23m 56s. Rate: 6.9 symbols/min [2025-09-17T04:05:45.495274] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-17T04:05:45.559171] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:45.597278] [DEBUG] [LOCAL ] GSK: Loaded 39887 existing records from primary storage. [2025-09-17T04:05:45.597504] [INFO ] [MAIN ] GSK: Loaded 39887 existing records. [2025-09-17T04:05:45.778900] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:45.779244] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-17T04:05:45.779334] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-17T04:05:45.780520] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-17T04:05:45.780622] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-17T04:05:46.143449] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:46.295196] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-11. [2025-09-17T04:05:46.309967] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T04:05:47.090153] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-17T04:05:47.506039] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T04:05:47.824847] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T04:05:47.890144] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-17T04:05:48.609825] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T04:05:48.611799] [INFO ] [REMOTE ] GRX: Full fetch complete (6340 records). [2025-09-17T04:05:48.611921] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-17T04:05:48.695268] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-17T04:05:49.028307] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-17T04:05:49.030030] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T04:05:49.030267] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-17T04:05:49.040854] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-17T04:05:49.041462] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-17T04:05:49.042074] [DEBUG] [LOCAL ] GRX: Trimmed 6340 records to 4268 (keeping 200 days of data) [2025-09-17T04:05:49.067773] [DEBUG] [LOCAL ] GRX: Primary data saved (4268 records). [2025-09-17T04:05:49.067872] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-17T04:05:49.067981] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 35.0s. Estimated remaining: 3h 23m 40s. Rate: 6.9 symbols/min [2025-09-17T04:05:49.240959] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:49.267472] [DEBUG] [LOCAL ] GSL: Loaded 24570 existing records from primary storage. [2025-09-17T04:05:49.267690] [INFO ] [MAIN ] GSL: Loaded 24570 existing records. [2025-09-17T04:05:49.448735] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:49.449046] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-17T04:05:49.449109] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-17T04:05:49.449741] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-17T04:05:49.449805] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-17T04:05:49.495328] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-17T04:05:49.833783] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:50.290113] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-17T04:05:50.769158] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T04:05:51.090124] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-17T04:05:51.618194] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:05:51.663066] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T04:05:51.890136] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-17T04:05:52.690136] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-17T04:05:52.926558] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T04:05:53.490162] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-17T04:05:53.748592] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T04:05:54.115521] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:05:54.290128] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-17T04:05:55.090157] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-17T04:05:55.270676] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T04:05:55.890263] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-17T04:05:56.450000] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T04:05:56.587165] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:05:56.690184] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-17T04:05:57.490194] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-11. [2025-09-17T04:05:57.904418] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T04:05:58.290141] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-17T04:05:58.744761] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-17T04:05:58.907783] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:05:59.090140] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-17T04:05:59.890166] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-17T04:06:00.295425] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T04:06:00.327375] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T04:06:00.690143] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-17T04:06:01.490139] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-17T04:06:01.599264] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:06:02.290162] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-17T04:06:03.090200] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-17T04:06:03.674591] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-17T04:06:03.890182] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-17T04:06:04.190193] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-17T04:06:04.690139] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-17T04:06:04.732601] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T04:06:05.299055] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T04:06:05.490180] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-17T04:06:05.961994] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T04:06:06.067495] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:06:06.290152] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-17T04:06:07.090172] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-17T04:06:07.277286] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T04:06:07.826020] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T04:06:07.890217] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-17T04:06:08.690120] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-17T04:06:08.958876] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T04:06:08.965358] [INFO ] [REMOTE ] GS: Full fetch complete (75834 records). [2025-09-17T04:06:08.965581] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-17T04:06:09.358665] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-17T04:06:09.358781] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-17T04:06:09.359716] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-17T04:06:09.359795] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-17T04:06:09.361445] [DEBUG] [LOCAL ] GS: Trimmed 75834 records to 52208 (keeping 200 days of data) [2025-09-17T04:06:09.493541] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-17T04:06:09.517035] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T04:06:09.734264] [DEBUG] [LOCAL ] GS: Primary data saved (52208 records). [2025-09-17T04:06:09.734433] [INFO ] [MAIN ] GS: Full history saved. [2025-09-17T04:06:09.734525] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GS took 35.8s. Estimated remaining: 3h 23m 48s. Rate: 6.8 symbols/min [2025-09-17T04:06:09.905351] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:09.941826] [DEBUG] [LOCAL ] GTES: Loaded 37387 existing records from primary storage. [2025-09-17T04:06:09.942021] [INFO ] [MAIN ] GTES: Loaded 37387 existing records. [2025-09-17T04:06:10.126664] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:10.127078] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-17T04:06:10.127325] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-17T04:06:10.134729] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-17T04:06:10.146628] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-17T04:06:10.196588] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T04:06:10.298957] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-17T04:06:10.520013] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:11.090118] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-17T04:06:11.197574] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:06:11.824205] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T04:06:11.890077] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-17T04:06:12.525606] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T04:06:12.690152] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-17T04:06:13.320816] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:06:13.490159] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-11. [2025-09-17T04:06:14.290193] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-17T04:06:14.629297] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T04:06:15.053776] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:06:15.090080] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-17T04:06:15.890167] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-17T04:06:16.492761] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-17T04:06:16.690150] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-17T04:06:17.490170] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-17T04:06:17.639021] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-17T04:06:17.730376] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T04:06:17.735222] [INFO ] [REMOTE ] GSBD: Full fetch complete (58278 records). [2025-09-17T04:06:17.735361] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-17T04:06:18.119182] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-17T04:06:18.119301] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-17T04:06:18.120199] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-17T04:06:18.120333] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-17T04:06:18.121628] [DEBUG] [LOCAL ] GSBD: Trimmed 58278 records to 39330 (keeping 200 days of data) [2025-09-17T04:06:18.231857] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:06:18.328378] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-17T04:06:18.402864] [DEBUG] [LOCAL ] GSBD: Primary data saved (39330 records). [2025-09-17T04:06:18.403130] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-17T04:06:18.403258] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSBD took 35.2s. Estimated remaining: 3h 23m 39s. Rate: 6.8 symbols/min [2025-09-17T04:06:18.578842] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:18.613949] [DEBUG] [LOCAL ] GTLS: Loaded 32299 existing records from primary storage. [2025-09-17T04:06:18.614144] [INFO ] [MAIN ] GTLS: Loaded 32299 existing records. [2025-09-17T04:06:18.791236] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:18.791484] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-17T04:06:18.791547] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-17T04:06:18.792244] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-17T04:06:18.792307] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-17T04:06:19.095249] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-17T04:06:19.147234] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:19.394107] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T04:06:19.400777] [INFO ] [REMOTE ] GSK: Full fetch complete (77328 records). [2025-09-17T04:06:19.400959] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-17T04:06:19.814713] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-17T04:06:19.814827] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-17T04:06:19.815788] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-17T04:06:19.815849] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-17T04:06:19.817438] [DEBUG] [LOCAL ] GSK: Trimmed 77328 records to 53504 (keeping 200 days of data) [2025-09-17T04:06:19.909069] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-11. [2025-09-17T04:06:20.076831] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T04:06:20.213757] [DEBUG] [LOCAL ] GSK: Primary data saved (53504 records). [2025-09-17T04:06:20.214089] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-17T04:06:20.214273] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSK took 34.8s. Estimated remaining: 3h 23m 21s. Rate: 6.9 symbols/min [2025-09-17T04:06:20.431436] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:20.481081] [DEBUG] [LOCAL ] GTN: Loaded 33708 existing records from primary storage. [2025-09-17T04:06:20.481332] [INFO ] [MAIN ] GTN: Loaded 33708 existing records. [2025-09-17T04:06:20.703567] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-17T04:06:20.817528] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:20.821315] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T04:06:20.821568] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-17T04:06:20.821765] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-17T04:06:20.836212] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-17T04:06:20.836363] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-17T04:06:21.417046] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:21.490211] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-17T04:06:21.626850] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:06:22.290155] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-11. [2025-09-17T04:06:22.361565] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T04:06:22.779279] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:06:22.783554] [INFO ] [REMOTE ] GSL: Full fetch complete (48409 records). [2025-09-17T04:06:22.783706] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-17T04:06:23.095388] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-17T04:06:23.168065] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-17T04:06:23.168187] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-17T04:06:23.169103] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-17T04:06:23.169169] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-17T04:06:23.170874] [DEBUG] [LOCAL ] GSL: Trimmed 48409 records to 33934 (keeping 200 days of data) [2025-09-17T04:06:23.388941] [DEBUG] [LOCAL ] GSL: Primary data saved (33934 records). [2025-09-17T04:06:23.389139] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-17T04:06:23.389241] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GSL took 34.3s. Estimated remaining: 3h 23m 4s. Rate: 6.9 symbols/min [2025-09-17T04:06:23.576232] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:23.599914] [DEBUG] [LOCAL ] GTY: Loaded 21887 existing records from primary storage. [2025-09-17T04:06:23.600100] [INFO ] [MAIN ] GTY: Loaded 21887 existing records. [2025-09-17T04:06:23.794458] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:23.794881] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-17T04:06:23.795064] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-17T04:06:23.795984] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-17T04:06:23.796057] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-17T04:06:23.892758] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-17T04:06:24.037215] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:06:24.224454] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:24.383119] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T04:06:24.690174] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-11. [2025-09-17T04:06:25.490226] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-17T04:06:25.758878] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T04:06:25.788848] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:06:26.290197] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-17T04:06:26.750529] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T04:06:27.090196] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-17T04:06:27.890098] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-17T04:06:28.398352] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T04:06:28.675114] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:06:28.690075] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-17T04:06:28.906515] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:06:29.490166] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-17T04:06:30.238786] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T04:06:30.290190] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-17T04:06:31.095244] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-17T04:06:31.123869] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T04:06:31.893265] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-17T04:06:31.899511] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T04:06:32.690228] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-17T04:06:32.801991] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:06:33.202436] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T04:06:33.490184] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-17T04:06:34.209604] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:06:34.290191] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-17T04:06:35.020662] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T04:06:35.090153] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-17T04:06:35.595360] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T04:06:35.890173] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-17T04:06:36.306020] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T04:06:36.690145] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-17T04:06:36.825419] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T04:06:37.490163] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-17T04:06:38.290204] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-17T04:06:38.427277] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:06:39.086742] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T04:06:39.091172] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-17T04:06:39.901531] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-17T04:06:39.910338] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:06:40.690139] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-17T04:06:40.813617] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:06:41.292112] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T04:06:41.490136] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-17T04:06:42.117858] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T04:06:42.290095] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-17T04:06:43.095259] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-17T04:06:43.112150] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:06:43.893049] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-17T04:06:43.897513] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T04:06:43.904552] [INFO ] [REMOTE ] GTES: Full fetch complete (73810 records). [2025-09-17T04:06:43.904756] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-17T04:06:44.337936] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-17T04:06:44.338137] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-17T04:06:44.339922] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-17T04:06:44.340010] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-17T04:06:44.342540] [DEBUG] [LOCAL ] GTES: Trimmed 73810 records to 50740 (keeping 200 days of data) [2025-09-17T04:06:44.690961] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-17T04:06:44.703967] [DEBUG] [LOCAL ] GTES: Primary data saved (50740 records). [2025-09-17T04:06:44.704942] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-17T04:06:44.705443] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GTES took 35.0s. Estimated remaining: 3h 23m 13s. Rate: 6.8 symbols/min [2025-09-17T04:06:44.885237] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:44.926771] [DEBUG] [LOCAL ] GUG: Loaded 8867 existing records from primary storage. [2025-09-17T04:06:44.927568] [INFO ] [MAIN ] GUG: Loaded 8867 existing records. [2025-09-17T04:06:44.929574] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T04:06:45.128978] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:45.129429] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-17T04:06:45.129728] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-17T04:06:45.130306] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-17T04:06:45.130444] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-17T04:06:45.344731] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:06:45.497458] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-17T04:06:45.536881] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:45.831743] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T04:06:45.838240] [INFO ] [REMOTE ] GTLS: Full fetch complete (61289 records). [2025-09-17T04:06:45.838457] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-17T04:06:46.248420] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-17T04:06:46.248561] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-17T04:06:46.249509] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-17T04:06:46.249585] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-17T04:06:46.251128] [DEBUG] [LOCAL ] GTLS: Trimmed 61289 records to 43162 (keeping 200 days of data) [2025-09-17T04:06:46.305236] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-17T04:06:46.539496] [DEBUG] [LOCAL ] GTLS: Primary data saved (43162 records). [2025-09-17T04:06:46.539751] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-17T04:06:46.539876] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTLS took 28.1s. Estimated remaining: 3h 22m 54s. Rate: 6.9 symbols/min [2025-09-17T04:06:46.724834] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:46.740269] [DEBUG] [LOCAL ] GUT: Loaded 11583 existing records from primary storage. [2025-09-17T04:06:46.740561] [INFO ] [MAIN ] GUT: Loaded 11583 existing records. [2025-09-17T04:06:46.933425] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:06:46.976910] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:46.978350] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-17T04:06:46.978998] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-17T04:06:46.979518] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-17T04:06:46.979596] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-17T04:06:47.096795] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-17T04:06:47.392430] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:47.900398] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-11. [2025-09-17T04:06:47.907976] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T04:06:48.039293] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T04:06:48.634034] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:06:48.690121] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-17T04:06:49.490192] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-17T04:06:49.696583] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T04:06:50.290160] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-17T04:06:51.095321] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-11. [2025-09-17T04:06:51.113718] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T04:06:51.254959] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T04:06:51.890175] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-17T04:06:51.997043] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T04:06:52.690184] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-17T04:06:53.490207] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-17T04:06:53.653535] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T04:06:53.701145] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T04:06:54.290129] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-17T04:06:54.510385] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:06:55.028825] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T04:06:55.090256] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-17T04:06:55.878706] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:06:55.890095] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-17T04:06:56.690164] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-17T04:06:56.785950] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T04:06:57.490277] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-17T04:06:58.280950] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T04:06:58.291016] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-17T04:06:58.961845] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T04:06:58.988597] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T04:06:59.090239] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-17T04:06:59.890217] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-17T04:07:00.637511] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:07:00.643887] [INFO ] [REMOTE ] GTN: Full fetch complete (66308 records). [2025-09-17T04:07:00.644145] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-17T04:07:00.695383] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-17T04:07:01.063170] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-17T04:07:01.065512] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-17T04:07:01.067585] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-17T04:07:01.069716] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:07:01.069792] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-17T04:07:01.076280] [DEBUG] [LOCAL ] GTN: Trimmed 66308 records to 45912 (keeping 200 days of data) [2025-09-17T04:07:01.364338] [DEBUG] [LOCAL ] GTN: Primary data saved (45912 records). [2025-09-17T04:07:01.364567] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-17T04:07:01.364729] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 41.2s. Estimated remaining: 3h 22m 54s. Rate: 6.9 symbols/min [2025-09-17T04:07:01.495424] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-17T04:07:01.550322] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:01.575481] [DEBUG] [LOCAL ] GVA: Loaded 24076 existing records from primary storage. [2025-09-17T04:07:01.575759] [INFO ] [MAIN ] GVA: Loaded 24076 existing records. [2025-09-17T04:07:01.762845] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:01.763162] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-17T04:07:01.763239] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-17T04:07:01.763937] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-17T04:07:01.764010] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-17T04:07:02.147741] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:02.167991] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T04:07:02.290181] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-17T04:07:02.703015] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T04:07:03.090180] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-17T04:07:03.101631] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T04:07:03.890217] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-11. [2025-09-17T04:07:04.163760] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:07:04.690197] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-17T04:07:05.134582] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T04:07:05.490222] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-17T04:07:05.696812] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T04:07:05.699932] [INFO ] [REMOTE ] GUT: Full fetch complete (23253 records). [2025-09-17T04:07:05.700106] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-17T04:07:06.127569] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-17T04:07:06.137498] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-17T04:07:06.139619] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-17T04:07:06.140348] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T04:07:06.140733] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-17T04:07:06.146240] [DEBUG] [LOCAL ] GUT: Trimmed 23253 records to 15668 (keeping 200 days of data) [2025-09-17T04:07:06.247419] [DEBUG] [LOCAL ] GUT: Primary data saved (15668 records). [2025-09-17T04:07:06.247682] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-17T04:07:06.247813] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GUT took 19.7s. Estimated remaining: 3h 22m 40s. Rate: 6.9 symbols/min [2025-09-17T04:07:06.295183] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-17T04:07:06.432803] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:06.447939] [DEBUG] [LOCAL ] GWH: Loaded 12976 existing records from primary storage. [2025-09-17T04:07:06.448147] [INFO ] [MAIN ] GWH: Loaded 12976 existing records. [2025-09-17T04:07:06.639500] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:06.639814] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-17T04:07:06.639876] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-17T04:07:06.640300] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-17T04:07:06.640359] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-17T04:07:07.011998] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:07.090157] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-11. [2025-09-17T04:07:07.254525] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:07:07.890140] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-17T04:07:08.069838] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:07:08.690139] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-17T04:07:09.293028] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T04:07:09.439371] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:07:09.490099] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-17T04:07:10.290141] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-17T04:07:10.438096] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T04:07:11.090208] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-17T04:07:11.627984] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:07:11.890178] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-17T04:07:12.016050] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T04:07:12.690204] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-17T04:07:13.163845] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T04:07:13.169607] [INFO ] [REMOTE ] GTY: Full fetch complete (42785 records). [2025-09-17T04:07:13.169849] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-17T04:07:13.495007] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-17T04:07:13.736230] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-17T04:07:13.736426] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-17T04:07:13.737759] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-17T04:07:13.737887] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-17T04:07:13.739441] [DEBUG] [LOCAL ] GTY: Trimmed 42785 records to 30319 (keeping 200 days of data) [2025-09-17T04:07:13.966859] [DEBUG] [LOCAL ] GTY: Primary data saved (30319 records). [2025-09-17T04:07:13.967061] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-17T04:07:13.967209] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GTY took 50.6s. Estimated remaining: 3h 22m 30s. Rate: 6.9 symbols/min [2025-09-17T04:07:14.198726] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T04:07:14.197032] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:14.216788] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T04:07:14.257019] [DEBUG] [LOCAL ] GWRE: Loaded 30089 existing records from primary storage. [2025-09-17T04:07:14.257215] [INFO ] [MAIN ] GWRE: Loaded 30089 existing records. [2025-09-17T04:07:14.295285] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-17T04:07:14.445144] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:14.445423] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-17T04:07:14.445494] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-17T04:07:14.446316] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-17T04:07:14.446383] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-17T04:07:14.817713] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:15.090173] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-17T04:07:15.192335] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T04:07:15.890138] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-17T04:07:16.607204] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:07:16.657523] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:07:16.690089] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-17T04:07:17.490176] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-11. [2025-09-17T04:07:18.146554] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:07:18.290127] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-17T04:07:18.947623] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T04:07:18.949776] [INFO ] [REMOTE ] GUG: Full fetch complete (19981 records). [2025-09-17T04:07:18.949876] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-17T04:07:19.098482] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-17T04:07:19.329790] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-17T04:07:19.329907] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-17T04:07:19.330518] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-17T04:07:19.330671] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-17T04:07:19.362598] [DEBUG] [LOCAL ] GUG: Trimmed 19981 records to 12308 (keeping 200 days of data) [2025-09-17T04:07:19.365289] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T04:07:19.450527] [DEBUG] [LOCAL ] GUG: Primary data saved (12308 records). [2025-09-17T04:07:19.450753] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-17T04:07:19.450867] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUG took 34.7s. Estimated remaining: 3h 22m 16s. Rate: 6.9 symbols/min [2025-09-17T04:07:19.623872] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:19.639599] [DEBUG] [LOCAL ] GWW: Loaded 14090 existing records from primary storage. [2025-09-17T04:07:19.639782] [INFO ] [MAIN ] GWW: Loaded 14090 existing records. [2025-09-17T04:07:19.819065] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:19.819331] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-17T04:07:19.819392] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-17T04:07:19.819948] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-17T04:07:19.820009] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-17T04:07:19.896054] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-17T04:07:20.196904] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:20.573951] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T04:07:20.690147] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-11. [2025-09-17T04:07:20.741458] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T04:07:21.490153] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-17T04:07:21.798859] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T04:07:22.260194] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T04:07:22.290160] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-17T04:07:23.090111] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-17T04:07:23.331043] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:07:23.890132] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-17T04:07:24.186816] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:07:24.681865] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:07:24.690076] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-17T04:07:25.490131] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-17T04:07:25.539186] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:07:26.290144] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-17T04:07:26.813315] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:07:27.090129] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-17T04:07:27.182775] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T04:07:27.890188] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-17T04:07:28.676835] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T04:07:28.690073] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-17T04:07:29.081479] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T04:07:29.490136] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-17T04:07:30.290145] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-17T04:07:30.453630] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T04:07:30.732803] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:07:31.090163] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-17T04:07:31.493578] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T04:07:31.890151] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-17T04:07:32.509972] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:07:32.690158] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-17T04:07:32.783726] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:07:33.490156] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-17T04:07:34.045452] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T04:07:34.290202] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-17T04:07:34.722972] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T04:07:34.726839] [INFO ] [REMOTE ] GVA: Full fetch complete (48825 records). [2025-09-17T04:07:34.726972] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-17T04:07:35.091273] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-17T04:07:35.106538] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-17T04:07:35.107449] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-17T04:07:35.108306] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-17T04:07:35.108480] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-17T04:07:35.110114] [DEBUG] [LOCAL ] GVA: Trimmed 48825 records to 34117 (keeping 200 days of data) [2025-09-17T04:07:35.234979] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T04:07:35.355626] [DEBUG] [LOCAL ] GVA: Primary data saved (34117 records). [2025-09-17T04:07:35.355826] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-17T04:07:35.355960] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GVA took 34.0s. Estimated remaining: 3h 22m 18s. Rate: 6.9 symbols/min [2025-09-17T04:07:35.529330] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:35.562851] [DEBUG] [LOCAL ] GXO: Loaded 34488 existing records from primary storage. [2025-09-17T04:07:35.563006] [INFO ] [MAIN ] GXO: Loaded 34488 existing records. [2025-09-17T04:07:35.751187] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:35.751500] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-17T04:07:35.751578] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-17T04:07:35.752461] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-17T04:07:35.752571] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-17T04:07:35.899323] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-17T04:07:36.124177] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:36.411935] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T04:07:36.690126] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-17T04:07:37.485297] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T04:07:37.493046] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-11. [2025-09-17T04:07:37.686454] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T04:07:38.290138] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-17T04:07:38.961675] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:07:39.056722] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T04:07:39.059368] [INFO ] [REMOTE ] GWH: Full fetch complete (20288 records). [2025-09-17T04:07:39.059471] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-17T04:07:39.095256] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-17T04:07:39.447153] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-17T04:07:39.447326] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-17T04:07:39.448467] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-17T04:07:39.448566] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-17T04:07:39.450859] [DEBUG] [LOCAL ] GWH: Trimmed 20288 records to 15026 (keeping 200 days of data) [2025-09-17T04:07:39.547292] [DEBUG] [LOCAL ] GWH: Primary data saved (15026 records). [2025-09-17T04:07:39.547530] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-17T04:07:39.547682] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GWH took 33.3s. Estimated remaining: 3h 22m 3s. Rate: 6.9 symbols/min [2025-09-17T04:07:39.733910] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:39.737478] [DEBUG] [LOCAL ] GYLD: Loaded 1117 existing records from primary storage. [2025-09-17T04:07:39.737619] [INFO ] [MAIN ] GYLD: Loaded 1117 existing records. [2025-09-17T04:07:39.895273] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-17T04:07:39.930695] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:39.931028] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-17T04:07:39.931117] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-17T04:07:39.931316] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-17T04:07:39.931395] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-17T04:07:40.332030] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:40.351751] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T04:07:40.690150] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-11. [2025-09-17T04:07:41.024763] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T04:07:41.247581] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T04:07:41.490136] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-17T04:07:42.290135] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-17T04:07:43.090134] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-17T04:07:43.291616] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T04:07:43.312838] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T04:07:43.890134] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-17T04:07:44.293098] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T04:07:44.690141] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-17T04:07:44.862446] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T04:07:45.490138] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-17T04:07:45.857892] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T04:07:46.290167] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-17T04:07:46.655964] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:07:47.090145] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-17T04:07:47.873495] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:07:47.890073] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-17T04:07:48.556462] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:07:48.561960] [INFO ] [REMOTE ] GWRE: Full fetch complete (61728 records). [2025-09-17T04:07:48.562130] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-17T04:07:48.695252] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-17T04:07:48.968953] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-17T04:07:48.969067] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-17T04:07:48.969922] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-17T04:07:48.969984] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-17T04:07:48.971386] [DEBUG] [LOCAL ] GWRE: Trimmed 61728 records to 41517 (keeping 200 days of data) [2025-09-17T04:07:49.169009] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T04:07:49.241249] [DEBUG] [LOCAL ] GWRE: Primary data saved (41517 records). [2025-09-17T04:07:49.241428] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-17T04:07:49.241558] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 35.3s. Estimated remaining: 3h 21m 55s. Rate: 6.9 symbols/min [2025-09-17T04:07:49.425356] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:49.457429] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T04:07:49.496045] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-17T04:07:49.498721] [DEBUG] [LOCAL ] H: Loaded 33240 existing records from primary storage. [2025-09-17T04:07:49.498907] [INFO ] [MAIN ] H: Loaded 33240 existing records. [2025-09-17T04:07:49.684189] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:49.684529] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-17T04:07:49.684619] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-17T04:07:49.685570] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-17T04:07:49.685673] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-17T04:07:50.055727] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:50.290158] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-17T04:07:50.618017] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T04:07:51.090204] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-17T04:07:51.290625] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T04:07:51.441337] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T04:07:51.890158] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-17T04:07:52.690169] [INFO ] [REMOTE ] H: Fetching primary data for 2024-11. [2025-09-17T04:07:53.003592] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T04:07:53.490183] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-17T04:07:54.163029] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:07:54.290196] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-17T04:07:54.711230] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T04:07:55.090172] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-17T04:07:55.162408] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:07:55.890192] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-17T04:07:56.535484] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T04:07:56.690147] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-17T04:07:57.135201] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T04:07:57.496425] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-17T04:07:57.515232] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T04:07:57.931590] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T04:07:58.290148] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-17T04:07:59.090142] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-17T04:07:59.636241] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T04:07:59.890110] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-17T04:08:00.160001] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:08:00.163946] [INFO ] [REMOTE ] GWW: Full fetch complete (29014 records). [2025-09-17T04:08:00.164064] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-17T04:08:00.355933] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T04:08:00.543157] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-17T04:08:00.543267] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-17T04:08:00.543864] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-17T04:08:00.543924] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-17T04:08:00.544767] [DEBUG] [LOCAL ] GWW: Trimmed 29014 records to 20108 (keeping 200 days of data) [2025-09-17T04:08:00.688097] [DEBUG] [LOCAL ] GWW: Primary data saved (20108 records). [2025-09-17T04:08:00.688262] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-17T04:08:00.688377] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GWW took 41.2s. Estimated remaining: 3h 21m 50s. Rate: 6.9 symbols/min [2025-09-17T04:08:00.695311] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-17T04:08:00.865715] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:00.896412] [DEBUG] [LOCAL ] HAE: Loaded 28192 existing records from primary storage. [2025-09-17T04:08:00.896638] [INFO ] [MAIN ] HAE: Loaded 28192 existing records. [2025-09-17T04:08:01.074053] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:01.074351] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-17T04:08:01.074429] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-17T04:08:01.075308] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-17T04:08:01.075375] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-17T04:08:01.366351] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T04:08:01.454397] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:01.490165] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-11. [2025-09-17T04:08:02.290130] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-17T04:08:02.932363] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T04:08:03.090128] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-17T04:08:03.773355] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T04:08:03.810550] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T04:08:03.890159] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-17T04:08:04.690151] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-17T04:08:05.269361] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:08:05.490187] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-17T04:08:06.290165] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-17T04:08:06.334375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:08:06.778163] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T04:08:06.780263] [INFO ] [REMOTE ] GYLD: Full fetch complete (1990 records). [2025-09-17T04:08:06.780432] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-17T04:08:07.098594] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-17T04:08:07.175707] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-17T04:08:07.193979] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-17T04:08:07.196700] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-17T04:08:07.198425] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T04:08:07.198531] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-17T04:08:07.206754] [DEBUG] [LOCAL ] GYLD: Trimmed 1990 records to 1521 (keeping 200 days of data) [2025-09-17T04:08:07.219372] [DEBUG] [LOCAL ] GYLD: Primary data saved (1521 records). [2025-09-17T04:08:07.219478] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-17T04:08:07.219587] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GYLD took 27.7s. Estimated remaining: 3h 21m 38s. Rate: 6.9 symbols/min [2025-09-17T04:08:07.446774] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:07.486177] [DEBUG] [LOCAL ] HAFN: Loaded 31774 existing records from primary storage. [2025-09-17T04:08:07.486365] [INFO ] [MAIN ] HAFN: Loaded 31774 existing records. [2025-09-17T04:08:07.680175] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:07.680508] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-17T04:08:07.680575] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-17T04:08:07.681396] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-17T04:08:07.681472] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-17T04:08:07.901228] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-17T04:08:08.062777] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:08.690163] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-17T04:08:08.771393] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T04:08:09.490316] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-17T04:08:09.614625] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T04:08:10.201998] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T04:08:10.290166] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-11. [2025-09-17T04:08:10.946531] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T04:08:10.952091] [INFO ] [REMOTE ] GXO: Full fetch complete (69705 records). [2025-09-17T04:08:10.952248] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-17T04:08:11.095330] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-17T04:08:11.347656] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-17T04:08:11.347784] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-17T04:08:11.348669] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-17T04:08:11.348726] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-17T04:08:11.350329] [DEBUG] [LOCAL ] GXO: Trimmed 69705 records to 47925 (keeping 200 days of data) [2025-09-17T04:08:11.612305] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T04:08:11.676331] [DEBUG] [LOCAL ] GXO: Primary data saved (47925 records). [2025-09-17T04:08:11.676496] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-17T04:08:11.676597] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GXO took 36.3s. Estimated remaining: 3h 21m 24s. Rate: 6.9 symbols/min [2025-09-17T04:08:11.857145] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:11.896842] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-17T04:08:11.901136] [DEBUG] [LOCAL ] HAL: Loaded 40068 existing records from primary storage. [2025-09-17T04:08:11.901377] [INFO ] [MAIN ] HAL: Loaded 40068 existing records. [2025-09-17T04:08:12.091027] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:12.091374] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-17T04:08:12.091456] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-17T04:08:12.092696] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-17T04:08:12.092785] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-17T04:08:12.476490] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:12.690143] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-11. [2025-09-17T04:08:12.807052] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:08:13.490191] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-17T04:08:13.552501] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:08:14.290162] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-17T04:08:14.454594] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T04:08:14.963721] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:08:15.090135] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-17T04:08:15.890167] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-17T04:08:16.047293] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:08:16.690167] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-17T04:08:16.992680] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T04:08:17.490141] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-17T04:08:17.863172] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T04:08:18.291208] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-17T04:08:18.296632] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T04:08:19.090151] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-17T04:08:19.177505] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T04:08:19.890132] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-17T04:08:20.090664] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T04:08:20.266791] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T04:08:20.690184] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-17T04:08:21.427516] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:08:21.490162] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-17T04:08:22.290191] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-17T04:08:22.426733] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T04:08:22.920087] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:08:23.090181] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-17T04:08:23.610475] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:08:23.890148] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-17T04:08:24.690211] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-17T04:08:24.988783] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:08:25.490157] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-17T04:08:25.548135] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T04:08:26.207789] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:08:26.290108] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-17T04:08:27.090117] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-17T04:08:27.222897] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T04:08:27.875417] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T04:08:27.890115] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-17T04:08:28.542958] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T04:08:28.548348] [INFO ] [REMOTE ] H: Full fetch complete (61374 records). [2025-09-17T04:08:28.548508] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-17T04:08:28.695284] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-17T04:08:28.943276] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-17T04:08:28.943403] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-17T04:08:28.944426] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-17T04:08:28.944508] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-17T04:08:28.946035] [DEBUG] [LOCAL ] H: Trimmed 61374 records to 45105 (keeping 200 days of data) [2025-09-17T04:08:29.235820] [DEBUG] [LOCAL ] H: Primary data saved (45105 records). [2025-09-17T04:08:29.235985] [INFO ] [MAIN ] H: Full history saved. [2025-09-17T04:08:29.236099] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. H took 40.0s. Estimated remaining: 3h 21m 27s. Rate: 6.9 symbols/min [2025-09-17T04:08:29.411131] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:29.411341] [DEBUG] [LOCAL ] HASI: No existing data file found in primary storage. [2025-09-17T04:08:29.411391] [WARN ] [MAIN ] HASI: No existing data found, performing full refresh instead. [2025-09-17T04:08:29.411720] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-17T04:08:29.411780] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-17T04:08:29.411832] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-09-17T04:08:29.411874] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-17T04:08:29.503378] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-17T04:08:29.776904] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:29.809824] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T04:08:30.221055] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T04:08:30.226794] [INFO ] [REMOTE ] HAE: Full fetch complete (57089 records). [2025-09-17T04:08:30.226942] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-17T04:08:30.295348] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-17T04:08:30.633969] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-17T04:08:30.634156] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-17T04:08:30.635310] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-17T04:08:30.635387] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-17T04:08:30.638593] [DEBUG] [LOCAL ] HAE: Trimmed 57089 records to 39478 (keeping 200 days of data) [2025-09-17T04:08:30.881480] [DEBUG] [LOCAL ] HAE: Primary data saved (39478 records). [2025-09-17T04:08:30.881692] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-17T04:08:30.881801] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. HAE took 30.2s. Estimated remaining: 3h 21m 8s. Rate: 6.9 symbols/min [2025-09-17T04:08:31.054078] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:31.054460] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-09-17T04:08:31.054615] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-09-17T04:08:31.054845] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-17T04:08:31.055013] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-17T04:08:31.055081] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-09-17T04:08:31.055129] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-17T04:08:31.092710] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-11. [2025-09-17T04:08:31.246308] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T04:08:31.470408] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:31.890151] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-17T04:08:32.245288] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T04:08:32.320967] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T04:08:32.690160] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-11. [2025-09-17T04:08:33.490150] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-17T04:08:33.615365] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T04:08:34.261223] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:08:34.290137] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-17T04:08:35.090136] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-17T04:08:35.574112] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T04:08:35.893801] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-17T04:08:35.898094] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:08:36.243867] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T04:08:36.690155] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-17T04:08:37.490124] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-17T04:08:37.904040] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T04:08:38.279572] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:08:38.290080] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-17T04:08:39.060663] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T04:08:39.090069] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-17T04:08:39.896964] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-17T04:08:39.902762] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T04:08:40.646474] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T04:08:40.690167] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-17T04:08:41.490243] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-17T04:08:41.901970] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T04:08:42.256101] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T04:08:42.290110] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-17T04:08:43.063858] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T04:08:43.090085] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-17T04:08:43.787863] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:08:43.794576] [INFO ] [REMOTE ] HAFN: Full fetch complete (66227 records). [2025-09-17T04:08:43.794759] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-17T04:08:43.895247] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-17T04:08:44.200509] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-17T04:08:44.200689] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-17T04:08:44.202042] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-17T04:08:44.202111] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-17T04:08:44.204251] [DEBUG] [LOCAL ] HAFN: Trimmed 66227 records to 43988 (keeping 200 days of data) [2025-09-17T04:08:44.496634] [DEBUG] [LOCAL ] HAFN: Primary data saved (43988 records). [2025-09-17T04:08:44.497144] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-17T04:08:44.497286] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAFN took 37.3s. Estimated remaining: 3h 21m 6s. Rate: 6.9 symbols/min [2025-09-17T04:08:44.674452] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:44.682635] [DEBUG] [LOCAL ] HBB: Loaded 4754 existing records from primary storage. [2025-09-17T04:08:44.682839] [INFO ] [MAIN ] HBB: Loaded 4754 existing records. [2025-09-17T04:08:44.715975] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-17T04:08:44.868109] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:44.868438] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-17T04:08:44.868497] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-17T04:08:44.869219] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-17T04:08:44.869288] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-17T04:08:45.290394] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:45.327662] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T04:08:45.376336] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T04:08:45.490165] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-11. [2025-09-17T04:08:45.920225] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T04:08:46.114137] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T04:08:46.290177] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-17T04:08:47.090208] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-17T04:08:47.890219] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-17T04:08:47.965917] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T04:08:48.698612] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-17T04:08:48.737446] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T04:08:49.490398] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-17T04:08:49.986791] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T04:08:49.994191] [INFO ] [REMOTE ] HAL: Full fetch complete (77631 records). [2025-09-17T04:08:49.994490] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-17T04:08:50.295266] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-17T04:08:50.427264] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-17T04:08:50.427448] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-17T04:08:50.429396] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-17T04:08:50.429560] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-17T04:08:50.432337] [DEBUG] [LOCAL ] HAL: Trimmed 77631 records to 53718 (keeping 200 days of data) [2025-09-17T04:08:50.467713] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:08:50.866117] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T04:08:50.895743] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-17T04:08:50.895995] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-17T04:08:50.896319] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 39.2s. Estimated remaining: 3h 20m 54s. Rate: 6.9 symbols/min [2025-09-17T04:08:51.083917] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:51.090160] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-17T04:08:51.130299] [DEBUG] [LOCAL ] HBI: Loaded 39471 existing records from primary storage. [2025-09-17T04:08:51.139128] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T04:08:51.138870] [INFO ] [MAIN ] HBI: Loaded 39471 existing records. [2025-09-17T04:08:51.345950] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:51.346321] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-17T04:08:51.346388] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-17T04:08:51.347495] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-17T04:08:51.347572] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-17T04:08:51.738375] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:51.890182] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-17T04:08:52.534510] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T04:08:52.663433] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:08:52.690188] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-17T04:08:53.490225] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-17T04:08:54.161741] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T04:08:54.261101] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T04:08:54.290220] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-17T04:08:55.019733] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T04:08:55.090202] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-17T04:08:55.890172] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-11. [2025-09-17T04:08:56.658397] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T04:08:56.690109] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-17T04:08:57.490222] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-17T04:08:57.552605] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:08:58.271355] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:08:58.290166] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-17T04:08:58.895976] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T04:08:59.061587] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:08:59.090210] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-17T04:08:59.810716] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T04:08:59.890181] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-17T04:09:00.690156] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-17T04:09:01.490200] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-17T04:09:01.655895] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:09:02.290196] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-17T04:09:02.643573] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T04:09:03.090173] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-17T04:09:03.890482] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-17T04:09:04.658187] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T04:09:04.690190] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-17T04:09:04.922497] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (3.43 seconds). [2025-09-17T04:09:04.929695] [INFO ] [REMOTE ] HASI: Full fetch complete (67834 records). [2025-09-17T04:09:04.929980] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-17T04:09:05.243277] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T04:09:05.378552] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-17T04:09:05.378829] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-17T04:09:05.380135] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-17T04:09:05.380276] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-17T04:09:05.416533] [DEBUG] [LOCAL ] HASI: Trimmed 67834 records to 47259 (keeping 200 days of data) [2025-09-17T04:09:05.418922] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (3.13 seconds). [2025-09-17T04:09:05.497007] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-17T04:09:05.615865] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-17T04:09:05.801713] [DEBUG] [LOCAL ] HASI: Primary data saved (47259 records). [2025-09-17T04:09:05.801899] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-17T04:09:05.801994] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HASI took 36.6s. Estimated remaining: 3h 20m 54s. Rate: 6.8 symbols/min [2025-09-17T04:09:05.986488] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:06.036370] [DEBUG] [LOCAL ] HBM: Loaded 39386 existing records from primary storage. [2025-09-17T04:09:06.036820] [INFO ] [MAIN ] HBM: Loaded 39386 existing records. [2025-09-17T04:09:06.225765] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:06.226174] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-17T04:09:06.226240] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-17T04:09:06.227349] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-17T04:09:06.227422] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-17T04:09:06.295384] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-17T04:09:06.627422] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:06.973265] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T04:09:07.090097] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-17T04:09:07.177129] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T04:09:07.561064] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T04:09:07.562360] [INFO ] [REMOTE ] HBB: Full fetch complete (10111 records). [2025-09-17T04:09:07.562465] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-17T04:09:07.895247] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-11. [2025-09-17T04:09:07.937841] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-17T04:09:07.938001] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-17T04:09:07.938407] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-17T04:09:07.938469] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-17T04:09:07.939980] [DEBUG] [LOCAL ] HBB: Trimmed 10111 records to 6983 (keeping 200 days of data) [2025-09-17T04:09:07.988537] [DEBUG] [LOCAL ] HBB: Primary data saved (6983 records). [2025-09-17T04:09:07.988789] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-17T04:09:07.988919] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HBB took 23.5s. Estimated remaining: 3h 20m 36s. Rate: 6.9 symbols/min [2025-09-17T04:09:08.166427] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:08.208555] [DEBUG] [LOCAL ] HCA: Loaded 35145 existing records from primary storage. [2025-09-17T04:09:08.208863] [INFO ] [MAIN ] HCA: Loaded 35145 existing records. [2025-09-17T04:09:08.405080] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:08.405479] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-17T04:09:08.405549] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-17T04:09:08.406467] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-17T04:09:08.406544] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-17T04:09:08.695441] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-17T04:09:08.815003] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:09.490192] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-11. [2025-09-17T04:09:09.582929] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T04:09:10.290136] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-17T04:09:10.330302] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:09:10.336880] [INFO ] [REMOTE ] HAYW: Full fetch complete (70886 records). [2025-09-17T04:09:10.337057] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-17T04:09:10.744493] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-17T04:09:10.744668] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-17T04:09:10.745899] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-17T04:09:10.745983] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-17T04:09:10.748341] [DEBUG] [LOCAL ] HAYW: Trimmed 70886 records to 48746 (keeping 200 days of data) [2025-09-17T04:09:11.051656] [DEBUG] [LOCAL ] HAYW: Primary data saved (48746 records). [2025-09-17T04:09:11.051833] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-17T04:09:11.051941] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HAYW took 40.2s. Estimated remaining: 3h 20m 20s. Rate: 6.9 symbols/min [2025-09-17T04:09:11.095225] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-17T04:09:11.232926] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:11.268066] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T04:09:11.304521] [DEBUG] [LOCAL ] HCC: Loaded 33661 existing records from primary storage. [2025-09-17T04:09:11.304767] [INFO ] [MAIN ] HCC: Loaded 33661 existing records. [2025-09-17T04:09:11.495774] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:11.496041] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-17T04:09:11.496284] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-17T04:09:11.497287] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-17T04:09:11.497376] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-17T04:09:11.758413] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T04:09:11.892693] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-17T04:09:11.916596] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:12.690187] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-17T04:09:13.001889] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T04:09:13.129451] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T04:09:13.490182] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-17T04:09:14.290163] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-17T04:09:15.090193] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-11. [2025-09-17T04:09:15.293525] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-17T04:09:15.890174] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-17T04:09:15.998578] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-17T04:09:16.453613] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T04:09:16.690119] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-17T04:09:16.767481] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:09:17.490204] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-17T04:09:17.679310] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T04:09:18.296778] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-17T04:09:18.335419] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:09:18.899093] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T04:09:19.090160] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-17T04:09:19.735865] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T04:09:19.890133] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-17T04:09:20.691173] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-17T04:09:20.694449] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T04:09:21.488668] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T04:09:21.498277] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-17T04:09:22.290138] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-17T04:09:22.421704] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T04:09:22.995788] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:09:23.090108] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-17T04:09:23.890147] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-17T04:09:24.060043] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:09:24.696200] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-17T04:09:24.702326] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:09:25.289903] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T04:09:25.490146] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-17T04:09:26.098300] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:09:26.290135] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-17T04:09:27.090133] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-17T04:09:27.490841] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T04:09:27.896609] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-17T04:09:27.923735] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T04:09:28.529746] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:09:28.690183] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-17T04:09:29.401589] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:09:29.490130] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-17T04:09:30.293436] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-17T04:09:30.304243] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T04:09:31.090154] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-17T04:09:31.139634] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:09:31.743748] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T04:09:31.750388] [INFO ] [REMOTE ] HBI: Full fetch complete (76769 records). [2025-09-17T04:09:31.750589] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-17T04:09:31.897791] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-17T04:09:32.175088] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-17T04:09:32.175255] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-17T04:09:32.176843] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-17T04:09:32.176920] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-17T04:09:32.179027] [DEBUG] [LOCAL ] HBI: Trimmed 76769 records to 53046 (keeping 200 days of data) [2025-09-17T04:09:32.524974] [DEBUG] [LOCAL ] HBI: Primary data saved (53046 records). [2025-09-17T04:09:32.525245] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-17T04:09:32.525409] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HBI took 41.6s. Estimated remaining: 3h 20m 29s. Rate: 6.8 symbols/min [2025-09-17T04:09:32.695513] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-17T04:09:32.724126] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:32.725843] [DEBUG] [LOCAL ] HCI: No existing data file found in primary storage. [2025-09-17T04:09:32.726102] [WARN ] [MAIN ] HCI: No existing data found, performing full refresh instead. [2025-09-17T04:09:32.726237] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-17T04:09:32.726291] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-17T04:09:32.726340] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-09-17T04:09:32.726405] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-17T04:09:33.205999] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-17T04:09:33.239280] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:33.490161] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-17T04:09:33.541250] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T04:09:34.095124] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T04:09:34.290186] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-17T04:09:35.090131] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-11. [2025-09-17T04:09:35.404588] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T04:09:35.890134] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-17T04:09:35.986368] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:09:36.072208] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:09:36.690194] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-17T04:09:37.448544] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:09:37.490086] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-17T04:09:38.231451] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T04:09:38.290087] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-17T04:09:39.090147] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-17T04:09:39.134848] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T04:09:39.692474] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T04:09:39.699007] [INFO ] [REMOTE ] HCC: Full fetch complete (63922 records). [2025-09-17T04:09:39.699218] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-17T04:09:39.902127] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-17T04:09:40.111386] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-17T04:09:40.111520] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-17T04:09:40.112416] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-17T04:09:40.112512] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-17T04:09:40.114051] [DEBUG] [LOCAL ] HCC: Trimmed 63922 records to 45429 (keeping 200 days of data) [2025-09-17T04:09:40.415048] [DEBUG] [LOCAL ] HCC: Primary data saved (45429 records). [2025-09-17T04:09:40.415276] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-17T04:09:40.415396] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HCC took 29.4s. Estimated remaining: 3h 20m 19s. Rate: 6.8 symbols/min [2025-09-17T04:09:40.695240] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-17T04:09:40.714287] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:09:41.182465] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T04:09:41.188863] [INFO ] [REMOTE ] HCA: Full fetch complete (69178 records). [2025-09-17T04:09:41.189045] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-17T04:09:41.495243] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-17T04:09:41.596763] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-17T04:09:41.596907] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-17T04:09:41.598432] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-17T04:09:41.598497] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-17T04:09:41.600632] [DEBUG] [LOCAL ] HCA: Trimmed 69178 records to 47465 (keeping 200 days of data) [2025-09-17T04:09:41.732169] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:09:41.933406] [DEBUG] [LOCAL ] HCA: Primary data saved (47465 records). [2025-09-17T04:09:41.933589] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-17T04:09:41.933747] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCA took 33.9s. Estimated remaining: 3h 19m 60s. Rate: 6.9 symbols/min [2025-09-17T04:09:42.290130] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-17T04:09:43.156965] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T04:09:43.160768] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-17T04:09:43.260412] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T04:09:43.269436] [INFO ] [REMOTE ] HBM: Full fetch complete (75854 records). [2025-09-17T04:09:43.269614] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-17T04:09:43.671318] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-17T04:09:43.671445] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-17T04:09:43.672507] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-17T04:09:43.672568] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-17T04:09:43.674252] [DEBUG] [LOCAL ] HBM: Trimmed 75854 records to 52925 (keeping 200 days of data) [2025-09-17T04:09:44.017849] [DEBUG] [LOCAL ] HBM: Primary data saved (52925 records). [2025-09-17T04:09:44.018032] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-17T04:09:44.018182] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HBM took 38.2s. Estimated remaining: 3h 19m 42s. Rate: 6.9 symbols/min [2025-09-17T04:09:44.063964] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T04:09:44.068568] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-17T04:09:44.816708] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T04:09:44.820536] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-17T04:09:45.803769] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T04:09:45.807409] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-17T04:09:46.719071] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T04:09:46.722545] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-17T04:09:47.724129] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T04:09:47.729536] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-17T04:09:48.815013] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T04:09:48.819308] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-17T04:09:49.757101] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T04:09:49.760925] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-17T04:09:50.782886] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T04:09:50.785761] [INFO ] [REMOTE ] HCI: Full fetch complete (19533 records). [2025-09-17T04:09:50.786296] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-17T04:09:51.162743] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-17T04:09:51.162913] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-17T04:09:51.163425] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-17T04:09:51.163487] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-17T04:09:51.164598] [DEBUG] [LOCAL ] HCI: Trimmed 19533 records to 14074 (keeping 200 days of data) [2025-09-17T04:09:51.260683] [DEBUG] [LOCAL ] HCI: Primary data saved (14074 records). [2025-09-17T04:09:51.260887] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-17T04:09:51.260984] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCI took 18.7s. Estimated remaining: 3h 19m 31s. Rate: 6.9 symbols/min [2025-09-17T04:09:51.897921] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:51.918157] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:51.993186] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:52.014160] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-17T04:09:52.013629] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:52.014699] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-17T04:09:52.015850] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-17T04:09:52.016090] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-17T04:09:52.016353] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-17T04:09:52.016514] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-17T04:09:52.314347] [DEBUG] [LOCAL ] HE: Loaded 36245 existing records from primary storage. [2025-09-17T04:09:52.361592] [INFO ] [MAIN ] HE: Loaded 36245 existing records. [2025-09-17T04:09:52.400816] [DEBUG] [LOCAL ] HD: Loaded 39898 existing records from primary storage. [2025-09-17T04:09:52.412140] [DEBUG] [LOCAL ] HDB: Loaded 38408 existing records from primary storage. [2025-09-17T04:09:52.432609] [INFO ] [MAIN ] HDB: Loaded 38408 existing records. [2025-09-17T04:09:52.432514] [INFO ] [MAIN ] HD: Loaded 39898 existing records. [2025-09-17T04:09:52.758598] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:52.789294] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-11. [2025-09-17T04:09:52.977488] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:52.977169] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:52.988937] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-17T04:09:52.999786] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-17T04:09:52.999916] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-17T04:09:53.042852] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-17T04:09:53.065717] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-17T04:09:53.044708] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-17T04:09:53.066100] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-17T04:09:53.066167] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-17T04:09:53.065957] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:53.169003] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-17T04:09:53.211495] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-17T04:09:53.280725] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T04:09:53.296198] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-17T04:09:53.296309] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-17T04:09:53.297913] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-17T04:09:53.837661] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T04:09:53.874995] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-17T04:09:54.179895] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:54.236863] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-11. [2025-09-17T04:09:54.231378] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:54.276861] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-11. [2025-09-17T04:09:54.301352] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:54.302045] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-11. [2025-09-17T04:09:54.344327] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T04:09:54.345769] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-17T04:09:54.647437] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T04:09:55.090211] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-17T04:09:55.314656] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-17T04:09:55.881945] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T04:09:55.892360] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-17T04:09:55.984917] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T04:09:56.122422] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-17T04:09:56.453952] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T04:09:56.690142] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-17T04:09:57.490222] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-17T04:09:58.290195] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-17T04:09:58.345685] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:09:59.090210] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-17T04:09:59.334771] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:09:59.890102] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-17T04:10:00.374798] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T04:10:00.459018] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:10:00.690166] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-17T04:10:01.490203] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-17T04:10:01.749409] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T04:10:01.966334] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T04:10:02.290139] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-17T04:10:03.090123] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-17T04:10:03.296397] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:10:03.890114] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-17T04:10:04.190220] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:10:04.484984] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:10:04.690109] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-17T04:10:05.490166] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-17T04:10:05.977475] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T04:10:06.290156] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-17T04:10:06.508557] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:10:06.523102] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-17T04:10:07.090199] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-17T04:10:07.237785] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T04:10:07.890142] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-17T04:10:08.690186] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-17T04:10:08.899067] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:10:09.027298] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T04:10:09.490174] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-17T04:10:09.720159] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-17T04:10:10.127495] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-17T04:10:10.290206] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-17T04:10:11.090202] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-17T04:10:11.890127] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-17T04:10:12.120050] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T04:10:12.690141] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-17T04:10:13.296197] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-17T04:10:13.490139] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-17T04:10:13.816391] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-17T04:10:13.860367] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T04:10:14.249043] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:10:14.290126] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-17T04:10:15.090153] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-17T04:10:15.890099] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-17T04:10:15.932509] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:10:16.690250] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-17T04:10:16.786562] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T04:10:16.989515] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T04:10:16.990435] [INFO ] [REMOTE ] HCXY: Full fetch complete (598 records). [2025-09-17T04:10:16.990517] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-17T04:10:17.175470] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-17T04:10:17.175709] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:10:17.175769] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:10:17.175816] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-17T04:10:17.175894] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-17T04:10:17.175955] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-17T04:10:17.176018] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-17T04:10:17.176087] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 25.9s. Estimated remaining: 3h 19m 46s. Rate: 6.8 symbols/min [2025-09-17T04:10:17.347457] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:17.370536] [DEBUG] [LOCAL ] HEI: Loaded 23607 existing records from primary storage. [2025-09-17T04:10:17.370705] [INFO ] [MAIN ] HEI: Loaded 23607 existing records. [2025-09-17T04:10:17.495320] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-17T04:10:17.554348] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:17.554804] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-17T04:10:17.554881] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-17T04:10:17.555727] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-17T04:10:17.555839] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-17T04:10:17.952424] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:17.975255] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T04:10:18.290151] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-11. [2025-09-17T04:10:19.090291] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-17T04:10:19.325676] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T04:10:19.563556] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:10:19.890153] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-17T04:10:20.690178] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-17T04:10:20.837906] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T04:10:21.490203] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-17T04:10:21.720895] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T04:10:22.121426] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:10:22.128077] [INFO ] [REMOTE ] HE: Full fetch complete (72375 records). [2025-09-17T04:10:22.128289] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-17T04:10:22.307151] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-17T04:10:22.544376] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-17T04:10:22.544534] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-17T04:10:22.545784] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-17T04:10:22.545901] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-17T04:10:22.547793] [DEBUG] [LOCAL ] HE: Trimmed 72375 records to 49341 (keeping 200 days of data) [2025-09-17T04:10:22.881159] [DEBUG] [LOCAL ] HE: Primary data saved (49341 records). [2025-09-17T04:10:22.881352] [INFO ] [MAIN ] HE: Full history saved. [2025-09-17T04:10:22.881453] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HE took 31.6s. Estimated remaining: 3h 19m 33s. Rate: 6.9 symbols/min [2025-09-17T04:10:23.069080] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:23.076163] [DEBUG] [LOCAL ] HEQ: Loaded 4338 existing records from primary storage. [2025-09-17T04:10:23.076306] [INFO ] [MAIN ] HEQ: Loaded 4338 existing records. [2025-09-17T04:10:23.108170] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-17T04:10:23.264322] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:23.264768] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-17T04:10:23.264854] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-17T04:10:23.275510] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-17T04:10:23.293862] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-17T04:10:23.329344] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T04:10:23.685955] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:23.721728] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T04:10:23.890123] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-17T04:10:24.690151] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-17T04:10:25.386669] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T04:10:25.490206] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-17T04:10:25.584980] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:10:25.591774] [INFO ] [REMOTE ] HDB: Full fetch complete (75057 records). [2025-09-17T04:10:25.591958] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-17T04:10:25.989062] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-17T04:10:25.989198] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-17T04:10:25.990221] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-17T04:10:25.990303] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-17T04:10:25.992004] [DEBUG] [LOCAL ] HDB: Trimmed 75057 records to 51918 (keeping 200 days of data) [2025-09-17T04:10:26.254707] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T04:10:26.290185] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-17T04:10:26.372958] [DEBUG] [LOCAL ] HDB: Primary data saved (51918 records). [2025-09-17T04:10:26.373171] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-17T04:10:26.373291] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HDB took 35.1s. Estimated remaining: 3h 19m 17s. Rate: 6.9 symbols/min [2025-09-17T04:10:26.545025] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:26.584263] [DEBUG] [LOCAL ] HESM: Loaded 35958 existing records from primary storage. [2025-09-17T04:10:26.584461] [INFO ] [MAIN ] HESM: Loaded 35958 existing records. [2025-09-17T04:10:26.773488] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:26.773821] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-17T04:10:26.773897] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-17T04:10:26.774789] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-17T04:10:26.774870] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-17T04:10:27.095375] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-11. [2025-09-17T04:10:27.173212] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:27.357981] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T04:10:27.590586] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T04:10:27.715458] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:10:27.890194] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-17T04:10:28.690196] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-11. [2025-09-17T04:10:29.411383] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:10:29.490146] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-17T04:10:30.153031] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T04:10:30.290136] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-17T04:10:31.051268] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:10:31.090075] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-17T04:10:31.890153] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-17T04:10:32.304708] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-17T04:10:32.311439] [INFO ] [REMOTE ] HD: Full fetch complete (77339 records). [2025-09-17T04:10:32.311624] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-17T04:10:32.636365] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T04:10:32.709877] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-17T04:10:32.737829] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-17T04:10:32.738898] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-17T04:10:32.740064] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-17T04:10:32.740278] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-17T04:10:32.751248] [DEBUG] [LOCAL ] HD: Trimmed 77339 records to 53522 (keeping 200 days of data) [2025-09-17T04:10:32.770729] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T04:10:33.127713] [DEBUG] [LOCAL ] HD: Primary data saved (53522 records). [2025-09-17T04:10:33.127895] [INFO ] [MAIN ] HD: Full history saved. [2025-09-17T04:10:33.127989] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HD took 41.9s. Estimated remaining: 3h 19m 6s. Rate: 6.9 symbols/min [2025-09-17T04:10:33.239110] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:10:33.313739] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:33.313978] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-17T04:10:33.314056] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-17T04:10:33.314172] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-17T04:10:33.314247] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-17T04:10:33.314313] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-17T04:10:33.314362] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-17T04:10:33.498830] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-17T04:10:33.730383] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:34.290174] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-17T04:10:34.889975] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:10:35.090169] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-17T04:10:35.138350] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T04:10:35.890126] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-17T04:10:36.113310] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T04:10:36.538388] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T04:10:36.690143] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-17T04:10:37.211602] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T04:10:37.490178] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-11. [2025-09-17T04:10:37.724073] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-11 (0.23 seconds). [2025-09-17T04:10:38.290152] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-17T04:10:38.936636] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T04:10:39.090146] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-17T04:10:39.890140] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-17T04:10:40.629692] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T04:10:40.655720] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T04:10:40.690099] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-17T04:10:41.382118] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T04:10:41.490151] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-17T04:10:41.809165] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-17T04:10:42.290155] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-17T04:10:42.522615] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-17T04:10:43.090130] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-17T04:10:43.890142] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-17T04:10:44.437339] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:10:44.690132] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-17T04:10:45.261090] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T04:10:45.490171] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-17T04:10:45.527929] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T04:10:46.290143] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-17T04:10:46.595063] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T04:10:46.941535] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:10:47.090138] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-17T04:10:47.808675] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T04:10:47.810385] [INFO ] [REMOTE ] HEQ: Full fetch complete (8816 records). [2025-09-17T04:10:47.810478] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-17T04:10:47.895230] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-17T04:10:48.178374] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-17T04:10:48.178513] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-17T04:10:48.178828] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-17T04:10:48.178903] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-17T04:10:48.179427] [DEBUG] [LOCAL ] HEQ: Trimmed 8816 records to 6098 (keeping 200 days of data) [2025-09-17T04:10:48.217281] [DEBUG] [LOCAL ] HEQ: Primary data saved (6098 records). [2025-09-17T04:10:48.217449] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-17T04:10:48.217578] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEQ took 25.3s. Estimated remaining: 3h 19m 5s. Rate: 6.9 symbols/min [2025-09-17T04:10:48.400407] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:48.401466] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-17T04:10:48.401551] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-17T04:10:48.401751] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-17T04:10:48.401826] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-17T04:10:48.401896] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-17T04:10:48.401959] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-17T04:10:48.695224] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-17T04:10:48.763536] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:48.986546] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T04:10:49.388229] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T04:10:49.392128] [INFO ] [REMOTE ] HEI: Full fetch complete (49301 records). [2025-09-17T04:10:49.392247] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-17T04:10:49.495926] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-11. [2025-09-17T04:10:49.788422] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-17T04:10:49.788531] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-17T04:10:49.789500] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-17T04:10:49.789574] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-17T04:10:49.790894] [DEBUG] [LOCAL ] HEI: Trimmed 49301 records to 33129 (keeping 200 days of data) [2025-09-17T04:10:49.887678] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T04:10:50.011170] [DEBUG] [LOCAL ] HEI: Primary data saved (33129 records). [2025-09-17T04:10:50.011353] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-17T04:10:50.011459] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEI took 32.8s. Estimated remaining: 3h 18m 47s. Rate: 6.9 symbols/min [2025-09-17T04:10:50.192073] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:50.205021] [DEBUG] [LOCAL ] HFRO: Loaded 11949 existing records from primary storage. [2025-09-17T04:10:50.205200] [INFO ] [MAIN ] HFRO: Loaded 11949 existing records. [2025-09-17T04:10:50.295266] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-17T04:10:50.411448] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:50.411783] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-17T04:10:50.411870] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-17T04:10:50.412431] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-17T04:10:50.412492] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-17T04:10:50.796262] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:51.090182] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-17T04:10:51.524735] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:10:51.890128] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-11. [2025-09-17T04:10:51.977681] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:10:52.649009] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T04:10:52.690183] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-17T04:10:53.490151] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-17T04:10:53.548681] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T04:10:53.734730] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-17T04:10:54.290153] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-17T04:10:54.534434] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-17T04:10:55.090147] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-17T04:10:55.477758] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T04:10:55.890193] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-17T04:10:56.690138] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-17T04:10:57.490152] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-17T04:10:57.598522] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:10:57.738565] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-17T04:10:57.852754] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T04:10:58.290157] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-17T04:10:59.090214] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-17T04:10:59.333708] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-17T04:10:59.890157] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-17T04:10:59.944669] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:11:00.690130] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-17T04:11:00.931578] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:11:01.105919] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T04:11:01.490181] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-17T04:11:01.779942] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T04:11:02.290146] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-17T04:11:02.524638] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-17T04:11:03.090280] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-17T04:11:03.890181] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-17T04:11:04.201173] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:11:04.297416] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T04:11:04.690160] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-17T04:11:05.015913] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T04:11:05.490169] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-17T04:11:05.852397] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T04:11:05.853130] [INFO ] [REMOTE ] HF: Full fetch complete (510 records). [2025-09-17T04:11:05.853214] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-17T04:11:06.039920] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-17T04:11:06.040167] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:11:06.040241] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:11:06.040367] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-17T04:11:06.040444] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-17T04:11:06.040492] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-17T04:11:06.040560] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-17T04:11:06.040631] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HF took 32.9s. Estimated remaining: 3h 18m 48s. Rate: 6.9 symbols/min [2025-09-17T04:11:06.215854] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:06.227954] [DEBUG] [LOCAL ] HGER: Loaded 9995 existing records from primary storage. [2025-09-17T04:11:06.228161] [INFO ] [MAIN ] HGER: Loaded 9995 existing records. [2025-09-17T04:11:06.297722] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-17T04:11:06.428996] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:06.429286] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-17T04:11:06.429347] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-17T04:11:06.429845] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-17T04:11:06.429912] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-17T04:11:06.816139] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:07.090156] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-17T04:11:07.895274] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-17T04:11:07.911557] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T04:11:08.147940] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T04:11:08.246345] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T04:11:08.690137] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-17T04:11:09.490154] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-17T04:11:09.561745] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:11:09.893167] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T04:11:10.290130] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-17T04:11:11.090121] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-11. [2025-09-17T04:11:11.217690] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T04:11:11.687265] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T04:11:11.890130] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-17T04:11:12.181153] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-17T04:11:12.690189] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-17T04:11:13.490138] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-17T04:11:13.695986] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T04:11:14.187242] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T04:11:14.290158] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-17T04:11:15.090143] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-17T04:11:15.390176] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T04:11:15.561045] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T04:11:15.561904] [INFO ] [REMOTE ] HFND: Full fetch complete (1791 records). [2025-09-17T04:11:15.561986] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-17T04:11:15.742368] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T04:11:15.742552] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:11:15.742600] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:11:15.742663] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-17T04:11:15.742736] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-17T04:11:15.742782] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-17T04:11:15.742849] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-17T04:11:15.742918] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HFND took 27.5s. Estimated remaining: 3h 18m 41s. Rate: 6.9 symbols/min [2025-09-17T04:11:15.897242] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-17T04:11:15.918769] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:15.928387] [DEBUG] [LOCAL ] HGLB: Loaded 6562 existing records from primary storage. [2025-09-17T04:11:15.928819] [INFO ] [MAIN ] HGLB: Loaded 6562 existing records. [2025-09-17T04:11:16.104701] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:16.104968] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-17T04:11:16.105028] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-17T04:11:16.105342] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-17T04:11:16.105399] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-17T04:11:16.470769] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:16.690166] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-17T04:11:16.853292] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T04:11:16.856193] [INFO ] [REMOTE ] HFRO: Full fetch complete (28964 records). [2025-09-17T04:11:16.856299] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-17T04:11:17.257537] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-17T04:11:17.257701] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-17T04:11:17.258440] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-17T04:11:17.258513] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-17T04:11:17.259474] [DEBUG] [LOCAL ] HFRO: Trimmed 28964 records to 17567 (keeping 200 days of data) [2025-09-17T04:11:17.371925] [DEBUG] [LOCAL ] HFRO: Primary data saved (17567 records). [2025-09-17T04:11:17.372260] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-17T04:11:17.372422] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HFRO took 27.4s. Estimated remaining: 3h 18m 22s. Rate: 6.9 symbols/min [2025-09-17T04:11:17.498336] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-11. [2025-09-17T04:11:17.584604] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:17.598308] [DEBUG] [LOCAL ] HGTY: Loaded 10001 existing records from primary storage. [2025-09-17T04:11:17.598556] [INFO ] [MAIN ] HGTY: Loaded 10001 existing records. [2025-09-17T04:11:17.795962] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:17.796400] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-17T04:11:17.796467] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-17T04:11:17.796933] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-17T04:11:17.797002] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-17T04:11:18.187632] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:18.230572] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:11:18.290160] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-17T04:11:18.456756] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T04:11:18.747361] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T04:11:19.090189] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-17T04:11:19.890147] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-17T04:11:20.690167] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-11. [2025-09-17T04:11:20.707671] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:11:20.797118] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:11:21.490168] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-17T04:11:21.599862] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T04:11:22.024134] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:11:22.290142] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-17T04:11:23.090222] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-17T04:11:23.825093] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T04:11:23.833923] [INFO ] [REMOTE ] HESM: Full fetch complete (68259 records). [2025-09-17T04:11:23.834135] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-17T04:11:23.895265] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-17T04:11:24.004291] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:11:24.279906] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-17T04:11:24.280023] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-17T04:11:24.280992] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-17T04:11:24.281064] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-17T04:11:24.282725] [DEBUG] [LOCAL ] HESM: Trimmed 68259 records to 48174 (keeping 200 days of data) [2025-09-17T04:11:24.595325] [DEBUG] [LOCAL ] HESM: Primary data saved (48174 records). [2025-09-17T04:11:24.595497] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-17T04:11:24.595618] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HESM took 58.2s. Estimated remaining: 3h 18m 12s. Rate: 6.9 symbols/min [2025-09-17T04:11:24.696820] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-17T04:11:24.809923] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:24.818293] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T04:11:24.855022] [DEBUG] [LOCAL ] HGV: Loaded 35072 existing records from primary storage. [2025-09-17T04:11:24.855223] [INFO ] [MAIN ] HGV: Loaded 35072 existing records. [2025-09-17T04:11:25.039011] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:25.039270] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-17T04:11:25.039329] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-17T04:11:25.040177] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-17T04:11:25.040241] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-17T04:11:25.400931] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:25.405894] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:11:25.490133] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-17T04:11:26.228755] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T04:11:26.290101] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-17T04:11:26.889828] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T04:11:27.090152] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-17T04:11:27.897063] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-17T04:11:27.897969] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T04:11:28.690175] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-17T04:11:28.738959] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T04:11:29.274585] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T04:11:29.490159] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-17T04:11:30.238845] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T04:11:30.290096] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-17T04:11:30.963712] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T04:11:31.090129] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-17T04:11:31.890658] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-17T04:11:31.892300] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T04:11:32.675389] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T04:11:32.690093] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-17T04:11:33.475693] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:11:33.490129] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-11. [2025-09-17T04:11:34.290192] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-17T04:11:34.950072] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T04:11:35.090144] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-17T04:11:35.323698] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T04:11:35.890179] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-17T04:11:36.564420] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T04:11:36.622822] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:11:36.690117] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-17T04:11:37.432497] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T04:11:37.435329] [INFO ] [REMOTE ] HGER: Full fetch complete (15483 records). [2025-09-17T04:11:37.435447] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-17T04:11:37.495278] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-17T04:11:37.858878] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-17T04:11:37.859050] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-17T04:11:37.859599] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-17T04:11:37.859685] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-17T04:11:37.860440] [DEBUG] [LOCAL ] HGER: Trimmed 15483 records to 12497 (keeping 200 days of data) [2025-09-17T04:11:37.942455] [DEBUG] [LOCAL ] HGER: Primary data saved (12497 records). [2025-09-17T04:11:37.942746] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-17T04:11:37.942894] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGER took 31.9s. Estimated remaining: 3h 18m 9s. Rate: 6.9 symbols/min [2025-09-17T04:11:38.122188] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:38.149679] [DEBUG] [LOCAL ] HHH: Loaded 25732 existing records from primary storage. [2025-09-17T04:11:38.149901] [INFO ] [MAIN ] HHH: Loaded 25732 existing records. [2025-09-17T04:11:38.294675] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-17T04:11:38.341278] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:38.349140] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:11:38.349242] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-17T04:11:38.352060] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-17T04:11:38.353305] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-17T04:11:38.353381] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-17T04:11:38.739905] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:39.090152] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-17T04:11:39.810501] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:11:39.867365] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T04:11:39.890080] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-17T04:11:40.645271] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T04:11:40.690089] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-17T04:11:41.450308] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T04:11:41.490115] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-17T04:11:42.290174] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-17T04:11:42.317948] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T04:11:42.320038] [INFO ] [REMOTE ] HGLB: Full fetch complete (14237 records). [2025-09-17T04:11:42.320135] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-17T04:11:42.702134] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-17T04:11:42.702285] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-17T04:11:42.702798] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-17T04:11:42.702861] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-17T04:11:42.703736] [DEBUG] [LOCAL ] HGLB: Trimmed 14237 records to 9787 (keeping 200 days of data) [2025-09-17T04:11:42.768563] [DEBUG] [LOCAL ] HGLB: Primary data saved (9787 records). [2025-09-17T04:11:42.768819] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-17T04:11:42.768947] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGLB took 27.0s. Estimated remaining: 3h 17m 55s. Rate: 6.9 symbols/min [2025-09-17T04:11:42.954120] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:42.983681] [DEBUG] [LOCAL ] HI: Loaded 25850 existing records from primary storage. [2025-09-17T04:11:42.983915] [INFO ] [MAIN ] HI: Loaded 25850 existing records. [2025-09-17T04:11:43.090448] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-11. [2025-09-17T04:11:43.170101] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T04:11:43.190861] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:43.195109] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-17T04:11:43.195205] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-17T04:11:43.196116] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-17T04:11:43.196184] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-17T04:11:43.569007] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:43.890123] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-17T04:11:44.213790] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T04:11:44.642823] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T04:11:44.690130] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-17T04:11:45.323686] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T04:11:45.490202] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-17T04:11:46.290224] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-17T04:11:46.946833] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:11:47.090156] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-17T04:11:47.327270] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T04:11:47.890138] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-17T04:11:48.634637] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:11:48.690169] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-17T04:11:48.885603] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T04:11:48.888861] [INFO ] [REMOTE ] HGTY: Full fetch complete (16804 records). [2025-09-17T04:11:48.888968] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-17T04:11:49.252512] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-17T04:11:49.252632] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-17T04:11:49.253095] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-17T04:11:49.253167] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-17T04:11:49.253775] [DEBUG] [LOCAL ] HGTY: Trimmed 16804 records to 12626 (keeping 200 days of data) [2025-09-17T04:11:49.337165] [DEBUG] [LOCAL ] HGTY: Primary data saved (12626 records). [2025-09-17T04:11:49.337382] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-17T04:11:49.337496] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGTY took 32.0s. Estimated remaining: 3h 17m 43s. Rate: 6.9 symbols/min [2025-09-17T04:11:49.490285] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-11. [2025-09-17T04:11:49.509290] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:49.549546] [DEBUG] [LOCAL ] HIG: Loaded 38323 existing records from primary storage. [2025-09-17T04:11:49.549736] [INFO ] [MAIN ] HIG: Loaded 38323 existing records. [2025-09-17T04:11:49.724260] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:49.724513] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-17T04:11:49.724570] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-17T04:11:49.725539] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-17T04:11:49.725603] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-17T04:11:50.078328] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:50.290180] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-11. [2025-09-17T04:11:50.362861] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:11:50.825936] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T04:11:51.090156] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-17T04:11:51.845893] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:11:51.890082] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-17T04:11:52.403579] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:11:52.690126] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-17T04:11:53.269473] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:11:53.490143] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-17T04:11:54.300213] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-17T04:11:54.306097] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:11:54.787975] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T04:11:55.090152] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-17T04:11:55.890143] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-17T04:11:56.047614] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T04:11:56.147675] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T04:11:56.690203] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-17T04:11:57.175727] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T04:11:57.490201] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-17T04:11:57.960953] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T04:11:58.290246] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-17T04:11:58.432788] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T04:11:59.090104] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-17T04:11:59.466715] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T04:11:59.890193] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-17T04:12:00.690153] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-17T04:12:00.889091] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T04:12:01.154943] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T04:12:01.490198] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-17T04:12:02.290159] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-17T04:12:02.830979] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T04:12:03.090196] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-17T04:12:03.890219] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-17T04:12:04.315843] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-17T04:12:04.551948] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-17T04:12:04.690190] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-17T04:12:05.490238] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-17T04:12:05.685542] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:12:05.925669] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-17T04:12:06.105695] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T04:12:06.290128] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-17T04:12:06.794891] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T04:12:07.090131] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-17T04:12:07.605089] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T04:12:07.890138] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-17T04:12:08.408913] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T04:12:08.690168] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-17T04:12:09.445194] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:12:09.451489] [INFO ] [REMOTE ] HGV: Full fetch complete (65731 records). [2025-09-17T04:12:09.451695] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-17T04:12:09.495865] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-17T04:12:09.858911] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-17T04:12:09.859051] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-17T04:12:09.860053] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-17T04:12:09.860125] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-17T04:12:09.861799] [DEBUG] [LOCAL ] HGV: Trimmed 65731 records to 47137 (keeping 200 days of data) [2025-09-17T04:12:10.148018] [DEBUG] [LOCAL ] HGV: Primary data saved (47137 records). [2025-09-17T04:12:10.148202] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-17T04:12:10.148324] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HGV took 45.6s. Estimated remaining: 3h 17m 51s. Rate: 6.8 symbols/min [2025-09-17T04:12:10.298789] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-17T04:12:10.326167] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:10.357795] [DEBUG] [LOCAL ] HII: Loaded 24405 existing records from primary storage. [2025-09-17T04:12:10.358168] [INFO ] [MAIN ] HII: Loaded 24405 existing records. [2025-09-17T04:12:10.543556] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:10.544066] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-17T04:12:10.544173] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-17T04:12:10.544950] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-17T04:12:10.545121] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-17T04:12:10.742423] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T04:12:10.957931] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:11.090105] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-17T04:12:11.187386] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T04:12:11.701137] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T04:12:11.890151] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-17T04:12:12.690150] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-11. [2025-09-17T04:12:12.759475] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T04:12:13.365866] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:12:13.490175] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-17T04:12:14.183077] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T04:12:14.290150] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-17T04:12:15.090222] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-17T04:12:15.336744] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T04:12:15.890151] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-17T04:12:16.690147] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-17T04:12:16.967008] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T04:12:16.971110] [INFO ] [REMOTE ] HI: Full fetch complete (49592 records). [2025-09-17T04:12:16.971244] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-17T04:12:17.296489] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-17T04:12:17.392947] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-17T04:12:17.393064] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-17T04:12:17.393822] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-17T04:12:17.393881] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-17T04:12:17.395119] [DEBUG] [LOCAL ] HI: Trimmed 49592 records to 35100 (keeping 200 days of data) [2025-09-17T04:12:17.498079] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-17T04:12:17.633160] [DEBUG] [LOCAL ] HI: Primary data saved (35100 records). [2025-09-17T04:12:17.633358] [INFO ] [MAIN ] HI: Full history saved. [2025-09-17T04:12:17.633494] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HI took 34.9s. Estimated remaining: 3h 17m 40s. Rate: 6.8 symbols/min [2025-09-17T04:12:17.801989] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:17.843690] [DEBUG] [LOCAL ] HIMS: Loaded 40167 existing records from primary storage. [2025-09-17T04:12:17.843860] [INFO ] [MAIN ] HIMS: Loaded 40167 existing records. [2025-09-17T04:12:18.020065] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:18.020328] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-17T04:12:18.020378] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-17T04:12:18.021275] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-17T04:12:18.021335] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-17T04:12:18.382452] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:18.382803] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-11. [2025-09-17T04:12:18.615539] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-17T04:12:18.653110] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T04:12:18.723961] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T04:12:19.090173] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-17T04:12:19.890197] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-17T04:12:20.690209] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-17T04:12:20.831279] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T04:12:20.839935] [INFO ] [REMOTE ] HIG: Full fetch complete (73063 records). [2025-09-17T04:12:20.840255] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-17T04:12:21.282059] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-11 (2.90 seconds). [2025-09-17T04:12:21.337168] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-17T04:12:21.337350] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-17T04:12:21.339093] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-17T04:12:21.339182] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-17T04:12:21.341517] [DEBUG] [LOCAL ] HIG: Trimmed 73063 records to 51311 (keeping 200 days of data) [2025-09-17T04:12:21.490211] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-17T04:12:21.643954] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:12:21.766717] [DEBUG] [LOCAL ] HIG: Primary data saved (51311 records). [2025-09-17T04:12:21.767103] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-17T04:12:21.767306] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HIG took 32.4s. Estimated remaining: 3h 17m 25s. Rate: 6.9 symbols/min [2025-09-17T04:12:21.952777] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:21.980005] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T04:12:22.003394] [DEBUG] [LOCAL ] HIO: Loaded 16041 existing records from primary storage. [2025-09-17T04:12:22.003660] [INFO ] [MAIN ] HIO: Loaded 16041 existing records. [2025-09-17T04:12:22.194319] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:22.194798] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-17T04:12:22.194884] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-17T04:12:22.195463] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-17T04:12:22.195530] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-17T04:12:22.297556] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-17T04:12:22.592129] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:23.090139] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-17T04:12:23.901358] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-11. [2025-09-17T04:12:23.926788] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:12:24.001583] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-17T04:12:24.648500] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:12:24.690129] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-17T04:12:24.716175] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T04:12:25.490137] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-17T04:12:26.290127] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-17T04:12:26.505067] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:12:27.090117] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-17T04:12:27.596257] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T04:12:27.600747] [INFO ] [REMOTE ] HHH: Full fetch complete (44700 records). [2025-09-17T04:12:27.600904] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-17T04:12:27.891606] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-17T04:12:27.987807] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-17T04:12:27.987988] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-17T04:12:27.988892] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-17T04:12:27.988968] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-17T04:12:27.990449] [DEBUG] [LOCAL ] HHH: Trimmed 44700 records to 32988 (keeping 200 days of data) [2025-09-17T04:12:28.111802] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T04:12:28.238149] [DEBUG] [LOCAL ] HHH: Primary data saved (32988 records). [2025-09-17T04:12:28.238328] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-17T04:12:28.238449] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HHH took 50.3s. Estimated remaining: 3h 17m 14s. Rate: 6.9 symbols/min [2025-09-17T04:12:28.410132] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:28.427806] [DEBUG] [LOCAL ] HIPO: Loaded 16781 existing records from primary storage. [2025-09-17T04:12:28.427979] [INFO ] [MAIN ] HIPO: Loaded 16781 existing records. [2025-09-17T04:12:28.612994] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:28.613446] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-17T04:12:28.613597] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-17T04:12:28.614189] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-17T04:12:28.614280] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-17T04:12:28.692986] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-17T04:12:28.870727] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T04:12:29.037956] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:29.118078] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T04:12:29.490231] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-17T04:12:30.290199] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-17T04:12:30.716632] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T04:12:31.090154] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-17T04:12:31.260521] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-17T04:12:31.314315] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T04:12:31.890148] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-11. [2025-09-17T04:12:32.626268] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:12:32.690218] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-17T04:12:33.217704] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T04:12:33.490155] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-17T04:12:34.290192] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-17T04:12:34.706567] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T04:12:35.090193] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-17T04:12:35.251614] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-17T04:12:35.756588] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T04:12:35.890188] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-17T04:12:36.541003] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:12:36.690158] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-17T04:12:37.006344] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:12:37.490176] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-17T04:12:37.623214] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T04:12:38.290155] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-17T04:12:38.713425] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T04:12:38.717831] [INFO ] [REMOTE ] HII: Full fetch complete (53502 records). [2025-09-17T04:12:38.717994] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-17T04:12:39.095316] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-17T04:12:39.144491] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-17T04:12:39.144827] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-17T04:12:39.145864] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-17T04:12:39.145932] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-17T04:12:39.147585] [DEBUG] [LOCAL ] HII: Trimmed 53502 records to 35819 (keeping 200 days of data) [2025-09-17T04:12:39.362449] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T04:12:39.425272] [DEBUG] [LOCAL ] HII: Primary data saved (35819 records). [2025-09-17T04:12:39.425559] [INFO ] [MAIN ] HII: Full history saved. [2025-09-17T04:12:39.425724] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HII took 29.3s. Estimated remaining: 3h 17m 8s. Rate: 6.9 symbols/min [2025-09-17T04:12:39.605998] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:39.646822] [DEBUG] [LOCAL ] HIW: Loaded 33209 existing records from primary storage. [2025-09-17T04:12:39.647096] [INFO ] [MAIN ] HIW: Loaded 33209 existing records. [2025-09-17T04:12:39.833316] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:39.833676] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-17T04:12:39.833741] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-17T04:12:39.836048] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-17T04:12:39.836122] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-17T04:12:39.897058] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-17T04:12:40.275571] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:40.291729] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T04:12:40.690240] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-17T04:12:41.055741] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T04:12:41.443168] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T04:12:41.490225] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-17T04:12:42.290243] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-17T04:12:43.090218] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-11. [2025-09-17T04:12:43.325441] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:12:43.890120] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-17T04:12:44.017166] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T04:12:44.695979] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-17T04:12:44.731620] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T04:12:45.141342] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T04:12:45.490097] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-17T04:12:45.526820] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T04:12:46.290192] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-17T04:12:46.618969] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T04:12:47.090235] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-17T04:12:47.890211] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-17T04:12:48.369078] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:12:48.623425] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-17T04:12:48.654625] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T04:12:48.690126] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-17T04:12:49.490241] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-17T04:12:49.797272] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T04:12:50.290211] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-17T04:12:51.090195] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-17T04:12:51.441347] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T04:12:51.828551] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T04:12:51.890099] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-17T04:12:52.275941] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T04:12:52.280919] [INFO ] [REMOTE ] HIO: Full fetch complete (36783 records). [2025-09-17T04:12:52.281097] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-17T04:12:52.692888] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-17T04:12:52.694667] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-17T04:12:52.694816] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-17T04:12:52.695750] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-17T04:12:52.695902] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-17T04:12:52.697327] [DEBUG] [LOCAL ] HIO: Trimmed 36783 records to 24130 (keeping 200 days of data) [2025-09-17T04:12:52.842109] [DEBUG] [LOCAL ] HIO: Primary data saved (24130 records). [2025-09-17T04:12:52.842277] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-17T04:12:52.842376] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIO took 31.1s. Estimated remaining: 3h 17m 5s. Rate: 6.8 symbols/min [2025-09-17T04:12:53.027724] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:53.046286] [DEBUG] [LOCAL ] HIX: Loaded 15027 existing records from primary storage. [2025-09-17T04:12:53.046556] [INFO ] [MAIN ] HIX: Loaded 15027 existing records. [2025-09-17T04:12:53.236792] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:53.237182] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-17T04:12:53.237263] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-17T04:12:53.237848] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-17T04:12:53.237917] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-17T04:12:53.496844] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-17T04:12:53.624811] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:54.207663] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T04:12:54.268573] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:12:54.290146] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-17T04:12:54.778076] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-17T04:12:55.090204] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-17T04:12:55.788718] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T04:12:55.878542] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T04:12:55.890090] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-11. [2025-09-17T04:12:56.690192] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-17T04:12:57.164582] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:12:57.490168] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-17T04:12:58.290188] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-17T04:12:59.090210] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-17T04:12:59.675387] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-09-17T04:12:59.890228] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-17T04:13:00.130169] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-17T04:13:00.459245] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T04:13:00.462445] [INFO ] [REMOTE ] HIPO: Full fetch complete (31806 records). [2025-09-17T04:13:00.462544] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-17T04:13:00.712476] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-17T04:13:00.836549] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-17T04:13:00.836677] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-17T04:13:00.837310] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-17T04:13:00.837366] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-17T04:13:00.838190] [DEBUG] [LOCAL ] HIPO: Trimmed 31806 records to 22908 (keeping 200 days of data) [2025-09-17T04:13:00.989121] [DEBUG] [LOCAL ] HIPO: Primary data saved (22908 records). [2025-09-17T04:13:00.989388] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-17T04:13:00.989539] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIPO took 32.8s. Estimated remaining: 3h 16m 56s. Rate: 6.9 symbols/min [2025-09-17T04:13:01.180359] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:01.200259] [DEBUG] [LOCAL ] HKD: Loaded 13531 existing records from primary storage. [2025-09-17T04:13:01.200517] [INFO ] [MAIN ] HKD: Loaded 13531 existing records. [2025-09-17T04:13:01.396744] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:01.397144] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-17T04:13:01.397219] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-17T04:13:01.397797] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-17T04:13:01.397874] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-17T04:13:01.605192] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:13:01.715175] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-17T04:13:01.842772] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:02.001488] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-17T04:13:02.290194] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-17T04:13:03.090198] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-11. [2025-09-17T04:13:03.151267] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T04:13:03.159224] [INFO ] [REMOTE ] HIMS: Full fetch complete (77909 records). [2025-09-17T04:13:03.159577] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-17T04:13:03.598824] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-17T04:13:03.624298] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T04:13:03.624393] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-17T04:13:03.636297] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-17T04:13:03.638014] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-17T04:13:03.639634] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T04:13:03.648220] [DEBUG] [LOCAL ] HIMS: Trimmed 77909 records to 53817 (keeping 200 days of data) [2025-09-17T04:13:03.890144] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-17T04:13:04.014699] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-17T04:13:04.015073] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-17T04:13:04.015252] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIMS took 46.4s. Estimated remaining: 3h 16m 40s. Rate: 6.9 symbols/min [2025-09-17T04:13:04.198678] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:04.243396] [DEBUG] [LOCAL ] HL: Loaded 40027 existing records from primary storage. [2025-09-17T04:13:04.243714] [INFO ] [MAIN ] HL: Loaded 40027 existing records. [2025-09-17T04:13:04.443363] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:04.458448] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-17T04:13:04.458837] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-17T04:13:04.460128] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T04:13:04.463668] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-17T04:13:04.465975] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-17T04:13:04.701158] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-17T04:13:04.863639] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:05.336687] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:13:05.490223] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-17T04:13:05.783753] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:13:06.290210] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-17T04:13:07.090333] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-17T04:13:07.195988] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:13:07.567558] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T04:13:07.890272] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-17T04:13:08.012485] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T04:13:08.690199] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-17T04:13:09.098856] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T04:13:09.490135] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-11. [2025-09-17T04:13:09.803076] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T04:13:10.290220] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-17T04:13:11.090194] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-17T04:13:11.393992] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T04:13:11.796242] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:13:11.802900] [INFO ] [REMOTE ] HIW: Full fetch complete (64483 records). [2025-09-17T04:13:11.803125] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-17T04:13:11.897796] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-17T04:13:12.215137] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-17T04:13:12.215281] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-17T04:13:12.216399] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-17T04:13:12.216464] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-17T04:13:12.218193] [DEBUG] [LOCAL ] HIW: Trimmed 64483 records to 44891 (keeping 200 days of data) [2025-09-17T04:13:12.348027] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T04:13:12.546049] [DEBUG] [LOCAL ] HIW: Primary data saved (44891 records). [2025-09-17T04:13:12.546526] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-17T04:13:12.546683] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIW took 33.1s. Estimated remaining: 3h 16m 31s. Rate: 6.9 symbols/min [2025-09-17T04:13:12.692988] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-17T04:13:12.726026] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:12.768465] [DEBUG] [LOCAL ] HLF: Loaded 36426 existing records from primary storage. [2025-09-17T04:13:12.768744] [INFO ] [MAIN ] HLF: Loaded 36426 existing records. [2025-09-17T04:13:12.948698] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:12.949061] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-17T04:13:12.949122] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-17T04:13:12.950153] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-17T04:13:12.950217] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-17T04:13:13.144678] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:13:13.345338] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:13.490174] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-11. [2025-09-17T04:13:14.290211] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-17T04:13:14.872182] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T04:13:14.897349] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T04:13:15.090139] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-17T04:13:15.890194] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-17T04:13:16.690191] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-17T04:13:16.913884] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (4.22 seconds). [2025-09-17T04:13:17.490219] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-17T04:13:17.766142] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-17T04:13:17.957454] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T04:13:18.290135] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-17T04:13:18.411624] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-17T04:13:19.090146] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-17T04:13:19.884613] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:13:19.899454] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-17T04:13:19.921218] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:13:20.540180] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (3.05 seconds). [2025-09-17T04:13:20.588669] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T04:13:20.690155] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-17T04:13:21.490152] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-17T04:13:22.290133] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-17T04:13:22.612694] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T04:13:22.632931] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T04:13:22.635856] [INFO ] [REMOTE ] HIX: Full fetch complete (30914 records). [2025-09-17T04:13:22.636009] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-17T04:13:23.044235] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-17T04:13:23.044383] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-17T04:13:23.045223] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-17T04:13:23.045290] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-17T04:13:23.046391] [DEBUG] [LOCAL ] HIX: Trimmed 30914 records to 20301 (keeping 200 days of data) [2025-09-17T04:13:23.098206] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-17T04:13:23.177250] [DEBUG] [LOCAL ] HIX: Primary data saved (20301 records). [2025-09-17T04:13:23.177433] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-17T04:13:23.177536] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 30.3s. Estimated remaining: 3h 16m 24s. Rate: 6.9 symbols/min [2025-09-17T04:13:23.351036] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:23.374433] [DEBUG] [LOCAL ] HLI: Loaded 22663 existing records from primary storage. [2025-09-17T04:13:23.374618] [INFO ] [MAIN ] HLI: Loaded 22663 existing records. [2025-09-17T04:13:23.555105] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:23.555433] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-17T04:13:23.555512] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-17T04:13:23.556287] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-17T04:13:23.556363] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-17T04:13:23.898095] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-17T04:13:23.927452] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:23.963238] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T04:13:24.276316] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T04:13:24.690219] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-17T04:13:25.490221] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-11. [2025-09-17T04:13:25.954237] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T04:13:26.290177] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-17T04:13:26.776281] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:13:26.801717] [DEBUG] [REMOTE ] HKD: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T04:13:26.802305] [WARN ] [REMOTE ] HKD: No data returned for month 2025-07 [2025-09-17T04:13:26.841444] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-17T04:13:27.090205] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-17T04:13:27.890171] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-17T04:13:28.690168] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-17T04:13:29.459243] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T04:13:29.490220] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-17T04:13:29.827901] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-17T04:13:30.127376] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T04:13:30.290252] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-17T04:13:31.090234] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-17T04:13:31.644241] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T04:13:31.890275] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-17T04:13:32.033203] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-17T04:13:32.690262] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-17T04:13:33.099832] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:13:33.103987] [INFO ] [REMOTE ] HKD: Full fetch complete (25370 records). [2025-09-17T04:13:33.104340] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-17T04:13:33.349412] [WARN ] [VALIDATOR ] HKD: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T04:13:33.353006] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T04:13:33.353599] [FATAL] [MAIN ] HKD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:13:33.364629] [WARN ] [MAIN ] HKD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:13:33.364907] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-17T04:13:33.365808] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-09-17T04:13:33.365934] [INFO ] [LOCAL ] HKD: Starting deletion of derivative data. [2025-09-17T04:13:33.366905] [DEBUG] [LOCAL ] HKD: Deleted derivative data file. [2025-09-17T04:13:33.367102] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 32.4s. Estimated remaining: 3h 16m 17s. Rate: 6.9 symbols/min [2025-09-17T04:13:33.495354] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-17T04:13:33.567116] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:33.591612] [DEBUG] [LOCAL ] HLIO: Loaded 21798 existing records from primary storage. [2025-09-17T04:13:33.591874] [INFO ] [MAIN ] HLIO: Loaded 21798 existing records. [2025-09-17T04:13:33.783741] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:33.784126] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-17T04:13:33.784190] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-17T04:13:33.785139] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-17T04:13:33.785215] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-17T04:13:34.201411] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:34.290213] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-17T04:13:34.399014] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:13:35.090247] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-11. [2025-09-17T04:13:35.537180] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T04:13:35.712465] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T04:13:35.890174] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-17T04:13:36.086088] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T04:13:36.690227] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-17T04:13:37.490246] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-17T04:13:37.927706] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:13:38.290190] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-17T04:13:38.408460] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-17T04:13:38.808304] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:13:39.090229] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-17T04:13:39.702635] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T04:13:39.890203] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-17T04:13:40.690113] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-17T04:13:41.030069] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T04:13:41.231563] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T04:13:41.490204] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-17T04:13:41.765086] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T04:13:42.290152] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-17T04:13:42.611390] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T04:13:43.090181] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-17T04:13:43.890164] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-17T04:13:44.430285] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T04:13:44.690166] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-17T04:13:44.854128] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T04:13:45.490281] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-17T04:13:45.783269] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-17T04:13:46.290306] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-17T04:13:46.626211] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T04:13:46.633358] [INFO ] [REMOTE ] HL: Full fetch complete (77520 records). [2025-09-17T04:13:46.633628] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-17T04:13:47.031671] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:13:47.081987] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-17T04:13:47.082130] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-17T04:13:47.083224] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-17T04:13:47.083295] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-17T04:13:47.085191] [DEBUG] [LOCAL ] HL: Trimmed 77520 records to 53670 (keeping 200 days of data) [2025-09-17T04:13:47.138162] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-17T04:13:47.424967] [DEBUG] [LOCAL ] HL: Primary data saved (53670 records). [2025-09-17T04:13:47.425189] [INFO ] [MAIN ] HL: Full history saved. [2025-09-17T04:13:47.425316] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HL took 43.4s. Estimated remaining: 3h 16m 16s. Rate: 6.8 symbols/min [2025-09-17T04:13:47.596526] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:47.619191] [DEBUG] [LOCAL ] HLLY: Loaded 24752 existing records from primary storage. [2025-09-17T04:13:47.619374] [INFO ] [MAIN ] HLLY: Loaded 24752 existing records. [2025-09-17T04:13:47.799128] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:47.799374] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-17T04:13:47.799437] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-17T04:13:47.800082] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-17T04:13:47.800149] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-17T04:13:47.891509] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-17T04:13:48.175530] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:48.215616] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T04:13:48.488602] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T04:13:48.690167] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-17T04:13:48.759737] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:13:49.490228] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-11. [2025-09-17T04:13:50.122764] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:13:50.290227] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-17T04:13:50.680282] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T04:13:51.090289] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-17T04:13:51.890220] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-17T04:13:52.090478] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T04:13:52.351515] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T04:13:52.690244] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-17T04:13:53.490451] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-17T04:13:53.540012] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T04:13:54.228524] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:13:54.236224] [INFO ] [REMOTE ] HLF: Full fetch complete (71471 records). [2025-09-17T04:13:54.236507] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-17T04:13:54.298885] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-17T04:13:54.673320] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-17T04:13:54.673492] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-17T04:13:54.674743] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-17T04:13:54.674818] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-17T04:13:54.676868] [DEBUG] [LOCAL ] HLF: Trimmed 71471 records to 48961 (keeping 200 days of data) [2025-09-17T04:13:54.785353] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:13:54.804785] [INFO ] [REMOTE ] HLI: Full fetch complete (45011 records). [2025-09-17T04:13:54.815574] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-17T04:13:55.107263] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-17T04:13:55.367792] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-17T04:13:55.369244] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-17T04:13:55.373159] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-17T04:13:55.373574] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-17T04:13:55.383474] [DEBUG] [LOCAL ] HLI: Trimmed 45011 records to 31508 (keeping 200 days of data) [2025-09-17T04:13:55.548720] [DEBUG] [LOCAL ] HLF: Primary data saved (48961 records). [2025-09-17T04:13:55.551380] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-17T04:13:55.553846] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HLF took 43.0s. Estimated remaining: 3h 16m 6s. Rate: 6.8 symbols/min [2025-09-17T04:13:55.760052] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:55.793951] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T04:13:55.898292] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-17T04:13:55.923979] [DEBUG] [LOCAL ] HLN: Loaded 39568 existing records from primary storage. [2025-09-17T04:13:55.925032] [INFO ] [MAIN ] HLN: Loaded 39568 existing records. [2025-09-17T04:13:56.151621] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:56.151408] [DEBUG] [LOCAL ] HLI: Primary data saved (31508 records). [2025-09-17T04:13:56.152404] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-17T04:13:56.152587] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-17T04:13:56.152797] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLI took 33.0s. Estimated remaining: 3h 15m 47s. Rate: 6.9 symbols/min [2025-09-17T04:13:56.153054] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-17T04:13:56.186090] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-17T04:13:56.223486] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-17T04:13:56.498627] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:56.716402] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:56.742029] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-11. [2025-09-17T04:13:56.747291] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T04:13:56.771496] [DEBUG] [LOCAL ] HLT: Loaded 37473 existing records from primary storage. [2025-09-17T04:13:56.771809] [INFO ] [MAIN ] HLT: Loaded 37473 existing records. [2025-09-17T04:13:56.962516] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:56.963087] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-17T04:13:56.963170] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-17T04:13:56.964339] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-17T04:13:56.964416] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-17T04:13:57.339957] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:57.490214] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-17T04:13:57.680876] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T04:13:58.290194] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-17T04:13:58.423354] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:13:58.568482] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:13:59.090210] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-11. [2025-09-17T04:13:59.181097] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:13:59.890284] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-17T04:14:00.690260] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-17T04:14:00.914607] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T04:14:01.453126] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T04:14:01.490250] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-17T04:14:02.219938] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:14:02.290215] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-17T04:14:02.761382] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T04:14:02.765066] [INFO ] [REMOTE ] HLIO: Full fetch complete (35886 records). [2025-09-17T04:14:02.765195] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-17T04:14:03.095319] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-17T04:14:03.182575] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-17T04:14:03.182734] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-17T04:14:03.183491] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-17T04:14:03.183554] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-17T04:14:03.185068] [DEBUG] [LOCAL ] HLIO: Trimmed 35886 records to 28192 (keeping 200 days of data) [2025-09-17T04:14:03.374122] [DEBUG] [LOCAL ] HLIO: Primary data saved (28192 records). [2025-09-17T04:14:03.374403] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-17T04:14:03.374551] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLIO took 30.0s. Estimated remaining: 3h 15m 36s. Rate: 6.9 symbols/min [2025-09-17T04:14:03.550294] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:03.591383] [DEBUG] [LOCAL ] HLX: Loaded 35463 existing records from primary storage. [2025-09-17T04:14:03.591666] [INFO ] [MAIN ] HLX: Loaded 35463 existing records. [2025-09-17T04:14:03.778415] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:03.778971] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-17T04:14:03.779057] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-17T04:14:03.788210] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-17T04:14:03.801745] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-17T04:14:03.810751] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:14:03.895159] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-17T04:14:04.196806] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:04.690174] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-11. [2025-09-17T04:14:04.981355] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T04:14:05.490213] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-17T04:14:05.763062] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T04:14:05.887490] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T04:14:06.290196] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-17T04:14:07.090192] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-17T04:14:07.405917] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T04:14:07.890117] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-17T04:14:07.933562] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T04:14:08.474605] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:14:08.690180] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-17T04:14:09.490191] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-17T04:14:09.574679] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T04:14:09.871000] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T04:14:10.290201] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-17T04:14:11.090188] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-17T04:14:11.158391] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T04:14:11.751893] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:14:11.890166] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-17T04:14:12.690176] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-17T04:14:13.012017] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T04:14:13.091387] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T04:14:13.490185] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-17T04:14:14.290158] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-17T04:14:14.704264] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:14:14.709205] [INFO ] [REMOTE ] HLLY: Full fetch complete (45885 records). [2025-09-17T04:14:14.709353] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-17T04:14:15.097437] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-17T04:14:15.117193] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-17T04:14:15.117368] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-17T04:14:15.118440] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-17T04:14:15.118542] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-17T04:14:15.120317] [DEBUG] [LOCAL ] HLLY: Trimmed 45885 records to 32988 (keeping 200 days of data) [2025-09-17T04:14:15.339123] [DEBUG] [LOCAL ] HLLY: Primary data saved (32988 records). [2025-09-17T04:14:15.339877] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-17T04:14:15.340171] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 27.9s. Estimated remaining: 3h 15m 31s. Rate: 6.9 symbols/min [2025-09-17T04:14:15.545413] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-17T04:14:15.612016] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:15.656105] [DEBUG] [LOCAL ] HMC: Loaded 34329 existing records from primary storage. [2025-09-17T04:14:15.656382] [INFO ] [MAIN ] HMC: Loaded 34329 existing records. [2025-09-17T04:14:15.849270] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:15.849671] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-17T04:14:15.849770] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-17T04:14:15.850630] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-17T04:14:15.850751] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-17T04:14:15.896580] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-17T04:14:16.243600] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:16.690230] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-11. [2025-09-17T04:14:16.808319] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T04:14:16.929823] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-17T04:14:17.490178] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-17T04:14:17.927984] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T04:14:18.290190] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-17T04:14:18.526590] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T04:14:19.090201] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-17T04:14:19.411886] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T04:14:19.890140] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-17T04:14:20.077334] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T04:14:20.647359] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:14:20.690135] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-17T04:14:21.490222] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-17T04:14:21.588497] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T04:14:22.152487] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T04:14:22.290226] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-17T04:14:23.090153] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-17T04:14:23.328231] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:14:23.890247] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-17T04:14:24.216246] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T04:14:24.663214] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:14:24.690144] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-17T04:14:25.490275] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-17T04:14:25.628788] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T04:14:26.290239] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-17T04:14:26.498884] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T04:14:26.994404] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T04:14:27.090242] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-17T04:14:27.890183] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-17T04:14:27.930374] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T04:14:28.690132] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-17T04:14:28.728521] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T04:14:29.278142] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:14:29.286635] [INFO ] [REMOTE ] HLT: Full fetch complete (73269 records). [2025-09-17T04:14:29.287035] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-17T04:14:29.491075] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-17T04:14:29.770730] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-17T04:14:29.770896] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-17T04:14:29.772351] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-17T04:14:29.772437] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-17T04:14:29.774712] [DEBUG] [LOCAL ] HLT: Trimmed 73269 records to 50770 (keeping 200 days of data) [2025-09-17T04:14:30.154752] [DEBUG] [LOCAL ] HLT: Primary data saved (50770 records). [2025-09-17T04:14:30.154993] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-17T04:14:30.155162] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLT took 34.0s. Estimated remaining: 3h 15m 30s. Rate: 6.8 symbols/min [2025-09-17T04:14:30.292811] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-17T04:14:30.341914] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:30.375810] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T04:14:30.400538] [DEBUG] [LOCAL ] HMN: Loaded 17941 existing records from primary storage. [2025-09-17T04:14:30.400796] [INFO ] [MAIN ] HMN: Loaded 17941 existing records. [2025-09-17T04:14:30.608762] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:30.609440] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-17T04:14:30.609532] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-17T04:14:30.610298] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-17T04:14:30.610375] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-17T04:14:31.018024] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:31.090253] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-17T04:14:31.350691] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T04:14:31.890207] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-17T04:14:32.046976] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T04:14:32.054339] [INFO ] [REMOTE ] HLN: Full fetch complete (76566 records). [2025-09-17T04:14:32.054631] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-17T04:14:32.475535] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-17T04:14:32.475745] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-17T04:14:32.476955] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-17T04:14:32.477033] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-17T04:14:32.479015] [DEBUG] [LOCAL ] HLN: Trimmed 76566 records to 53082 (keeping 200 days of data) [2025-09-17T04:14:32.691148] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-11. [2025-09-17T04:14:32.858210] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T04:14:32.895801] [DEBUG] [LOCAL ] HLN: Primary data saved (53082 records). [2025-09-17T04:14:32.896248] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-17T04:14:32.896404] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLN took 37.3s. Estimated remaining: 3h 15m 14s. Rate: 6.9 symbols/min [2025-09-17T04:14:33.086921] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:33.144806] [DEBUG] [LOCAL ] HMY: Loaded 39534 existing records from primary storage. [2025-09-17T04:14:33.145058] [INFO ] [MAIN ] HMY: Loaded 39534 existing records. [2025-09-17T04:14:33.356915] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:33.357289] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-17T04:14:33.357373] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-17T04:14:33.358471] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-17T04:14:33.358584] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-17T04:14:33.495331] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-17T04:14:33.760841] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:33.792493] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T04:14:33.839527] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T04:14:34.290192] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-17T04:14:35.090155] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-17T04:14:35.144248] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:14:35.461607] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T04:14:35.890138] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-11. [2025-09-17T04:14:36.690189] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-17T04:14:36.871627] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:14:37.490206] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-17T04:14:37.799039] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T04:14:38.199738] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:14:38.205405] [INFO ] [REMOTE ] HLX: Full fetch complete (68942 records). [2025-09-17T04:14:38.205616] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-17T04:14:38.296314] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-17T04:14:38.600206] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-17T04:14:38.600349] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-17T04:14:38.601403] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-17T04:14:38.601533] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-17T04:14:38.603437] [DEBUG] [LOCAL ] HLX: Trimmed 68942 records to 48229 (keeping 200 days of data) [2025-09-17T04:14:38.890564] [DEBUG] [LOCAL ] HLX: Primary data saved (48229 records). [2025-09-17T04:14:38.890783] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-17T04:14:38.890949] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLX took 35.5s. Estimated remaining: 3h 15m 1s. Rate: 6.9 symbols/min [2025-09-17T04:14:39.064834] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:39.065087] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-17T04:14:39.065134] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-17T04:14:39.065255] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-17T04:14:39.065312] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-17T04:14:39.065367] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-17T04:14:39.065432] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-17T04:14:39.096272] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-17T04:14:39.466709] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:39.478906] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:14:39.515377] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T04:14:39.890167] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-11. [2025-09-17T04:14:40.091750] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:40.092589] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-11 [2025-09-17T04:14:40.690376] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-17T04:14:40.882294] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:40.882811] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-17T04:14:40.943914] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T04:14:41.490206] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-17T04:14:41.686733] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:41.687258] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-17T04:14:42.290186] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-17T04:14:43.090202] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-17T04:14:43.890192] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-17T04:14:44.036950] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:14:44.080549] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:44.080992] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-17T04:14:44.226588] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:14:44.690199] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-17T04:14:45.490155] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-17T04:14:46.290182] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-17T04:14:46.508115] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:46.508510] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-17T04:14:46.556629] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T04:14:46.678049] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T04:14:47.090227] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-17T04:14:47.890191] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-17T04:14:48.690165] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-17T04:14:48.881962] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:48.882347] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-17T04:14:48.947521] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T04:14:48.996381] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:14:49.490200] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-17T04:14:50.290163] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-17T04:14:50.692601] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T04:14:51.090164] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-17T04:14:51.890221] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-17T04:14:51.950883] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T04:14:52.067687] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T04:14:52.690164] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-17T04:14:53.139889] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:14:53.490165] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-17T04:14:54.021402] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T04:14:54.290180] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-17T04:14:54.903747] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:14:55.006373] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T04:14:55.090094] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-17T04:14:55.890194] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-17T04:14:56.310175] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T04:14:56.690161] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-17T04:14:57.441397] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:14:57.447212] [INFO ] [REMOTE ] HMC: Full fetch complete (69700 records). [2025-09-17T04:14:57.447420] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-17T04:14:57.495251] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-17T04:14:57.854585] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-17T04:14:57.854947] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-17T04:14:57.856154] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-17T04:14:57.856341] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-17T04:14:57.869610] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T04:14:57.875739] [DEBUG] [LOCAL ] HMC: Trimmed 69700 records to 47068 (keeping 200 days of data) [2025-09-17T04:14:58.167036] [DEBUG] [LOCAL ] HMC: Primary data saved (47068 records). [2025-09-17T04:14:58.167230] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-17T04:14:58.167398] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HMC took 42.8s. Estimated remaining: 3h 15m 6s. Rate: 6.8 symbols/min [2025-09-17T04:14:58.295238] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-17T04:14:58.346546] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:58.372683] [DEBUG] [LOCAL ] HNI: Loaded 21452 existing records from primary storage. [2025-09-17T04:14:58.372889] [INFO ] [MAIN ] HNI: Loaded 21452 existing records. [2025-09-17T04:14:58.568377] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:58.568679] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-17T04:14:58.568758] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-17T04:14:58.569462] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-17T04:14:58.569553] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-17T04:14:58.940023] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:59.090109] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-11. [2025-09-17T04:14:59.321866] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:14:59.324995] [INFO ] [REMOTE ] HMN: Full fetch complete (31394 records). [2025-09-17T04:14:59.325124] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-17T04:14:59.713289] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-17T04:14:59.713489] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-17T04:14:59.714562] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-17T04:14:59.715171] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-17T04:14:59.717868] [DEBUG] [LOCAL ] HMN: Trimmed 31394 records to 23184 (keeping 200 days of data) [2025-09-17T04:14:59.857511] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-17T04:14:59.899710] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-17T04:14:59.932680] [DEBUG] [LOCAL ] HMN: Primary data saved (23184 records). [2025-09-17T04:14:59.932891] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-17T04:14:59.933231] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HMN took 29.8s. Estimated remaining: 3h 14m 49s. Rate: 6.9 symbols/min [2025-09-17T04:15:00.129420] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:00.181366] [DEBUG] [LOCAL ] HOG: Loaded 37825 existing records from primary storage. [2025-09-17T04:15:00.181693] [INFO ] [MAIN ] HOG: Loaded 37825 existing records. [2025-09-17T04:15:00.381286] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:00.381750] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-17T04:15:00.381829] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-17T04:15:00.383241] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-17T04:15:00.383328] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-17T04:15:00.524079] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:15:00.695216] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-17T04:15:00.792901] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:01.490247] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-17T04:15:02.290235] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-11. [2025-09-17T04:15:02.502414] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T04:15:02.681936] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-17T04:15:03.090143] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-17T04:15:03.890219] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-17T04:15:05.117204] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T04:15:05.123000] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-17T04:15:05.151149] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (3.66 seconds). [2025-09-17T04:15:05.490134] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-17T04:15:05.800242] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-11 (3.51 seconds). [2025-09-17T04:15:06.290165] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-17T04:15:06.329006] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T04:15:06.361591] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:15:07.073195] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:15:07.090085] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-17T04:15:07.890131] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-17T04:15:08.208494] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T04:15:08.665546] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T04:15:08.671228] [INFO ] [REMOTE ] HNGE: Full fetch complete (24280 records). [2025-09-17T04:15:08.671431] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-17T04:15:08.695233] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-17T04:15:08.865498] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 80 unique days, need 200 days [2025-09-17T04:15:08.865915] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:15:08.865982] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:15:08.866033] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-17T04:15:08.866107] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-17T04:15:08.866164] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-17T04:15:08.866220] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-17T04:15:08.866294] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HNGE took 30.0s. Estimated remaining: 3h 14m 40s. Rate: 6.9 symbols/min [2025-09-17T04:15:09.038852] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:09.072581] [DEBUG] [LOCAL ] HOMB: Loaded 31713 existing records from primary storage. [2025-09-17T04:15:09.072821] [INFO ] [MAIN ] HOMB: Loaded 31713 existing records. [2025-09-17T04:15:09.265762] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:09.266598] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-17T04:15:09.266699] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-17T04:15:09.267935] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-17T04:15:09.268016] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-17T04:15:09.492885] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-17T04:15:09.663738] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:09.697046] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T04:15:10.055381] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T04:15:10.290139] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-17T04:15:11.090188] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-17T04:15:11.230195] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T04:15:11.890133] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-17T04:15:12.317161] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T04:15:12.504796] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T04:15:12.690146] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-17T04:15:13.490130] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-17T04:15:13.576179] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T04:15:13.664109] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T04:15:14.290164] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-17T04:15:15.090182] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-11. [2025-09-17T04:15:15.890211] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-17T04:15:16.032514] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T04:15:16.477606] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-09-17T04:15:16.690159] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-17T04:15:17.352800] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-11 (2.26 seconds). [2025-09-17T04:15:17.490210] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-17T04:15:17.795049] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:15:17.825301] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T04:15:18.290160] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-17T04:15:18.991701] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T04:15:19.090135] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-17T04:15:19.890248] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-17T04:15:20.002292] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T04:15:20.009030] [INFO ] [REMOTE ] HMY: Full fetch complete (76408 records). [2025-09-17T04:15:20.009209] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-17T04:15:20.422734] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-17T04:15:20.422878] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-17T04:15:20.424002] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-17T04:15:20.424069] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-17T04:15:20.426196] [DEBUG] [LOCAL ] HMY: Trimmed 76408 records to 53124 (keeping 200 days of data) [2025-09-17T04:15:20.690254] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-17T04:15:20.809279] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:15:20.838798] [DEBUG] [LOCAL ] HMY: Primary data saved (53124 records). [2025-09-17T04:15:20.839022] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-17T04:15:20.839146] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMY took 47.9s. Estimated remaining: 3h 14m 35s. Rate: 6.9 symbols/min [2025-09-17T04:15:21.015311] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:21.057970] [DEBUG] [LOCAL ] HOUS: Loaded 32881 existing records from primary storage. [2025-09-17T04:15:21.058498] [INFO ] [MAIN ] HOUS: Loaded 32881 existing records. [2025-09-17T04:15:21.253232] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:21.254357] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-17T04:15:21.254439] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-17T04:15:21.267276] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-17T04:15:21.290004] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-17T04:15:21.370052] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:15:21.499390] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-17T04:15:21.679152] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:22.290214] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-17T04:15:22.536345] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T04:15:23.084433] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T04:15:23.092547] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-17T04:15:23.333956] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T04:15:23.338972] [INFO ] [REMOTE ] HNI: Full fetch complete (40487 records). [2025-09-17T04:15:23.339085] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-17T04:15:23.712380] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-17T04:15:23.712520] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-17T04:15:23.713453] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-17T04:15:23.713601] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-17T04:15:23.714700] [DEBUG] [LOCAL ] HNI: Trimmed 40487 records to 28780 (keeping 200 days of data) [2025-09-17T04:15:23.891527] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-11. [2025-09-17T04:15:23.895204] [DEBUG] [LOCAL ] HNI: Primary data saved (28780 records). [2025-09-17T04:15:23.896153] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-17T04:15:23.896276] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HNI took 25.7s. Estimated remaining: 3h 14m 19s. Rate: 6.9 symbols/min [2025-09-17T04:15:24.690171] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-17T04:15:24.797397] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:15:25.350932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T04:15:25.490207] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-17T04:15:26.290240] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-17T04:15:26.345203] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:15:26.908510] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T04:15:27.090159] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-17T04:15:27.781519] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T04:15:27.890198] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-17T04:15:28.690168] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-17T04:15:28.986395] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T04:15:29.490160] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-17T04:15:29.777181] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T04:15:30.186932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T04:15:30.290144] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-17T04:15:30.749020] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T04:15:31.090149] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-17T04:15:31.458951] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:15:31.890195] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-17T04:15:32.234783] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T04:15:32.690199] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-17T04:15:33.495930] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-17T04:15:33.512374] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:15:34.187169] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:15:34.290160] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-17T04:15:35.155633] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-17T04:15:35.179126] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T04:15:35.386866] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T04:15:35.890148] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-17T04:15:36.690215] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-17T04:15:36.791050] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T04:15:36.797934] [INFO ] [REMOTE ] HOG: Full fetch complete (74080 records). [2025-09-17T04:15:36.798120] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-17T04:15:37.216607] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-17T04:15:37.216814] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-17T04:15:37.218020] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-17T04:15:37.218101] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-17T04:15:37.219981] [DEBUG] [LOCAL ] HOG: Trimmed 74080 records to 51307 (keeping 200 days of data) [2025-09-17T04:15:37.576765] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T04:15:37.597058] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-17T04:15:37.607378] [DEBUG] [LOCAL ] HOG: Primary data saved (51307 records). [2025-09-17T04:15:37.607590] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-17T04:15:37.607726] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOG took 37.7s. Estimated remaining: 3h 14m 17s. Rate: 6.9 symbols/min [2025-09-17T04:15:38.223816] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:15:38.290210] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-17T04:15:39.096975] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:15:39.103160] [INFO ] [REMOTE ] HOMB: Full fetch complete (63425 records). [2025-09-17T04:15:39.103400] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-17T04:15:39.516981] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-17T04:15:39.517148] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-17T04:15:39.518525] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-17T04:15:39.518628] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-17T04:15:39.550216] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T04:15:39.548527] [DEBUG] [LOCAL ] HOMB: Trimmed 63425 records to 43713 (keeping 200 days of data) [2025-09-17T04:15:39.560881] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-17T04:15:39.838621] [DEBUG] [LOCAL ] HOMB: Primary data saved (43713 records). [2025-09-17T04:15:39.838841] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-17T04:15:39.838984] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOMB took 31.0s. Estimated remaining: 3h 13m 60s. Rate: 6.9 symbols/min [2025-09-17T04:15:41.142330] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T04:15:41.152872] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-17T04:15:42.660393] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T04:15:42.671027] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-17T04:15:44.286546] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:15:44.292563] [INFO ] [REMOTE ] HOUS: Full fetch complete (62133 records). [2025-09-17T04:15:44.292783] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-17T04:15:44.678955] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-17T04:15:44.679074] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-17T04:15:44.680011] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-17T04:15:44.680089] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-17T04:15:44.681897] [DEBUG] [LOCAL ] HOUS: Trimmed 62133 records to 43953 (keeping 200 days of data) [2025-09-17T04:15:44.935911] [DEBUG] [LOCAL ] HOUS: Primary data saved (43953 records). [2025-09-17T04:15:44.936126] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-17T04:15:44.936266] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 24.1s. Estimated remaining: 3h 13m 46s. Rate: 6.9 symbols/min [2025-09-17T04:15:45.469199] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.572550] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.692266] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.694675] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.700055] [DEBUG] [LOCAL ] HOV: Loaded 10592 existing records from primary storage. [2025-09-17T04:15:45.700299] [INFO ] [MAIN ] HOV: Loaded 10592 existing records. [2025-09-17T04:15:45.854058] [DEBUG] [LOCAL ] HPF: Loaded 5625 existing records from primary storage. [2025-09-17T04:15:45.918825] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:45.896285] [INFO ] [MAIN ] HPF: Loaded 5625 existing records. [2025-09-17T04:15:45.932151] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-17T04:15:45.980754] [DEBUG] [LOCAL ] HPE: Loaded 40047 existing records from primary storage. [2025-09-17T04:15:45.980872] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-17T04:15:46.068249] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-17T04:15:46.043927] [DEBUG] [LOCAL ] HP: Loaded 38678 existing records from primary storage. [2025-09-17T04:15:46.007382] [INFO ] [MAIN ] HPE: Loaded 40047 existing records. [2025-09-17T04:15:46.073931] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-17T04:15:46.073805] [INFO ] [MAIN ] HP: Loaded 38678 existing records. [2025-09-17T04:15:46.677844] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:46.837292] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:46.807033] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-17T04:15:46.868178] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-17T04:15:46.868448] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:46.873838] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-17T04:15:46.892462] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-17T04:15:46.903184] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-17T04:15:46.902962] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-17T04:15:46.908593] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-17T04:15:46.934952] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-17T04:15:46.940283] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-17T04:15:46.977955] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:47.015935] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-17T04:15:46.998827] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-17T04:15:46.999181] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-11. [2025-09-17T04:15:47.052762] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-17T04:15:48.001190] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:48.072175] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-11. [2025-09-17T04:15:48.133843] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:48.139127] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:48.140343] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-11. [2025-09-17T04:15:48.140659] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-11. [2025-09-17T04:15:48.151369] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T04:15:48.154291] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-17T04:15:48.802094] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:15:48.803811] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-17T04:15:49.191867] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:15:49.195801] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-17T04:15:49.551674] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T04:15:49.554431] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-17T04:15:49.736994] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T04:15:49.749157] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-17T04:15:49.776457] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T04:15:49.779580] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-17T04:15:50.038170] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T04:15:50.049749] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-17T04:15:50.309080] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T04:15:50.312123] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-17T04:15:50.390513] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T04:15:50.699598] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T04:15:51.089000] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T04:15:51.099237] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-17T04:15:51.708264] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T04:15:51.890165] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-17T04:15:52.019150] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T04:15:52.442787] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T04:15:52.690213] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-17T04:15:53.490227] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-17T04:15:53.556515] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:15:54.230716] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T04:15:54.290215] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-17T04:15:54.976869] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T04:15:55.090171] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-17T04:15:55.890168] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-17T04:15:56.652362] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:15:56.690165] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-17T04:15:56.787839] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T04:15:57.462037] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:15:57.490174] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-17T04:15:58.290164] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-17T04:15:59.019567] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T04:15:59.090138] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-17T04:15:59.168928] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T04:15:59.845984] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T04:15:59.848117] [INFO ] [REMOTE ] HPF: Full fetch complete (10696 records). [2025-09-17T04:15:59.848216] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-17T04:15:59.895231] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-17T04:16:00.232244] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-17T04:16:00.232397] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-17T04:16:00.232783] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-17T04:16:00.232841] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-17T04:16:00.233453] [DEBUG] [LOCAL ] HPF: Trimmed 10696 records to 7213 (keeping 200 days of data) [2025-09-17T04:16:00.280558] [DEBUG] [LOCAL ] HPF: Primary data saved (7213 records). [2025-09-17T04:16:00.280933] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-17T04:16:00.281051] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 15.3s. Estimated remaining: 3h 13m 46s. Rate: 6.9 symbols/min [2025-09-17T04:16:00.454053] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:00.464417] [DEBUG] [LOCAL ] HPI: Loaded 7756 existing records from primary storage. [2025-09-17T04:16:00.464611] [INFO ] [MAIN ] HPI: Loaded 7756 existing records. [2025-09-17T04:16:00.647308] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:00.647600] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-17T04:16:00.647685] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-17T04:16:00.648078] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-17T04:16:00.648146] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-17T04:16:00.702752] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-17T04:16:00.928423] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T04:16:01.033388] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:01.490132] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-17T04:16:02.290143] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-17T04:16:02.486953] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T04:16:02.782428] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T04:16:03.090161] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-17T04:16:03.890178] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-11. [2025-09-17T04:16:03.979751] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T04:16:04.016886] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T04:16:04.631664] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T04:16:04.690146] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-17T04:16:05.276075] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T04:16:05.490153] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-17T04:16:06.290227] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-17T04:16:07.090225] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-17T04:16:07.253468] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T04:16:07.292430] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:16:07.826066] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T04:16:07.890147] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-17T04:16:08.690182] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-17T04:16:09.291107] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:16:09.490213] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-17T04:16:09.688740] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T04:16:10.238042] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T04:16:10.290183] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-17T04:16:11.090192] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-17T04:16:11.183078] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T04:16:11.185276] [INFO ] [REMOTE ] HOV: Full fetch complete (19278 records). [2025-09-17T04:16:11.185384] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-17T04:16:11.566710] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-17T04:16:11.566829] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-17T04:16:11.567337] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-17T04:16:11.567403] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-17T04:16:11.568085] [DEBUG] [LOCAL ] HOV: Trimmed 19278 records to 13734 (keeping 200 days of data) [2025-09-17T04:16:11.655568] [DEBUG] [LOCAL ] HOV: Primary data saved (13734 records). [2025-09-17T04:16:11.655772] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-17T04:16:11.655883] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 26.7s. Estimated remaining: 3h 13m 41s. Rate: 6.9 symbols/min [2025-09-17T04:16:11.836037] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:11.875980] [DEBUG] [LOCAL ] HPP: Loaded 38143 existing records from primary storage. [2025-09-17T04:16:11.876322] [INFO ] [MAIN ] HPP: Loaded 38143 existing records. [2025-09-17T04:16:11.897624] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-17T04:16:11.933299] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T04:16:12.076228] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:12.076491] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-17T04:16:12.076548] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-17T04:16:12.077366] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-17T04:16:12.077428] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-17T04:16:12.450709] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:12.690168] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-11. [2025-09-17T04:16:13.490185] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-17T04:16:13.735500] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T04:16:14.273155] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:16:14.290114] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-17T04:16:14.386046] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T04:16:15.090218] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-17T04:16:15.890104] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-17T04:16:16.429937] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T04:16:16.690147] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-17T04:16:16.789739] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T04:16:17.209440] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:16:17.490160] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-17T04:16:18.290169] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-17T04:16:18.776819] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T04:16:19.090146] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-17T04:16:19.339324] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T04:16:19.444917] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:16:19.890164] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-17T04:16:20.690150] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-17T04:16:21.043419] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T04:16:21.425142] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T04:16:21.459724] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:16:21.490101] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-17T04:16:22.290166] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-17T04:16:23.005087] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:16:23.011593] [INFO ] [REMOTE ] HP: Full fetch complete (73775 records). [2025-09-17T04:16:23.011811] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-17T04:16:23.095345] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-17T04:16:23.427814] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-17T04:16:23.427979] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-17T04:16:23.429260] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-17T04:16:23.429330] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-17T04:16:23.432707] [DEBUG] [LOCAL ] HP: Trimmed 73775 records to 51688 (keeping 200 days of data) [2025-09-17T04:16:23.771494] [DEBUG] [LOCAL ] HP: Primary data saved (51688 records). [2025-09-17T04:16:23.771731] [INFO ] [MAIN ] HP: Full history saved. [2025-09-17T04:16:23.771939] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HP took 38.8s. Estimated remaining: 3h 13m 36s. Rate: 6.8 symbols/min [2025-09-17T04:16:23.896600] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-17T04:16:23.919149] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T04:16:23.991351] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:24.031629] [DEBUG] [LOCAL ] HPQ: Loaded 40021 existing records from primary storage. [2025-09-17T04:16:24.031831] [INFO ] [MAIN ] HPQ: Loaded 40021 existing records. [2025-09-17T04:16:24.207783] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:24.208048] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-17T04:16:24.208105] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-17T04:16:24.209771] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-17T04:16:24.209848] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-17T04:16:24.615283] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:24.680569] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T04:16:24.690140] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-11. [2025-09-17T04:16:25.051673] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T04:16:25.490162] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-17T04:16:26.290147] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-17T04:16:26.321483] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T04:16:26.609511] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T04:16:27.090157] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-17T04:16:27.890108] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-17T04:16:28.158610] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:16:28.162362] [INFO ] [REMOTE ] HPI: Full fetch complete (13113 records). [2025-09-17T04:16:28.162500] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-17T04:16:28.572184] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-17T04:16:28.572438] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-17T04:16:28.572998] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-17T04:16:28.573187] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-17T04:16:28.573988] [DEBUG] [LOCAL ] HPI: Trimmed 13113 records to 9802 (keeping 200 days of data) [2025-09-17T04:16:28.659590] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-17T04:16:28.690446] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-17T04:16:28.690599] [DEBUG] [LOCAL ] HPI: Primary data saved (9802 records). [2025-09-17T04:16:28.691737] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-17T04:16:28.691892] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HPI took 28.4s. Estimated remaining: 3h 13m 22s. Rate: 6.9 symbols/min [2025-09-17T04:16:28.869497] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:28.880803] [DEBUG] [LOCAL ] HPS: Loaded 7704 existing records from primary storage. [2025-09-17T04:16:28.880984] [INFO ] [MAIN ] HPS: Loaded 7704 existing records. [2025-09-17T04:16:29.066353] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:29.066693] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-17T04:16:29.066796] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-17T04:16:29.067161] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-17T04:16:29.067242] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-17T04:16:29.510419] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-17T04:16:29.517036] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:29.558692] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:16:30.290182] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-11. [2025-09-17T04:16:30.802090] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T04:16:31.011771] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T04:16:31.090201] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-17T04:16:31.186626] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:16:31.787697] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T04:16:31.890197] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-17T04:16:32.690179] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-17T04:16:33.490219] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-17T04:16:33.930688] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T04:16:33.937772] [INFO ] [REMOTE ] HPE: Full fetch complete (77587 records). [2025-09-17T04:16:33.938033] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-17T04:16:34.300519] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-17T04:16:34.394919] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-17T04:16:34.395299] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-17T04:16:34.396766] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-17T04:16:34.397020] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-17T04:16:34.432434] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T04:16:34.432674] [DEBUG] [LOCAL ] HPE: Trimmed 77587 records to 53697 (keeping 200 days of data) [2025-09-17T04:16:34.798553] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-17T04:16:34.798797] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-17T04:16:34.798935] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPE took 49.9s. Estimated remaining: 3h 13m 10s. Rate: 6.9 symbols/min [2025-09-17T04:16:34.987441] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:35.044450] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T04:16:35.062878] [DEBUG] [LOCAL ] HQH: Loaded 18896 existing records from primary storage. [2025-09-17T04:16:35.063074] [INFO ] [MAIN ] HQH: Loaded 18896 existing records. [2025-09-17T04:16:35.100114] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-17T04:16:35.281964] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T04:16:35.288194] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:35.294936] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-17T04:16:35.295096] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-17T04:16:35.295783] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-17T04:16:35.295850] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-17T04:16:35.687483] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:35.890222] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-17T04:16:36.690190] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-17T04:16:36.733720] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T04:16:36.873152] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:16:37.490218] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-11. [2025-09-17T04:16:38.290177] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-17T04:16:38.459793] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T04:16:38.518462] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T04:16:39.090179] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-17T04:16:39.872331] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T04:16:39.890098] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-17T04:16:40.690153] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-17T04:16:40.985821] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:16:41.490184] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-17T04:16:41.685837] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:16:41.694392] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T04:16:42.290210] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-17T04:16:42.648734] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T04:16:43.090165] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-17T04:16:43.890209] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-17T04:16:44.054505] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T04:16:44.108022] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T04:16:44.690166] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-17T04:16:45.490155] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-17T04:16:45.548771] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T04:16:45.722670] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T04:16:46.290193] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-17T04:16:46.846963] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T04:16:46.854452] [INFO ] [REMOTE ] HPP: Full fetch complete (73177 records). [2025-09-17T04:16:46.854667] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-17T04:16:47.095468] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-17T04:16:47.284919] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-17T04:16:47.285074] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-17T04:16:47.286356] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-17T04:16:47.286438] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-17T04:16:47.288422] [DEBUG] [LOCAL ] HPP: Trimmed 73177 records to 50711 (keeping 200 days of data) [2025-09-17T04:16:47.426035] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T04:16:47.678047] [DEBUG] [LOCAL ] HPP: Primary data saved (50711 records). [2025-09-17T04:16:47.678291] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-17T04:16:47.678420] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPP took 36.0s. Estimated remaining: 3h 13m 7s. Rate: 6.9 symbols/min [2025-09-17T04:16:47.870686] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:47.886797] [DEBUG] [LOCAL ] HQL: Loaded 11773 existing records from primary storage. [2025-09-17T04:16:47.887076] [INFO ] [MAIN ] HQL: Loaded 11773 existing records. [2025-09-17T04:16:47.899564] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-17T04:16:48.088768] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:48.089164] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-17T04:16:48.089253] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-17T04:16:48.089863] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-17T04:16:48.089937] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-17T04:16:48.490588] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:48.690227] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-11. [2025-09-17T04:16:48.783958] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T04:16:49.059701] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T04:16:49.490154] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-17T04:16:49.597599] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T04:16:50.237452] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:16:50.290154] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-17T04:16:51.090147] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-17T04:16:51.230924] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T04:16:51.890144] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-17T04:16:52.263074] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T04:16:52.690165] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-17T04:16:53.490133] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-17T04:16:53.593749] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T04:16:53.720049] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T04:16:54.290151] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-17T04:16:54.795958] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:16:55.090157] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-17T04:16:55.890147] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-17T04:16:56.036815] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T04:16:56.321275] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:16:56.690197] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-17T04:16:56.944841] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T04:16:57.486511] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T04:16:57.490069] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-17T04:16:58.290158] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-17T04:16:58.341249] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T04:16:58.343792] [INFO ] [REMOTE ] HPS: Full fetch complete (15096 records). [2025-09-17T04:16:58.343919] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-17T04:16:58.793305] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-17T04:16:58.793499] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-17T04:16:58.794706] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-17T04:16:58.794814] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-17T04:16:58.796172] [DEBUG] [LOCAL ] HPS: Trimmed 15096 records to 10289 (keeping 200 days of data) [2025-09-17T04:16:58.900048] [DEBUG] [LOCAL ] HPS: Primary data saved (10289 records). [2025-09-17T04:16:58.900341] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-17T04:16:58.900520] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPS took 30.2s. Estimated remaining: 3h 13m 1s. Rate: 6.8 symbols/min [2025-09-17T04:16:59.107172] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-17T04:16:59.177142] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:59.177502] [DEBUG] [LOCAL ] HR: No existing data file found in primary storage. [2025-09-17T04:16:59.177598] [WARN ] [MAIN ] HR: No existing data found, performing full refresh instead. [2025-09-17T04:16:59.177910] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-17T04:16:59.179727] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-17T04:16:59.180782] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-09-17T04:16:59.180882] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-17T04:16:59.730021] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:59.752058] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:16:59.890147] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-17T04:17:00.244820] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T04:17:00.690117] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-17T04:17:01.228610] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:17:01.490185] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-17T04:17:01.734448] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:17:02.290176] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-17T04:17:03.090145] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-17T04:17:03.337000] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T04:17:03.506993] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T04:17:03.890122] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-17T04:17:04.192854] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T04:17:04.196741] [INFO ] [REMOTE ] HQH: Full fetch complete (37531 records). [2025-09-17T04:17:04.197091] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-17T04:17:04.596141] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-17T04:17:04.596322] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-17T04:17:04.597413] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-17T04:17:04.597494] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-17T04:17:04.598972] [DEBUG] [LOCAL ] HQH: Trimmed 37531 records to 24949 (keeping 200 days of data) [2025-09-17T04:17:04.693241] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-11. [2025-09-17T04:17:04.760867] [DEBUG] [LOCAL ] HQH: Primary data saved (24949 records). [2025-09-17T04:17:04.761063] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-17T04:17:04.761172] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HQH took 30.0s. Estimated remaining: 3h 12m 49s. Rate: 6.9 symbols/min [2025-09-17T04:17:04.932701] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:04.944181] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T04:17:04.981017] [DEBUG] [LOCAL ] HRB: Loaded 36056 existing records from primary storage. [2025-09-17T04:17:04.981224] [INFO ] [MAIN ] HRB: Loaded 36056 existing records. [2025-09-17T04:17:05.159782] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:05.160087] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-17T04:17:05.160152] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-17T04:17:05.161032] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-17T04:17:05.161095] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-17T04:17:05.495395] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-17T04:17:05.525037] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:06.290154] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-11. [2025-09-17T04:17:06.359452] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:17:06.545930] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T04:17:07.090202] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-17T04:17:07.824872] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T04:17:07.890137] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-17T04:17:08.690212] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-17T04:17:08.750132] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:17:09.445308] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T04:17:09.467566] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T04:17:09.490106] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-17T04:17:10.290165] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-17T04:17:10.875275] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T04:17:11.090214] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-17T04:17:11.890162] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-17T04:17:11.947494] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:17:12.690172] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-17T04:17:12.753882] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T04:17:12.835563] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:17:13.490163] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-17T04:17:14.254463] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:17:14.290151] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-17T04:17:15.005775] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T04:17:15.012812] [INFO ] [REMOTE ] HPQ: Full fetch complete (77540 records). [2025-09-17T04:17:15.013040] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-17T04:17:15.095260] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-17T04:17:15.379635] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T04:17:15.462746] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-17T04:17:15.462897] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-17T04:17:15.464363] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-17T04:17:15.464463] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-17T04:17:15.466547] [DEBUG] [LOCAL ] HPQ: Trimmed 77540 records to 53669 (keeping 200 days of data) [2025-09-17T04:17:15.837466] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-09-17T04:17:15.837712] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-17T04:17:15.837845] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HPQ took 52.1s. Estimated remaining: 3h 12m 43s. Rate: 6.8 symbols/min [2025-09-17T04:17:15.895502] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-17T04:17:16.030296] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:16.060959] [DEBUG] [LOCAL ] HRI: Loaded 24045 existing records from primary storage. [2025-09-17T04:17:16.061193] [INFO ] [MAIN ] HRI: Loaded 24045 existing records. [2025-09-17T04:17:16.246895] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:16.247209] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-17T04:17:16.247267] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-17T04:17:16.248359] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-17T04:17:16.248436] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-17T04:17:16.607766] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:16.690087] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-11. [2025-09-17T04:17:16.923234] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:17:16.922879] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T04:17:16.939013] [INFO ] [REMOTE ] HQL: Full fetch complete (24086 records). [2025-09-17T04:17:16.940085] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-17T04:17:17.360225] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-17T04:17:17.360415] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-17T04:17:17.361161] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-17T04:17:17.361225] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-17T04:17:17.362402] [DEBUG] [LOCAL ] HQL: Trimmed 24086 records to 16177 (keeping 200 days of data) [2025-09-17T04:17:17.470812] [DEBUG] [LOCAL ] HQL: Primary data saved (16177 records). [2025-09-17T04:17:17.471040] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-17T04:17:17.471182] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQL took 29.8s. Estimated remaining: 3h 12m 25s. Rate: 6.9 symbols/min [2025-09-17T04:17:17.495338] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-17T04:17:17.660791] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:17.702187] [DEBUG] [LOCAL ] HRL: Loaded 39585 existing records from primary storage. [2025-09-17T04:17:17.702416] [INFO ] [MAIN ] HRL: Loaded 39585 existing records. [2025-09-17T04:17:17.896552] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:17.896870] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-17T04:17:17.896936] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-17T04:17:17.898043] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-17T04:17:17.898110] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-17T04:17:18.292821] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-17T04:17:18.299872] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:18.302493] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T04:17:19.034047] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:17:19.090232] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-17T04:17:19.890200] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-17T04:17:20.250194] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T04:17:20.338961] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T04:17:20.690214] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-11. [2025-09-17T04:17:21.490216] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-17T04:17:21.649607] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T04:17:22.257612] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:17:22.290181] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-17T04:17:23.090210] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-17T04:17:23.156429] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:17:23.215365] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T04:17:23.890194] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-17T04:17:24.690193] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-17T04:17:24.750029] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:17:25.490237] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-17T04:17:25.701451] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T04:17:26.056168] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:17:26.290195] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-17T04:17:27.090173] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-17T04:17:27.161513] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:17:27.761600] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:17:27.890189] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-17T04:17:28.695308] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-17T04:17:28.713952] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T04:17:29.237987] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:17:29.490268] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-17T04:17:30.290729] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-17T04:17:30.296574] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T04:17:31.039662] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T04:17:31.090186] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-17T04:17:31.890141] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-17T04:17:31.999004] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:17:32.684108] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:17:32.694476] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-17T04:17:33.357338] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T04:17:33.490203] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-17T04:17:34.264855] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T04:17:34.272008] [INFO ] [REMOTE ] HR: Full fetch complete (74660 records). [2025-09-17T04:17:34.272256] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-17T04:17:34.295336] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-17T04:17:34.722753] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-17T04:17:34.722920] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-17T04:17:34.724352] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-17T04:17:34.724462] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-17T04:17:34.726548] [DEBUG] [LOCAL ] HR: Trimmed 74660 records to 51981 (keeping 200 days of data) [2025-09-17T04:17:35.084984] [DEBUG] [LOCAL ] HR: Primary data saved (51981 records). [2025-09-17T04:17:35.085267] [INFO ] [MAIN ] HR: Full history saved. [2025-09-17T04:17:35.085421] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HR took 36.2s. Estimated remaining: 3h 12m 28s. Rate: 6.8 symbols/min [2025-09-17T04:17:35.114074] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-17T04:17:35.331600] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:35.368165] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T04:17:35.397136] [DEBUG] [LOCAL ] HRTG: Loaded 25347 existing records from primary storage. [2025-09-17T04:17:35.397533] [INFO ] [MAIN ] HRTG: Loaded 25347 existing records. [2025-09-17T04:17:35.590633] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:35.590972] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-17T04:17:35.591039] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-17T04:17:35.591913] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-17T04:17:35.591986] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-17T04:17:35.895349] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-17T04:17:35.996310] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:36.264987] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T04:17:36.656791] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:17:36.690213] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-17T04:17:37.490167] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-11. [2025-09-17T04:17:37.540619] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:17:37.547262] [INFO ] [REMOTE ] HRB: Full fetch complete (69680 records). [2025-09-17T04:17:37.547458] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-17T04:17:37.995571] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-17T04:17:37.995735] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-17T04:17:37.996936] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-17T04:17:37.997007] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-17T04:17:37.998832] [DEBUG] [LOCAL ] HRB: Trimmed 69680 records to 48619 (keeping 200 days of data) [2025-09-17T04:17:38.301783] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-17T04:17:38.329369] [DEBUG] [LOCAL ] HRB: Primary data saved (48619 records). [2025-09-17T04:17:38.329621] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-17T04:17:38.329774] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HRB took 33.6s. Estimated remaining: 3h 12m 12s. Rate: 6.9 symbols/min [2025-09-17T04:17:38.546518] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:38.592604] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T04:17:38.637501] [DEBUG] [LOCAL ] HSBC: Loaded 37817 existing records from primary storage. [2025-09-17T04:17:38.637746] [INFO ] [MAIN ] HSBC: Loaded 37817 existing records. [2025-09-17T04:17:38.830538] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:38.831681] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-17T04:17:38.831837] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-17T04:17:38.839437] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-17T04:17:38.852313] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-17T04:17:38.932611] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T04:17:39.095494] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-17T04:17:39.278559] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:39.303720] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T04:17:39.890368] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-17T04:17:40.292856] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T04:17:40.690234] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-17T04:17:41.490221] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-17T04:17:41.642407] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:17:42.233455] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:17:42.290175] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-17T04:17:42.518479] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:17:43.090236] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-17T04:17:43.368288] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T04:17:43.890183] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-17T04:17:44.166274] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:17:44.690220] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-17T04:17:45.480275] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T04:17:45.490708] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-11. [2025-09-17T04:17:46.002079] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T04:17:46.006876] [INFO ] [REMOTE ] HRI: Full fetch complete (45388 records). [2025-09-17T04:17:46.007166] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-17T04:17:46.295378] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-17T04:17:46.475158] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-17T04:17:46.475326] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-17T04:17:46.476287] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-17T04:17:46.476360] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-17T04:17:46.477885] [DEBUG] [LOCAL ] HRI: Trimmed 45388 records to 33312 (keeping 200 days of data) [2025-09-17T04:17:46.713077] [DEBUG] [LOCAL ] HRI: Primary data saved (33312 records). [2025-09-17T04:17:46.713317] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-17T04:17:46.713448] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRI took 30.9s. Estimated remaining: 3h 12m 3s. Rate: 6.9 symbols/min [2025-09-17T04:17:46.903904] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:46.917208] [DEBUG] [LOCAL ] HSHP: Loaded 10229 existing records from primary storage. [2025-09-17T04:17:46.917427] [INFO ] [MAIN ] HSHP: Loaded 10229 existing records. [2025-09-17T04:17:47.095545] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-17T04:17:47.121311] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:47.121717] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-17T04:17:47.121785] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-17T04:17:47.122269] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-17T04:17:47.122334] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-17T04:17:47.515763] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:47.545710] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T04:17:47.890163] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-11. [2025-09-17T04:17:48.260841] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T04:17:48.328495] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:17:48.690169] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-17T04:17:48.791209] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T04:17:49.490176] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-17T04:17:50.290192] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-17T04:17:50.605795] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T04:17:50.924590] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T04:17:51.090217] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-17T04:17:51.796824] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:17:51.890263] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-17T04:17:52.538878] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T04:17:52.690184] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-17T04:17:52.877512] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:17:53.490158] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-17T04:17:54.290204] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-17T04:17:54.457885] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T04:17:54.917205] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:17:55.090196] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-17T04:17:55.890206] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-17T04:17:56.078079] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T04:17:56.085167] [INFO ] [REMOTE ] HRL: Full fetch complete (76517 records). [2025-09-17T04:17:56.085397] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-17T04:17:56.510884] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-17T04:17:56.511044] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-17T04:17:56.512356] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-17T04:17:56.512443] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-17T04:17:56.514907] [DEBUG] [LOCAL ] HRL: Trimmed 76517 records to 53088 (keeping 200 days of data) [2025-09-17T04:17:56.635176] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T04:17:56.691245] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-17T04:17:56.925914] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T04:17:56.954589] [DEBUG] [LOCAL ] HRL: Primary data saved (53088 records). [2025-09-17T04:17:56.954863] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-17T04:17:56.955015] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRL took 39.5s. Estimated remaining: 3h 11m 56s. Rate: 6.9 symbols/min [2025-09-17T04:17:57.143491] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:57.186383] [DEBUG] [LOCAL ] HSY: Loaded 37663 existing records from primary storage. [2025-09-17T04:17:57.186618] [INFO ] [MAIN ] HSY: Loaded 37663 existing records. [2025-09-17T04:17:57.374428] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:57.374797] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-17T04:17:57.374865] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-17T04:17:57.376025] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-17T04:17:57.376103] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-17T04:17:57.505398] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-17T04:17:57.757116] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:57.831061] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:17:58.290177] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-11. [2025-09-17T04:17:58.862709] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T04:17:59.090225] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-17T04:17:59.890162] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-17T04:18:00.182359] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T04:18:00.690139] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-17T04:18:01.261800] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T04:18:01.296528] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:18:01.490266] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-17T04:18:02.002239] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T04:18:02.290225] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-17T04:18:03.090180] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-17T04:18:03.890236] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-17T04:18:03.957989] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-17T04:18:03.962465] [INFO ] [REMOTE ] HRTG: Full fetch complete (41306 records). [2025-09-17T04:18:03.962717] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-17T04:18:04.439318] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-17T04:18:04.439462] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-17T04:18:04.440320] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-17T04:18:04.440395] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-17T04:18:04.441806] [DEBUG] [LOCAL ] HRTG: Trimmed 41306 records to 32087 (keeping 200 days of data) [2025-09-17T04:18:04.647593] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T04:18:04.670296] [DEBUG] [LOCAL ] HRTG: Primary data saved (32087 records). [2025-09-17T04:18:04.670553] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-17T04:18:04.670723] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRTG took 29.6s. Estimated remaining: 3h 11m 46s. Rate: 6.9 symbols/min [2025-09-17T04:18:04.704921] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-17T04:18:04.852246] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:04.852553] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-17T04:18:04.852629] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-17T04:18:04.852793] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-17T04:18:04.852872] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-17T04:18:04.852928] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-17T04:18:04.852969] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-17T04:18:05.211607] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:05.490168] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-11. [2025-09-17T04:18:05.591769] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T04:18:05.881875] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T04:18:05.972985] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:18:05.973619] [WARN ] [REMOTE ] HTB: No data returned for month 2024-11 [2025-09-17T04:18:06.023828] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-17T04:18:06.290185] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-17T04:18:07.090161] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-17T04:18:07.890196] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-17T04:18:08.191818] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T04:18:08.690160] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-17T04:18:08.852540] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T04:18:08.959799] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:18:08.960370] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-17T04:18:08.997956] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:18:09.490134] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-17T04:18:09.684500] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:18:09.684972] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-17T04:18:10.290145] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-17T04:18:11.090282] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-17T04:18:11.226748] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T04:18:11.890199] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-17T04:18:12.100352] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-17T04:18:12.690142] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-17T04:18:13.038394] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T04:18:13.203152] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T04:18:13.490157] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-17T04:18:14.290415] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-17T04:18:14.398731] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:18:14.403366] [INFO ] [REMOTE ] HSHP: Full fetch complete (23273 records). [2025-09-17T04:18:14.403490] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-17T04:18:14.785038] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-17T04:18:14.785174] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-17T04:18:14.785825] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-17T04:18:14.785893] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-17T04:18:14.786694] [DEBUG] [LOCAL ] HSHP: Trimmed 23273 records to 15645 (keeping 200 days of data) [2025-09-17T04:18:14.887483] [DEBUG] [LOCAL ] HSHP: Primary data saved (15645 records). [2025-09-17T04:18:14.887708] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-17T04:18:14.887834] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HSHP took 28.2s. Estimated remaining: 3h 11m 39s. Rate: 6.9 symbols/min [2025-09-17T04:18:15.072855] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:15.086627] [DEBUG] [LOCAL ] HTD: Loaded 10000 existing records from primary storage. [2025-09-17T04:18:15.086826] [INFO ] [MAIN ] HTD: Loaded 10000 existing records. [2025-09-17T04:18:15.098372] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-17T04:18:15.280483] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:15.280854] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-17T04:18:15.280944] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-17T04:18:15.281393] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-17T04:18:15.281489] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-17T04:18:15.649618] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:15.890448] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-11. [2025-09-17T04:18:16.214664] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T04:18:16.690220] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-17T04:18:17.490178] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-17T04:18:17.644020] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-09-17T04:18:17.793793] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T04:18:18.053340] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T04:18:18.290169] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-17T04:18:19.069521] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:18:19.090136] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-17T04:18:19.346208] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T04:18:19.787365] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T04:18:19.890131] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-17T04:18:20.650616] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T04:18:20.690142] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-17T04:18:21.490155] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-17T04:18:21.599085] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:18:22.290172] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-17T04:18:23.090138] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-17T04:18:23.128623] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T04:18:23.428238] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:18:23.779889] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T04:18:23.890199] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-17T04:18:24.610836] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T04:18:24.612762] [INFO ] [REMOTE ] HTB: Full fetch complete (7011 records). [2025-09-17T04:18:24.612864] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-17T04:18:24.695309] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-17T04:18:24.804378] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 138 unique days, need 200 days [2025-09-17T04:18:24.804706] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:18:24.804826] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:18:24.804879] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-17T04:18:24.805037] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-17T04:18:24.805136] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-17T04:18:24.805262] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-17T04:18:24.805372] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HTB took 20.1s. Estimated remaining: 3h 11m 31s. Rate: 6.9 symbols/min [2025-09-17T04:18:24.986741] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:24.987055] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-17T04:18:24.987109] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-17T04:18:24.987230] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-17T04:18:24.987310] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-17T04:18:24.987362] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-17T04:18:24.987414] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-17T04:18:25.359026] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:25.490198] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-11. [2025-09-17T04:18:25.815725] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T04:18:26.290223] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-17T04:18:26.578846] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T04:18:27.090155] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-17T04:18:27.890158] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-17T04:18:28.064412] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T04:18:28.644156] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T04:18:28.690131] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-17T04:18:28.944974] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T04:18:28.951924] [INFO ] [REMOTE ] HSBC: Full fetch complete (73343 records). [2025-09-17T04:18:28.952187] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-17T04:18:29.360264] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-17T04:18:29.360424] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-17T04:18:29.361552] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-17T04:18:29.361622] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-17T04:18:29.363537] [DEBUG] [LOCAL ] HSBC: Trimmed 73343 records to 51293 (keeping 200 days of data) [2025-09-17T04:18:29.491235] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-17T04:18:29.636402] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T04:18:29.739276] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-17T04:18:29.760801] [DEBUG] [LOCAL ] HSBC: Primary data saved (51293 records). [2025-09-17T04:18:29.761051] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-17T04:18:29.761211] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSBC took 51.4s. Estimated remaining: 3h 11m 18s. Rate: 6.9 symbols/min [2025-09-17T04:18:29.952530] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:29.996945] [DEBUG] [LOCAL ] HTGC: Loaded 35199 existing records from primary storage. [2025-09-17T04:18:29.997194] [INFO ] [MAIN ] HTGC: Loaded 35199 existing records. [2025-09-17T04:18:30.271002] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:30.271317] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-17T04:18:30.271373] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-17T04:18:30.272563] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-17T04:18:30.272680] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-17T04:18:30.295404] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-17T04:18:30.656721] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:31.090180] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-11. [2025-09-17T04:18:31.890174] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-17T04:18:32.328903] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T04:18:32.348436] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T04:18:32.690171] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-17T04:18:32.750484] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:18:33.015393] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T04:18:33.490197] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-17T04:18:34.290204] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-17T04:18:34.384032] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T04:18:35.090147] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-17T04:18:35.895220] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-17T04:18:35.906831] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T04:18:35.960506] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:18:36.259430] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T04:18:36.690156] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-17T04:18:37.090410] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T04:18:37.490207] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-17T04:18:38.290158] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-17T04:18:39.090119] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-17T04:18:39.151165] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:18:39.431045] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T04:18:39.890160] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-17T04:18:40.057205] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T04:18:40.690138] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-17T04:18:41.479712] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T04:18:41.491354] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-17T04:18:41.720812] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-17T04:18:42.225572] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:18:42.290143] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-17T04:18:43.090148] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-17T04:18:43.376358] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-17T04:18:43.890160] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-17T04:18:44.000067] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:18:44.690229] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-17T04:18:44.787825] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T04:18:45.490165] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-17T04:18:45.725268] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-17T04:18:46.158618] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:18:46.290137] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-17T04:18:47.090156] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-17T04:18:47.890197] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-17T04:18:47.995633] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:18:48.690193] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-17T04:18:48.913969] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T04:18:48.929894] [INFO ] [REMOTE ] HSY: Full fetch complete (73782 records). [2025-09-17T04:18:48.930547] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-17T04:18:48.931069] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:18:49.328978] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-17T04:18:49.329096] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-17T04:18:49.330267] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-17T04:18:49.330336] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-17T04:18:49.331980] [DEBUG] [LOCAL ] HSY: Trimmed 73782 records to 50531 (keeping 200 days of data) [2025-09-17T04:18:49.526922] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-17T04:18:49.671404] [DEBUG] [LOCAL ] HSY: Primary data saved (50531 records). [2025-09-17T04:18:49.671605] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-17T04:18:49.671748] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HSY took 52.7s. Estimated remaining: 3h 11m 23s. Rate: 6.8 symbols/min [2025-09-17T04:18:49.843758] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:49.868007] [DEBUG] [LOCAL ] HTH: Loaded 25177 existing records from primary storage. [2025-09-17T04:18:49.868188] [INFO ] [MAIN ] HTH: Loaded 25177 existing records. [2025-09-17T04:18:50.050247] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:50.050515] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-17T04:18:50.050576] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-17T04:18:50.051359] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-17T04:18:50.051430] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-17T04:18:50.293790] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-17T04:18:50.422243] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:50.434287] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T04:18:50.475015] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T04:18:50.710276] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T04:18:50.711291] [INFO ] [REMOTE ] HTFC: Full fetch complete (839 records). [2025-09-17T04:18:50.711386] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-17T04:18:50.903156] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-17T04:18:50.903400] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:18:50.903458] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:18:50.903510] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-17T04:18:50.903665] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-17T04:18:50.903729] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-17T04:18:50.903802] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-17T04:18:50.903891] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTFC took 26.1s. Estimated remaining: 3h 11m 5s. Rate: 6.9 symbols/min [2025-09-17T04:18:51.085184] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:51.090119] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-11. [2025-09-17T04:18:51.124239] [DEBUG] [LOCAL ] HUBB: Loaded 26937 existing records from primary storage. [2025-09-17T04:18:51.124536] [INFO ] [MAIN ] HUBB: Loaded 26937 existing records. [2025-09-17T04:18:51.309342] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:51.309690] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-17T04:18:51.309761] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-17T04:18:51.310781] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-17T04:18:51.310849] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-17T04:18:51.700578] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:51.890173] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-11. [2025-09-17T04:18:52.173171] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:18:52.690261] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-17T04:18:53.320008] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:18:53.490247] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-17T04:18:54.274109] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T04:18:54.290096] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-17T04:18:54.849444] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:18:55.090236] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-17T04:18:55.890201] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-17T04:18:55.978917] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T04:18:56.178162] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T04:18:56.690245] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-17T04:18:56.824105] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T04:18:56.826406] [INFO ] [REMOTE ] HTD: Full fetch complete (18795 records). [2025-09-17T04:18:56.826498] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-17T04:18:57.263222] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-17T04:18:57.263401] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-17T04:18:57.264341] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-17T04:18:57.264449] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-17T04:18:57.265810] [DEBUG] [LOCAL ] HTD: Trimmed 18795 records to 13409 (keeping 200 days of data) [2025-09-17T04:18:57.374444] [DEBUG] [LOCAL ] HTD: Primary data saved (13409 records). [2025-09-17T04:18:57.374858] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-17T04:18:57.375005] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTD took 42.5s. Estimated remaining: 3h 10m 53s. Rate: 6.9 symbols/min [2025-09-17T04:18:57.494457] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-17T04:18:57.575374] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:57.617793] [DEBUG] [LOCAL ] HUBS: Loaded 29255 existing records from primary storage. [2025-09-17T04:18:57.618032] [INFO ] [MAIN ] HUBS: Loaded 29255 existing records. [2025-09-17T04:18:57.807020] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:57.807514] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-17T04:18:57.807614] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-17T04:18:57.813578] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-17T04:18:57.823981] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-17T04:18:57.824802] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T04:18:58.212623] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:58.290242] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-11. [2025-09-17T04:18:59.039324] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:18:59.090191] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-17T04:18:59.838462] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T04:18:59.890150] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-17T04:19:00.476539] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:19:00.690176] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-17T04:19:01.435438] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T04:19:01.490216] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-17T04:19:02.245376] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T04:19:02.290192] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-17T04:19:02.652996] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T04:19:03.090230] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-17T04:19:03.831253] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:19:03.890174] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-17T04:19:04.702732] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-17T04:19:04.709518] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:19:05.217774] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:19:05.490244] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-17T04:19:06.243847] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T04:19:06.290201] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-17T04:19:06.861976] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T04:19:07.090198] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-17T04:19:07.769445] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T04:19:07.890173] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-17T04:19:08.690192] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-17T04:19:08.745463] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:19:08.984746] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T04:19:09.490232] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-17T04:19:10.074396] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:19:10.290221] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-17T04:19:10.835208] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T04:19:11.090158] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-17T04:19:11.468019] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:19:11.474807] [INFO ] [REMOTE ] HTGC: Full fetch complete (68013 records). [2025-09-17T04:19:11.475045] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-17T04:19:11.896443] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-17T04:19:11.897503] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-17T04:19:11.898775] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-17T04:19:11.900092] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-17T04:19:11.900183] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-17T04:19:11.902499] [DEBUG] [LOCAL ] HTGC: Trimmed 68013 records to 47771 (keeping 200 days of data) [2025-09-17T04:19:12.221315] [DEBUG] [LOCAL ] HTGC: Primary data saved (47771 records). [2025-09-17T04:19:12.221539] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-17T04:19:12.221673] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTGC took 42.5s. Estimated remaining: 3h 10m 52s. Rate: 6.8 symbols/min [2025-09-17T04:19:12.400207] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:12.472507] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T04:19:12.484099] [DEBUG] [LOCAL ] HUM: Loaded 36539 existing records from primary storage. [2025-09-17T04:19:12.485129] [INFO ] [MAIN ] HUM: Loaded 36539 existing records. [2025-09-17T04:19:12.694156] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-17T04:19:12.699532] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:12.700679] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-17T04:19:12.700759] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-17T04:19:12.701766] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-17T04:19:12.701834] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-17T04:19:13.083444] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:13.490180] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-11. [2025-09-17T04:19:13.520875] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:19:13.733818] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:19:14.290207] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-17T04:19:15.090184] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-17T04:19:15.264814] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T04:19:15.344032] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T04:19:15.890168] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-17T04:19:16.259921] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:19:16.690167] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-17T04:19:17.179265] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T04:19:17.490196] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-17T04:19:18.135340] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:19:18.290179] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-17T04:19:19.090235] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-17T04:19:19.176007] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T04:19:19.249836] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T04:19:19.890223] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-17T04:19:20.690180] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-17T04:19:20.898694] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T04:19:21.260912] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T04:19:21.269268] [INFO ] [REMOTE ] HUBB: Full fetch complete (53277 records). [2025-09-17T04:19:21.269451] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-17T04:19:21.499104] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-17T04:19:21.680297] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-17T04:19:21.680442] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-17T04:19:21.681438] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-17T04:19:21.681530] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-17T04:19:21.683100] [DEBUG] [LOCAL ] HUBB: Trimmed 53277 records to 37695 (keeping 200 days of data) [2025-09-17T04:19:21.977325] [DEBUG] [LOCAL ] HUBB: Primary data saved (37695 records). [2025-09-17T04:19:21.977578] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-17T04:19:21.977736] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HUBB took 31.1s. Estimated remaining: 3h 10m 45s. Rate: 6.8 symbols/min [2025-09-17T04:19:22.165901] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:22.222908] [DEBUG] [LOCAL ] HUN: Loaded 39628 existing records from primary storage. [2025-09-17T04:19:22.223180] [INFO ] [MAIN ] HUN: Loaded 39628 existing records. [2025-09-17T04:19:22.290781] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-17T04:19:22.450889] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:22.454018] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T04:19:22.451877] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-17T04:19:22.463250] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-17T04:19:22.464758] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-17T04:19:22.464838] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-17T04:19:22.826255] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:23.089911] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T04:19:23.090105] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-11. [2025-09-17T04:19:23.890167] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-17T04:19:23.937278] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:19:23.942597] [INFO ] [REMOTE ] HUBS: Full fetch complete (55167 records). [2025-09-17T04:19:23.942796] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-17T04:19:24.347227] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-17T04:19:24.347360] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-17T04:19:24.348264] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-17T04:19:24.348339] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-17T04:19:24.349887] [DEBUG] [LOCAL ] HUBS: Trimmed 55167 records to 39811 (keeping 200 days of data) [2025-09-17T04:19:24.615615] [DEBUG] [LOCAL ] HUBS: Primary data saved (39811 records). [2025-09-17T04:19:24.616014] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-17T04:19:24.616175] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HUBS took 27.2s. Estimated remaining: 3h 10m 28s. Rate: 6.9 symbols/min [2025-09-17T04:19:24.701729] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-17T04:19:24.802396] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:24.839681] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:19:24.878592] [DEBUG] [LOCAL ] HUYA: Loaded 32344 existing records from primary storage. [2025-09-17T04:19:24.878837] [INFO ] [MAIN ] HUYA: Loaded 32344 existing records. [2025-09-17T04:19:25.126306] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:25.126671] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-17T04:19:25.126740] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-17T04:19:25.127862] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-17T04:19:25.127932] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-17T04:19:25.449854] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:19:25.485189] [INFO ] [REMOTE ] HTH: Full fetch complete (46219 records). [2025-09-17T04:19:25.505712] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-17T04:19:25.545715] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:25.545815] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-17T04:19:25.991635] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-17T04:19:25.991804] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-17T04:19:25.992969] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-17T04:19:25.993058] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-17T04:19:25.994729] [DEBUG] [LOCAL ] HTH: Trimmed 46219 records to 32999 (keeping 200 days of data) [2025-09-17T04:19:26.212978] [DEBUG] [LOCAL ] HTH: Primary data saved (32999 records). [2025-09-17T04:19:26.213199] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-17T04:19:26.213372] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HTH took 36.5s. Estimated remaining: 3h 10m 11s. Rate: 6.9 symbols/min [2025-09-17T04:19:26.295292] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-11. [2025-09-17T04:19:26.407924] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:26.424576] [DEBUG] [LOCAL ] HVT: Loaded 11049 existing records from primary storage. [2025-09-17T04:19:26.424890] [INFO ] [MAIN ] HVT: Loaded 11049 existing records. [2025-09-17T04:19:26.635914] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:26.636320] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-17T04:19:26.636407] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-17T04:19:26.637062] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-17T04:19:26.637145] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-17T04:19:26.793251] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T04:19:27.070421] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:27.090089] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-11. [2025-09-17T04:19:27.250983] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T04:19:27.890207] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-17T04:19:27.995351] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T04:19:28.186551] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:19:28.690222] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-17T04:19:29.177160] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T04:19:29.490161] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-17T04:19:30.295296] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-17T04:19:30.314156] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:19:30.755600] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T04:19:31.090184] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-17T04:19:31.795246] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T04:19:31.890164] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-17T04:19:32.690182] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-17T04:19:32.833499] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T04:19:33.491755] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-17T04:19:33.495532] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T04:19:34.290181] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-17T04:19:34.547042] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T04:19:35.055444] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:19:35.080188] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T04:19:35.090076] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-17T04:19:35.861371] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T04:19:35.890164] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-17T04:19:36.690157] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-17T04:19:37.358325] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T04:19:37.490178] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-17T04:19:38.290163] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-17T04:19:38.337316] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:19:39.100946] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-17T04:19:39.107800] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:19:39.890145] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-17T04:19:39.964610] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:19:40.008613] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:19:40.690148] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-17T04:19:41.490123] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-17T04:19:41.609513] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T04:19:42.290165] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-17T04:19:42.398491] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:19:43.090192] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-17T04:19:43.139659] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:19:43.197461] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T04:19:43.890187] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-17T04:19:44.690186] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-17T04:19:44.967768] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T04:19:45.053537] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T04:19:45.490196] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-17T04:19:45.973687] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T04:19:46.290262] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-17T04:19:46.358043] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:19:47.090175] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-17T04:19:47.890170] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-17T04:19:48.057698] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T04:19:48.093284] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:19:48.690178] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-17T04:19:49.299999] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:19:49.490207] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-17T04:19:49.619210] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T04:19:50.290211] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-17T04:19:50.980313] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:19:51.090182] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-17T04:19:51.240266] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T04:19:51.890193] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-17T04:19:52.695264] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-17T04:19:52.709337] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:19:52.716960] [INFO ] [REMOTE ] HUN: Full fetch complete (76310 records). [2025-09-17T04:19:52.717165] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-17T04:19:53.152413] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-17T04:19:53.152554] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-17T04:19:53.154096] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-17T04:19:53.154189] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-17T04:19:53.156345] [DEBUG] [LOCAL ] HUN: Trimmed 76310 records to 53188 (keeping 200 days of data) [2025-09-17T04:19:53.502100] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-17T04:19:53.534264] [DEBUG] [LOCAL ] HUN: Primary data saved (53188 records). [2025-09-17T04:19:53.534725] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-17T04:19:53.535070] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUN took 31.6s. Estimated remaining: 3h 10m 25s. Rate: 6.8 symbols/min [2025-09-17T04:19:53.603444] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T04:19:53.681968] [INFO ] [REMOTE ] HUM: Full fetch complete (70750 records). [2025-09-17T04:19:53.682283] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-17T04:19:53.767634] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:53.821992] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T04:19:53.863707] [INFO ] [REMOTE ] HVT: Full fetch complete (23875 records). [2025-09-17T04:19:53.888679] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-17T04:19:54.271168] [DEBUG] [LOCAL ] HWM: Loaded 39509 existing records from primary storage. [2025-09-17T04:19:54.302380] [INFO ] [MAIN ] HWM: Loaded 39509 existing records. [2025-09-17T04:19:54.685240] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-17T04:19:54.711596] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-17T04:19:54.718252] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-17T04:19:54.753857] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-17T04:19:54.832778] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:54.861565] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-17T04:19:54.861671] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-17T04:19:54.862149] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-17T04:19:54.862327] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-17T04:19:54.862860] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-17T04:19:54.865138] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-17T04:19:54.865503] [DEBUG] [LOCAL ] HUM: Trimmed 70750 records to 48832 (keeping 200 days of data) [2025-09-17T04:19:54.866377] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-17T04:19:54.866942] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-17T04:19:54.872690] [DEBUG] [LOCAL ] HVT: Trimmed 23875 records to 16336 (keeping 200 days of data) [2025-09-17T04:19:55.421662] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T04:19:55.489296] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-17T04:19:55.531214] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:55.532957] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-11. [2025-09-17T04:19:55.562588] [DEBUG] [LOCAL ] HVT: Primary data saved (16336 records). [2025-09-17T04:19:55.563558] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-17T04:19:55.564269] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HVT took 29.4s. Estimated remaining: 3h 10m 8s. Rate: 6.8 symbols/min [2025-09-17T04:19:55.904016] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:55.953829] [DEBUG] [LOCAL ] HXL: Loaded 34210 existing records from primary storage. [2025-09-17T04:19:55.960503] [INFO ] [MAIN ] HXL: Loaded 34210 existing records. [2025-09-17T04:19:56.222927] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:56.225215] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-17T04:19:56.243352] [DEBUG] [LOCAL ] HUM: Primary data saved (48832 records). [2025-09-17T04:19:56.243224] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-17T04:19:56.243943] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-17T04:19:56.244394] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUM took 44.0s. Estimated remaining: 3h 9m 49s. Rate: 6.9 symbols/min [2025-09-17T04:19:56.250407] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-17T04:19:56.303133] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-17T04:19:56.744922] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:56.926953] [DEBUG] [LOCAL ] HY: Loaded 7194 existing records from primary storage. [2025-09-17T04:19:56.963785] [INFO ] [MAIN ] HY: Loaded 7194 existing records. [2025-09-17T04:19:57.265767] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:57.327203] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-11. [2025-09-17T04:19:57.335733] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:57.337235] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-17T04:19:57.337355] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-17T04:19:57.338102] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-17T04:19:57.338521] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-17T04:19:57.660628] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T04:19:57.734541] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-17T04:19:57.762192] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:57.763364] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-11. [2025-09-17T04:19:57.799516] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-11 (2.27 seconds). [2025-09-17T04:19:58.290121] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-17T04:19:58.601477] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T04:19:58.934332] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T04:19:59.020691] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:19:59.090163] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-17T04:19:59.890119] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-17T04:19:59.992166] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T04:20:00.690220] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-17T04:20:00.713635] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:20:00.719850] [INFO ] [REMOTE ] HUYA: Full fetch complete (63678 records). [2025-09-17T04:20:00.720036] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-17T04:20:00.926734] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:20:01.150889] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-17T04:20:01.151055] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-17T04:20:01.152132] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-17T04:20:01.152230] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-17T04:20:01.154070] [DEBUG] [LOCAL ] HUYA: Trimmed 63678 records to 44349 (keeping 200 days of data) [2025-09-17T04:20:01.442129] [DEBUG] [LOCAL ] HUYA: Primary data saved (44349 records). [2025-09-17T04:20:01.442333] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-17T04:20:01.442453] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HUYA took 36.8s. Estimated remaining: 3h 9m 36s. Rate: 6.9 symbols/min [2025-09-17T04:20:01.495294] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-17T04:20:01.640362] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:01.640658] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-17T04:20:01.640714] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-17T04:20:01.640841] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-17T04:20:01.640898] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-17T04:20:01.640954] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-17T04:20:01.641000] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-17T04:20:02.047752] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:02.290245] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-11. [2025-09-17T04:20:02.447576] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T04:20:02.609810] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T04:20:02.699764] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T04:20:03.090157] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-17T04:20:03.890215] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-17T04:20:03.925768] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T04:20:04.690244] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-17T04:20:05.490181] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-17T04:20:05.602280] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T04:20:05.850260] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T04:20:06.290215] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-17T04:20:06.930410] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T04:20:06.934348] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T04:20:07.090211] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-17T04:20:07.890202] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-17T04:20:08.050207] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:20:08.207920] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T04:20:08.690214] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-17T04:20:09.490196] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-17T04:20:09.818607] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T04:20:10.290178] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-17T04:20:10.509713] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-17T04:20:10.720859] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T04:20:11.090162] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-17T04:20:11.890261] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-17T04:20:12.244356] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T04:20:12.690173] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-17T04:20:13.027452] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T04:20:13.171914] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T04:20:13.490154] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-17T04:20:14.292774] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-17T04:20:14.293882] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T04:20:15.090171] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-17T04:20:15.658226] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:20:15.827691] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T04:20:15.890174] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-17T04:20:16.690184] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-17T04:20:17.363050] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T04:20:17.490146] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-17T04:20:17.794583] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T04:20:18.290200] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-17T04:20:18.749861] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:20:18.768488] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T04:20:19.090195] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-17T04:20:19.890202] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-17T04:20:20.690211] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-17T04:20:20.951022] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-17T04:20:20.954664] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T04:20:21.495284] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-17T04:20:21.521541] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:20:22.290204] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-17T04:20:23.090211] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-17T04:20:23.394120] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T04:20:23.395522] [INFO ] [REMOTE ] HYAC: Full fetch complete (875 records). [2025-09-17T04:20:23.395630] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-17T04:20:23.396351] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T04:20:23.396436] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:20:23.396484] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:20:23.396530] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-17T04:20:23.396618] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-17T04:20:23.396715] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-17T04:20:23.396780] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-17T04:20:23.396859] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HYAC took 22.0s. Estimated remaining: 3h 9m 43s. Rate: 6.8 symbols/min [2025-09-17T04:20:23.582971] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:23.583532] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-17T04:20:23.583776] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-17T04:20:23.584028] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-17T04:20:23.584121] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-17T04:20:23.584378] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-17T04:20:23.584447] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-17T04:20:23.752584] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T04:20:23.895763] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-17T04:20:24.061280] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:24.094460] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:20:24.690153] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-17T04:20:24.741877] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:20:25.490156] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-17T04:20:26.290093] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-17T04:20:26.330253] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T04:20:26.371767] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T04:20:27.090178] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-17T04:20:27.890153] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-11. [2025-09-17T04:20:27.984531] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T04:20:27.986827] [INFO ] [REMOTE ] HY: Full fetch complete (15150 records). [2025-09-17T04:20:27.986947] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-17T04:20:28.164024] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-11 (0.27 seconds). [2025-09-17T04:20:28.355932] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-17T04:20:28.356077] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-17T04:20:28.356678] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-17T04:20:28.356794] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-17T04:20:28.357513] [DEBUG] [LOCAL ] HY: Trimmed 15150 records to 10442 (keeping 200 days of data) [2025-09-17T04:20:28.450780] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-17T04:20:28.468917] [DEBUG] [LOCAL ] HY: Primary data saved (10442 records). [2025-09-17T04:20:28.469109] [INFO ] [MAIN ] HY: Full history saved. [2025-09-17T04:20:28.469252] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HY took 32.2s. Estimated remaining: 3h 9m 30s. Rate: 6.8 symbols/min [2025-09-17T04:20:28.644732] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:28.654431] [DEBUG] [LOCAL ] HYI: Loaded 6467 existing records from primary storage. [2025-09-17T04:20:28.654677] [INFO ] [MAIN ] HYI: Loaded 6467 existing records. [2025-09-17T04:20:28.695343] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-17T04:20:28.851908] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:28.852332] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-17T04:20:28.852428] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-17T04:20:28.852970] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-17T04:20:28.853062] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-17T04:20:29.232414] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:29.490184] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-11. [2025-09-17T04:20:30.138241] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:20:30.276301] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T04:20:30.290171] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-17T04:20:31.083437] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T04:20:31.090075] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-17T04:20:31.883118] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T04:20:31.890079] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-17T04:20:32.615734] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T04:20:32.690205] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-17T04:20:33.490156] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-17T04:20:33.508516] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T04:20:34.290174] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-17T04:20:34.622045] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T04:20:35.090154] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-17T04:20:35.144843] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T04:20:35.890152] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-17T04:20:35.922570] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T04:20:36.222736] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T04:20:36.690156] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-17T04:20:36.913766] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-17T04:20:37.490199] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-17T04:20:37.725089] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-17T04:20:38.290149] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-17T04:20:39.090196] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-17T04:20:39.403783] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T04:20:39.890199] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-17T04:20:40.090137] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:20:40.100396] [INFO ] [REMOTE ] HWM: Full fetch complete (76528 records). [2025-09-17T04:20:40.100887] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-17T04:20:40.520239] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-17T04:20:40.520419] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-17T04:20:40.521737] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-17T04:20:40.521851] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-17T04:20:40.523924] [DEBUG] [LOCAL ] HWM: Trimmed 76528 records to 53037 (keeping 200 days of data) [2025-09-17T04:20:40.724662] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-17T04:20:40.885157] [DEBUG] [LOCAL ] HWM: Primary data saved (53037 records). [2025-09-17T04:20:40.885381] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-17T04:20:40.885525] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HWM took 47.4s. Estimated remaining: 3h 9m 26s. Rate: 6.8 symbols/min [2025-09-17T04:20:41.041188] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T04:20:41.068687] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:41.094343] [DEBUG] [LOCAL ] HYT: Loaded 24402 existing records from primary storage. [2025-09-17T04:20:41.094545] [INFO ] [MAIN ] HYT: Loaded 24402 existing records. [2025-09-17T04:20:41.277592] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:41.278013] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-17T04:20:41.278083] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-17T04:20:41.278968] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-17T04:20:41.279036] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-17T04:20:41.496462] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-17T04:20:41.629210] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:20:41.676329] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:41.904625] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T04:20:42.290164] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-17T04:20:43.015438] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T04:20:43.090100] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-17T04:20:43.584522] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T04:20:43.890197] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-17T04:20:44.494008] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T04:20:44.690154] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-17T04:20:45.458367] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:20:45.490102] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-17T04:20:46.141241] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T04:20:46.142564] [INFO ] [REMOTE ] HYI: Full fetch complete (13103 records). [2025-09-17T04:20:46.142681] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-17T04:20:46.295256] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-11. [2025-09-17T04:20:46.532564] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-17T04:20:46.532766] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-17T04:20:46.533387] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-17T04:20:46.533444] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-17T04:20:46.534574] [DEBUG] [LOCAL ] HYI: Trimmed 13103 records to 8940 (keeping 200 days of data) [2025-09-17T04:20:46.593977] [DEBUG] [LOCAL ] HYI: Primary data saved (8940 records). [2025-09-17T04:20:46.594181] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-17T04:20:46.594362] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYI took 18.1s. Estimated remaining: 3h 9m 13s. Rate: 6.8 symbols/min [2025-09-17T04:20:46.763483] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:46.768942] [DEBUG] [LOCAL ] HYTR: Loaded 2235 existing records from primary storage. [2025-09-17T04:20:46.769074] [INFO ] [MAIN ] HYTR: Loaded 2235 existing records. [2025-09-17T04:20:46.944803] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:46.945102] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-17T04:20:46.945170] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-17T04:20:46.945469] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-17T04:20:46.945535] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-17T04:20:47.095396] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-17T04:20:47.307468] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:47.478247] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T04:20:47.586618] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:20:47.890204] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-17T04:20:48.690279] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-17T04:20:49.211371] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T04:20:49.219837] [INFO ] [REMOTE ] HXL: Full fetch complete (66095 records). [2025-09-17T04:20:49.220094] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-17T04:20:49.499511] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-17T04:20:49.627781] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-17T04:20:49.627924] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-17T04:20:49.629026] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-17T04:20:49.629104] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-17T04:20:49.630884] [DEBUG] [LOCAL ] HXL: Trimmed 66095 records to 46295 (keeping 200 days of data) [2025-09-17T04:20:49.913614] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T04:20:49.940550] [DEBUG] [LOCAL ] HXL: Primary data saved (46295 records). [2025-09-17T04:20:49.940869] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-17T04:20:49.941123] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HXL took 54.4s. Estimated remaining: 3h 8m 58s. Rate: 6.9 symbols/min [2025-09-17T04:20:50.144972] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:50.149562] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:20:50.178042] [DEBUG] [LOCAL ] HZO: Loaded 20719 existing records from primary storage. [2025-09-17T04:20:50.178277] [INFO ] [MAIN ] HZO: Loaded 20719 existing records. [2025-09-17T04:20:50.290478] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-11. [2025-09-17T04:20:50.410263] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:50.410637] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-17T04:20:50.410765] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-17T04:20:50.411498] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-17T04:20:50.411595] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-17T04:20:50.784361] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T04:20:51.007822] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:51.090244] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-17T04:20:51.890215] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-17T04:20:52.307725] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T04:20:52.434107] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:20:52.690190] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-11. [2025-09-17T04:20:53.490195] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-17T04:20:53.772396] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:20:53.804416] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T04:20:53.805317] [INFO ] [REMOTE ] HYBX: Full fetch complete (833 records). [2025-09-17T04:20:53.805426] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-17T04:20:54.005377] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-17T04:20:54.005622] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:20:54.005718] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:20:54.005768] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-17T04:20:54.005847] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-17T04:20:54.005906] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-17T04:20:54.005994] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-17T04:20:54.006093] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYBX took 30.6s. Estimated remaining: 3h 8m 44s. Rate: 6.9 symbols/min [2025-09-17T04:20:54.189600] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:54.198112] [DEBUG] [LOCAL ] IAE: Loaded 4267 existing records from primary storage. [2025-09-17T04:20:54.198280] [INFO ] [MAIN ] IAE: Loaded 4267 existing records. [2025-09-17T04:20:54.295221] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-17T04:20:54.390393] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:54.390780] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-17T04:20:54.390861] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-17T04:20:54.391223] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-17T04:20:54.391295] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-17T04:20:54.762713] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:54.852152] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T04:20:55.090158] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-17T04:20:55.621188] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T04:20:55.890160] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-11. [2025-09-17T04:20:56.578838] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T04:20:56.690155] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-17T04:20:57.251194] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T04:20:57.490167] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-17T04:20:58.114460] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T04:20:58.290196] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-17T04:20:58.702582] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T04:20:59.090154] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-17T04:20:59.890213] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-17T04:21:00.136753] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T04:21:00.690204] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-17T04:21:01.269083] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:21:01.387997] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T04:21:01.490133] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-17T04:21:02.290176] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-17T04:21:03.090177] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-17T04:21:03.890196] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-17T04:21:04.091802] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-17T04:21:04.655008] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T04:21:04.690166] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-17T04:21:04.906712] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-17T04:21:05.135137] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T04:21:05.490161] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-17T04:21:05.790853] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T04:21:06.112184] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T04:21:06.290215] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-17T04:21:07.090137] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-17T04:21:07.628465] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T04:21:07.890181] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-17T04:21:08.351116] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:21:08.626350] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:21:08.690179] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-17T04:21:09.490164] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-17T04:21:10.178775] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:21:10.290154] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-17T04:21:10.890486] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:21:11.090143] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-17T04:21:11.576759] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:21:11.890163] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-17T04:21:12.003185] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T04:21:12.353815] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T04:21:12.690148] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-17T04:21:13.490270] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-17T04:21:13.975024] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T04:21:13.977783] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:21:13.977934] [INFO ] [REMOTE ] HYTR: Full fetch complete (4329 records). [2025-09-17T04:21:13.978262] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-17T04:21:14.295302] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-17T04:21:14.371620] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-17T04:21:14.372085] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-17T04:21:14.372350] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-17T04:21:14.372428] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-17T04:21:14.372913] [DEBUG] [LOCAL ] HYTR: Trimmed 4329 records to 3222 (keeping 200 days of data) [2025-09-17T04:21:14.399126] [DEBUG] [LOCAL ] HYTR: Primary data saved (3222 records). [2025-09-17T04:21:14.399442] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-17T04:21:14.399634] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYTR took 27.8s. Estimated remaining: 3h 8m 49s. Rate: 6.8 symbols/min [2025-09-17T04:21:14.574794] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:14.618597] [DEBUG] [LOCAL ] IAG: Loaded 39848 existing records from primary storage. [2025-09-17T04:21:14.618849] [INFO ] [MAIN ] IAG: Loaded 39848 existing records. [2025-09-17T04:21:14.808506] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:14.808795] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-17T04:21:14.808866] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-17T04:21:14.809744] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-17T04:21:14.809808] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-17T04:21:15.095184] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-17T04:21:15.103580] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T04:21:15.234869] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:15.890141] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-17T04:21:16.690108] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-17T04:21:17.093065] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T04:21:17.121765] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:21:17.490153] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-17T04:21:18.121923] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:21:18.290135] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-17T04:21:18.829152] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:21:19.090142] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-11. [2025-09-17T04:21:19.710471] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:21:19.890152] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-17T04:21:20.497010] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T04:21:20.690149] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-17T04:21:20.772347] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:21:21.490103] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-17T04:21:21.506944] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T04:21:21.510455] [INFO ] [REMOTE ] HZO: Full fetch complete (40204 records). [2025-09-17T04:21:21.510628] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-17T04:21:21.900798] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-17T04:21:21.900934] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-17T04:21:21.901767] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-17T04:21:21.901841] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-17T04:21:21.902970] [DEBUG] [LOCAL ] HZO: Trimmed 40204 records to 29369 (keeping 200 days of data) [2025-09-17T04:21:22.083243] [DEBUG] [LOCAL ] HZO: Primary data saved (29369 records). [2025-09-17T04:21:22.083430] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-17T04:21:22.083536] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HZO took 32.1s. Estimated remaining: 3h 8m 39s. Rate: 6.8 symbols/min [2025-09-17T04:21:22.290139] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-17T04:21:23.090154] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-17T04:21:23.260294] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:21:23.701910] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T04:21:23.712913] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T04:21:23.714038] [INFO ] [REMOTE ] HYT: Full fetch complete (46782 records). [2025-09-17T04:21:23.716697] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-17T04:21:23.892684] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-17T04:21:24.134497] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-17T04:21:24.134633] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-17T04:21:24.135798] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-17T04:21:24.135881] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-17T04:21:24.137319] [DEBUG] [LOCAL ] HYT: Trimmed 46782 records to 33193 (keeping 200 days of data) [2025-09-17T04:21:24.360249] [DEBUG] [LOCAL ] HYT: Primary data saved (33193 records). [2025-09-17T04:21:24.360453] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-17T04:21:24.360571] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. HYT took 43.5s. Estimated remaining: 3h 8m 22s. Rate: 6.9 symbols/min [2025-09-17T04:21:24.690182] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-17T04:21:24.726587] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T04:21:25.490165] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-17T04:21:26.086510] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T04:21:26.290145] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-17T04:21:26.446986] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T04:21:26.964958] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T04:21:26.966664] [INFO ] [REMOTE ] IAE: Full fetch complete (8333 records). [2025-09-17T04:21:26.966755] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-17T04:21:27.095266] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-17T04:21:27.332300] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-17T04:21:27.332415] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-17T04:21:27.332687] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-17T04:21:27.332738] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-17T04:21:27.333353] [DEBUG] [LOCAL ] IAE: Trimmed 8333 records to 5736 (keeping 200 days of data) [2025-09-17T04:21:27.369258] [DEBUG] [LOCAL ] IAE: Primary data saved (5736 records). [2025-09-17T04:21:27.369388] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-17T04:21:27.369492] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. IAE took 33.4s. Estimated remaining: 3h 8m 7s. Rate: 6.9 symbols/min [2025-09-17T04:21:29.086112] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T04:21:29.098499] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-17T04:21:30.959468] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T04:21:30.974218] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-17T04:21:33.001032] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T04:21:33.013027] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-17T04:21:34.851140] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T04:21:34.862577] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-17T04:21:36.451057] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T04:21:36.462706] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-17T04:21:38.306837] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T04:21:38.318937] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-17T04:21:40.177075] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T04:21:40.190275] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-17T04:21:42.111698] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T04:21:42.118468] [INFO ] [REMOTE ] IAG: Full fetch complete (77021 records). [2025-09-17T04:21:42.118670] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-17T04:21:42.513716] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-17T04:21:42.513838] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-17T04:21:42.514904] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-17T04:21:42.514972] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-17T04:21:42.516611] [DEBUG] [LOCAL ] IAG: Trimmed 77021 records to 53432 (keeping 200 days of data) [2025-09-17T04:21:42.840123] [DEBUG] [LOCAL ] IAG: Primary data saved (53432 records). [2025-09-17T04:21:42.840352] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-17T04:21:42.840506] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 28.4s. Estimated remaining: 3h 8m 6s. Rate: 6.9 symbols/min [2025-09-17T04:21:43.521162] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.636868] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.633201] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.639749] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.718630] [DEBUG] [LOCAL ] IBTA: Loaded 26290 existing records from primary storage. [2025-09-17T04:21:43.727934] [INFO ] [MAIN ] IBTA: Loaded 26290 existing records. [2025-09-17T04:21:43.767579] [DEBUG] [LOCAL ] IBP: Loaded 21669 existing records from primary storage. [2025-09-17T04:21:43.795865] [INFO ] [MAIN ] IBP: Loaded 21669 existing records. [2025-09-17T04:21:43.898869] [DEBUG] [LOCAL ] IBN: Loaded 39380 existing records from primary storage. [2025-09-17T04:21:43.970943] [DEBUG] [LOCAL ] IBM: Loaded 40001 existing records from primary storage. [2025-09-17T04:21:43.971140] [INFO ] [MAIN ] IBN: Loaded 39380 existing records. [2025-09-17T04:21:44.009673] [INFO ] [MAIN ] IBM: Loaded 40001 existing records. [2025-09-17T04:21:44.630809] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.741193] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.780831] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.817063] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-17T04:21:44.827629] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.868756] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.895150] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.895381] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-17T04:21:44.895226] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-17T04:21:44.895597] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-17T04:21:44.895881] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-17T04:21:44.895341] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.916141] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-17T04:21:44.925154] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.935658] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-17T04:21:44.906699] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-17T04:21:44.935596] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-17T04:21:44.983944] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-17T04:21:45.047654] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-17T04:21:45.143721] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-17T04:21:46.207078] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.283438] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.305057] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-11. [2025-09-17T04:21:46.356750] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.347836] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-11. [2025-09-17T04:21:46.367681] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-11. [2025-09-17T04:21:46.451822] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.452225] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-11. [2025-09-17T04:21:47.618138] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:21:47.624890] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-17T04:21:47.642335] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:21:47.648215] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-17T04:21:48.060960] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T04:21:48.071490] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-17T04:21:48.467836] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T04:21:48.478511] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-17T04:21:48.531688] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T04:21:48.538256] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-17T04:21:48.574241] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T04:21:48.581694] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-17T04:21:49.616455] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:21:49.622560] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-17T04:21:49.689726] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:21:49.696185] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-17T04:21:49.854490] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:21:49.865515] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-17T04:21:50.349741] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T04:21:50.361060] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-17T04:21:50.505287] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T04:21:50.510879] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-17T04:21:51.024524] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T04:21:51.032026] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-17T04:21:51.633280] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T04:21:51.645759] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-17T04:21:51.842486] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T04:21:51.853434] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-17T04:21:52.151196] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T04:21:52.162576] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-17T04:21:52.369474] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T04:21:52.377036] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-17T04:21:53.099968] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T04:21:53.111854] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-17T04:21:53.178466] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T04:21:53.189157] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-17T04:21:53.289523] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T04:21:53.296737] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-17T04:21:54.059065] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T04:21:54.070973] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-17T04:21:54.106692] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T04:21:54.114994] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-17T04:21:54.611293] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:21:54.619441] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-17T04:21:54.928101] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:21:54.939954] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-17T04:21:55.332629] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T04:21:55.339942] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-17T04:21:55.820510] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T04:21:55.890152] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-17T04:21:56.146255] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T04:21:56.289290] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T04:21:56.420159] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T04:21:56.690193] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-17T04:21:56.807023] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T04:21:57.490199] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-17T04:21:58.290210] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-17T04:21:59.024581] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-17T04:21:59.090152] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-17T04:21:59.423127] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T04:21:59.890140] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-17T04:21:59.937210] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:22:00.690203] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-17T04:22:01.227865] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T04:22:01.308520] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:22:01.490212] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-17T04:22:02.042989] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:22:02.049037] [INFO ] [REMOTE ] IBTA: Full fetch complete (50133 records). [2025-09-17T04:22:02.049294] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-17T04:22:02.295357] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-17T04:22:02.453178] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-17T04:22:02.453433] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-17T04:22:02.454498] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-17T04:22:02.454662] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-17T04:22:02.467996] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:22:02.472280] [DEBUG] [LOCAL ] IBTA: Trimmed 50133 records to 38340 (keeping 200 days of data) [2025-09-17T04:22:02.473705] [INFO ] [REMOTE ] IBP: Full fetch complete (40778 records). [2025-09-17T04:22:02.474309] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-17T04:22:03.099257] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-17T04:22:03.136845] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-17T04:22:03.138197] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-17T04:22:03.140248] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-17T04:22:03.141317] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-17T04:22:03.148335] [DEBUG] [LOCAL ] IBTA: Primary data saved (38340 records). [2025-09-17T04:22:03.148834] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-17T04:22:03.148948] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBTA took 20.3s. Estimated remaining: 3h 8m 11s. Rate: 6.8 symbols/min [2025-09-17T04:22:03.260327] [DEBUG] [LOCAL ] IBP: Trimmed 40778 records to 29528 (keeping 200 days of data) [2025-09-17T04:22:03.337152] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:03.497813] [DEBUG] [LOCAL ] ICE: Loaded 39416 existing records from primary storage. [2025-09-17T04:22:03.531240] [INFO ] [MAIN ] ICE: Loaded 39416 existing records. [2025-09-17T04:22:03.753279] [DEBUG] [LOCAL ] IBP: Primary data saved (29528 records). [2025-09-17T04:22:03.753572] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-17T04:22:03.753730] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBP took 20.9s. Estimated remaining: 3h 7m 52s. Rate: 6.9 symbols/min [2025-09-17T04:22:03.750189] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:03.798935] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-17T04:22:03.847775] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-17T04:22:03.864857] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-17T04:22:03.880347] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-17T04:22:03.980138] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:04.316275] [DEBUG] [LOCAL ] ICL: Loaded 28534 existing records from primary storage. [2025-09-17T04:22:04.397718] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:04.398011] [INFO ] [MAIN ] ICL: Loaded 28534 existing records. [2025-09-17T04:22:04.403803] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-11. [2025-09-17T04:22:04.425463] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T04:22:04.628716] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:04.629039] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-17T04:22:04.629127] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-17T04:22:04.630039] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-17T04:22:04.630111] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-17T04:22:04.702421] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-17T04:22:05.006983] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:05.353051] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T04:22:05.490160] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-11. [2025-09-17T04:22:06.264037] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T04:22:06.290176] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-17T04:22:06.698744] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T04:22:06.973801] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T04:22:07.090160] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-17T04:22:07.890179] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-17T04:22:08.690135] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-17T04:22:08.795812] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-17T04:22:08.866623] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:22:09.337312] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T04:22:09.490170] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-17T04:22:10.290169] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-17T04:22:10.450882] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T04:22:11.090150] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-17T04:22:11.883041] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-17T04:22:11.898523] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-17T04:22:12.580995] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T04:22:12.690158] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-17T04:22:13.219409] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T04:22:13.227255] [INFO ] [REMOTE ] IBN: Full fetch complete (76125 records). [2025-09-17T04:22:13.227455] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-17T04:22:13.498376] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-17T04:22:13.667748] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-17T04:22:13.667895] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-17T04:22:13.668945] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-17T04:22:13.669012] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-17T04:22:13.670752] [DEBUG] [LOCAL ] IBN: Trimmed 76125 records to 52924 (keeping 200 days of data) [2025-09-17T04:22:13.941084] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:22:14.073168] [DEBUG] [LOCAL ] IBN: Primary data saved (52924 records). [2025-09-17T04:22:14.073382] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-17T04:22:14.073504] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBN took 31.2s. Estimated remaining: 3h 7m 46s. Rate: 6.8 symbols/min [2025-09-17T04:22:14.258207] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:14.287713] [DEBUG] [LOCAL ] IDA: Loaded 24824 existing records from primary storage. [2025-09-17T04:22:14.287940] [INFO ] [MAIN ] IDA: Loaded 24824 existing records. [2025-09-17T04:22:14.323968] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-17T04:22:14.492405] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:14.492752] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-17T04:22:14.492830] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-17T04:22:14.493575] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-17T04:22:14.493685] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-17T04:22:14.860942] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:15.090151] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-11. [2025-09-17T04:22:15.583774] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (5.29 seconds). [2025-09-17T04:22:15.890126] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-17T04:22:15.929218] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:22:16.155977] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-17T04:22:16.163419] [INFO ] [REMOTE ] IBM: Full fetch complete (77489 records). [2025-09-17T04:22:16.163735] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-17T04:22:16.498969] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T04:22:16.618616] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-17T04:22:16.618796] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-17T04:22:16.619890] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-17T04:22:16.619960] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-17T04:22:16.622141] [DEBUG] [LOCAL ] IBM: Trimmed 77489 records to 53609 (keeping 200 days of data) [2025-09-17T04:22:16.697300] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-17T04:22:16.989160] [DEBUG] [LOCAL ] IBM: Primary data saved (53609 records). [2025-09-17T04:22:16.989433] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-17T04:22:16.989592] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 34.1s. Estimated remaining: 3h 7m 30s. Rate: 6.9 symbols/min [2025-09-17T04:22:17.175971] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:17.185658] [DEBUG] [LOCAL ] IDE: Loaded 6599 existing records from primary storage. [2025-09-17T04:22:17.185856] [INFO ] [MAIN ] IDE: Loaded 6599 existing records. [2025-09-17T04:22:17.369056] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:17.369404] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-17T04:22:17.369484] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-17T04:22:17.369984] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-17T04:22:17.370054] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-17T04:22:17.495246] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-17T04:22:17.789416] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:17.825044] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T04:22:18.288527] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T04:22:18.297542] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-11. [2025-09-17T04:22:18.814173] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:22:19.090167] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-17T04:22:19.163974] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T04:22:19.890174] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-17T04:22:20.690175] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-17T04:22:20.901074] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T04:22:21.442414] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T04:22:21.490181] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-17T04:22:22.161129] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T04:22:22.290168] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-17T04:22:22.939926] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T04:22:23.090155] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-17T04:22:23.537265] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:22:23.890180] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-17T04:22:24.437183] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T04:22:24.574491] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:22:24.690209] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-17T04:22:25.490158] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-17T04:22:26.101138] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:22:26.290160] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-17T04:22:26.760554] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T04:22:27.090170] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-17T04:22:27.658045] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T04:22:27.663025] [INFO ] [REMOTE ] ICL: Full fetch complete (56296 records). [2025-09-17T04:22:27.663159] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-17T04:22:27.899116] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-17T04:22:28.056538] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-17T04:22:28.056680] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-17T04:22:28.057611] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-17T04:22:28.057695] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-17T04:22:28.059065] [DEBUG] [LOCAL ] ICL: Trimmed 56296 records to 39049 (keeping 200 days of data) [2025-09-17T04:22:28.292510] [DEBUG] [LOCAL ] ICL: Primary data saved (39049 records). [2025-09-17T04:22:28.292749] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-17T04:22:28.292858] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICL took 24.5s. Estimated remaining: 3h 7m 24s. Rate: 6.9 symbols/min [2025-09-17T04:22:28.491579] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:28.499731] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T04:22:28.528179] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T04:22:28.540676] [DEBUG] [LOCAL ] IDT: Loaded 13221 existing records from primary storage. [2025-09-17T04:22:28.540867] [INFO ] [MAIN ] IDT: Loaded 13221 existing records. [2025-09-17T04:22:28.693413] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-17T04:22:28.721227] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:28.722669] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-17T04:22:28.722736] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-17T04:22:28.723153] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-17T04:22:28.723211] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-17T04:22:29.079757] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:29.490156] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-17T04:22:30.199692] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:22:30.225092] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:22:30.290139] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-17T04:22:31.023304] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T04:22:31.090202] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-11. [2025-09-17T04:22:31.820451] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:22:31.890176] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-17T04:22:32.690177] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-17T04:22:32.803736] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:22:33.490200] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-17T04:22:34.172315] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T04:22:34.290251] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-17T04:22:34.572141] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T04:22:34.818187] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:22:35.090186] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-17T04:22:35.890287] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-17T04:22:36.561356] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T04:22:36.690232] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-17T04:22:36.907392] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T04:22:37.490119] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-17T04:22:37.754948] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T04:22:38.290357] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-17T04:22:39.090137] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-17T04:22:39.237391] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T04:22:39.275223] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T04:22:39.843498] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:22:39.890185] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-17T04:22:40.690194] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-17T04:22:41.418861] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T04:22:41.490171] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-17T04:22:41.733952] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T04:22:42.290173] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-17T04:22:42.328146] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T04:22:43.090201] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-17T04:22:43.890226] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-17T04:22:44.069442] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T04:22:44.092595] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T04:22:44.370115] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T04:22:44.690210] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-17T04:22:45.490220] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-17T04:22:46.290224] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-17T04:22:46.490450] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:22:46.497714] [INFO ] [REMOTE ] ICE: Full fetch complete (76584 records). [2025-09-17T04:22:46.497987] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-17T04:22:46.863957] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T04:22:46.907967] [INFO ] [REMOTE ] IDE: Full fetch complete (12722 records). [2025-09-17T04:22:46.945330] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-17T04:22:46.949910] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-17T04:22:46.956109] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-17T04:22:46.972765] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-17T04:22:46.983853] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-17T04:22:47.054161] [DEBUG] [LOCAL ] ICE: Trimmed 76584 records to 53026 (keeping 200 days of data) [2025-09-17T04:22:47.093427] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-17T04:22:47.432359] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:22:47.566157] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-17T04:22:47.566377] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-17T04:22:47.567079] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-17T04:22:47.567183] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-17T04:22:47.639934] [DEBUG] [LOCAL ] IDE: Trimmed 12722 records to 8366 (keeping 200 days of data) [2025-09-17T04:22:47.732343] [DEBUG] [LOCAL ] IDE: Primary data saved (8366 records). [2025-09-17T04:22:47.735121] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-17T04:22:47.736902] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. IDE took 30.7s. Estimated remaining: 3h 7m 28s. Rate: 6.8 symbols/min [2025-09-17T04:22:47.894871] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-17T04:22:47.962495] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:48.072858] [DEBUG] [LOCAL ] IEX: Loaded 28751 existing records from primary storage. [2025-09-17T04:22:48.074787] [INFO ] [MAIN ] IEX: Loaded 28751 existing records. [2025-09-17T04:22:48.290095] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:48.292877] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-17T04:22:48.293994] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-17T04:22:48.297598] [DEBUG] [LOCAL ] ICE: Primary data saved (53026 records). [2025-09-17T04:22:48.297634] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-17T04:22:48.298099] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-17T04:22:48.298239] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-17T04:22:48.298421] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. ICE took 45.1s. Estimated remaining: 3h 7m 10s. Rate: 6.8 symbols/min [2025-09-17T04:22:48.622900] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:48.780425] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T04:22:48.814719] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-17T04:22:48.911989] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:48.925946] [DEBUG] [LOCAL ] IFF: Loaded 37927 existing records from primary storage. [2025-09-17T04:22:48.926131] [INFO ] [MAIN ] IFF: Loaded 37927 existing records. [2025-09-17T04:22:49.110086] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:49.110468] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-17T04:22:49.110544] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-17T04:22:49.111438] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-17T04:22:49.111523] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-17T04:22:49.502794] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-11. [2025-09-17T04:22:49.514394] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:49.526369] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T04:22:49.918506] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:22:50.290199] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-17T04:22:50.928722] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:22:51.088720] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T04:22:51.092302] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-11. [2025-09-17T04:22:51.094459] [INFO ] [REMOTE ] IDA: Full fetch complete (44617 records). [2025-09-17T04:22:51.094584] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-17T04:22:51.501380] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-17T04:22:51.501534] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-17T04:22:51.502381] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-17T04:22:51.502441] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-17T04:22:51.503575] [DEBUG] [LOCAL ] IDA: Trimmed 44617 records to 32109 (keeping 200 days of data) [2025-09-17T04:22:51.728471] [DEBUG] [LOCAL ] IDA: Primary data saved (32109 records). [2025-09-17T04:22:51.728744] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-17T04:22:51.728861] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. IDA took 37.7s. Estimated remaining: 3h 6m 55s. Rate: 6.9 symbols/min [2025-09-17T04:22:51.890283] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-17T04:22:51.909907] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:51.929925] [DEBUG] [LOCAL ] IFN: Loaded 13709 existing records from primary storage. [2025-09-17T04:22:51.930142] [INFO ] [MAIN ] IFN: Loaded 13709 existing records. [2025-09-17T04:22:52.131278] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:52.131662] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-17T04:22:52.131733] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-17T04:22:52.132230] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-17T04:22:52.132293] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-17T04:22:52.503865] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:52.690252] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-11. [2025-09-17T04:22:53.214279] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:22:53.452544] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T04:22:53.490189] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-17T04:22:54.290171] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-17T04:22:54.627186] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:22:55.090215] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-17T04:22:55.368446] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T04:22:55.890201] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-17T04:22:56.490274] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T04:22:56.690167] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-17T04:22:56.833378] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-11 (5.74 seconds). [2025-09-17T04:22:57.159970] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T04:22:57.490231] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-17T04:22:58.259899] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:22:58.290140] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-17T04:22:58.916269] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:22:59.090193] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-17T04:22:59.670775] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:22:59.890191] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-17T04:23:00.690250] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-17T04:23:01.490240] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-17T04:23:04.234360] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (4.34 seconds). [2025-09-17T04:23:04.237494] [INFO ] [REMOTE ] IDT: Full fetch complete (22144 records). [2025-09-17T04:23:04.237624] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-17T04:23:04.548992] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (5.46 seconds). [2025-09-17T04:23:04.615686] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-17T04:23:04.643579] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-17T04:23:04.643738] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-17T04:23:04.645611] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-17T04:23:04.646111] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-17T04:23:04.672947] [DEBUG] [LOCAL ] IDT: Trimmed 22144 records to 17424 (keeping 200 days of data) [2025-09-17T04:23:04.675313] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (3.19 seconds). [2025-09-17T04:23:04.685705] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-17T04:23:04.795394] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (4.11 seconds). [2025-09-17T04:23:04.821163] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-17T04:23:04.837719] [DEBUG] [LOCAL ] IDT: Primary data saved (17424 records). [2025-09-17T04:23:04.837891] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-17T04:23:04.838011] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDT took 36.5s. Estimated remaining: 3h 6m 51s. Rate: 6.9 symbols/min [2025-09-17T04:23:05.010304] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:05.028483] [DEBUG] [LOCAL ] IFS: Loaded 16478 existing records from primary storage. [2025-09-17T04:23:05.028707] [INFO ] [MAIN ] IFS: Loaded 16478 existing records. [2025-09-17T04:23:05.202828] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:05.203152] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-17T04:23:05.203212] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-17T04:23:05.203735] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-17T04:23:05.203793] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-17T04:23:05.552528] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:05.552921] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-11. [2025-09-17T04:23:05.695239] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T04:23:05.700152] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-17T04:23:06.325037] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:23:06.335383] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-17T04:23:06.568196] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T04:23:06.659275] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:23:07.090174] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-17T04:23:07.867933] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (3.18 seconds). [2025-09-17T04:23:07.895206] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-17T04:23:07.911501] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T04:23:08.076677] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:23:08.671911] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:23:08.690117] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-17T04:23:09.490163] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-17T04:23:09.789891] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:23:10.290153] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-17T04:23:11.015721] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:23:11.085458] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T04:23:11.092418] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-17T04:23:11.890198] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-17T04:23:12.690194] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-17T04:23:12.903082] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T04:23:13.490219] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-17T04:23:14.225297] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-17T04:23:14.290425] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-17T04:23:14.498577] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T04:23:15.090170] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-17T04:23:15.183222] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-17T04:23:15.297490] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T04:23:15.300129] [INFO ] [REMOTE ] IFN: Full fetch complete (28893 records). [2025-09-17T04:23:15.300236] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-17T04:23:15.667282] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-17T04:23:15.667406] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-17T04:23:15.668077] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-17T04:23:15.668134] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-17T04:23:15.669416] [DEBUG] [LOCAL ] IFN: Trimmed 28893 records to 18414 (keeping 200 days of data) [2025-09-17T04:23:15.785921] [DEBUG] [LOCAL ] IFN: Primary data saved (18414 records). [2025-09-17T04:23:15.786131] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-17T04:23:15.786237] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IFN took 24.1s. Estimated remaining: 3h 6m 45s. Rate: 6.8 symbols/min [2025-09-17T04:23:15.895355] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-17T04:23:15.961858] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:15.972186] [DEBUG] [LOCAL ] IGA: Loaded 7019 existing records from primary storage. [2025-09-17T04:23:15.972422] [INFO ] [MAIN ] IGA: Loaded 7019 existing records. [2025-09-17T04:23:16.165812] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:16.166154] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-17T04:23:16.166215] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-17T04:23:16.166588] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-17T04:23:16.166678] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-17T04:23:16.553904] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:23:16.557555] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:16.690095] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-11. [2025-09-17T04:23:17.332669] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T04:23:17.490158] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-17T04:23:17.981436] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T04:23:18.290206] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-17T04:23:18.599978] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:23:19.090203] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-17T04:23:19.738519] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T04:23:19.764937] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T04:23:19.890157] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-17T04:23:20.690104] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-17T04:23:21.048499] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T04:23:21.490171] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-17T04:23:22.155014] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:23:22.183632] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T04:23:22.290148] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-17T04:23:23.090176] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-17T04:23:23.637450] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:23:23.643380] [INFO ] [REMOTE ] IEX: Full fetch complete (52961 records). [2025-09-17T04:23:23.643587] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-17T04:23:23.897070] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-17T04:23:24.043758] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-17T04:23:24.043893] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-17T04:23:24.045139] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-17T04:23:24.045237] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-17T04:23:24.047054] [DEBUG] [LOCAL ] IEX: Trimmed 52961 records to 38334 (keeping 200 days of data) [2025-09-17T04:23:24.302149] [DEBUG] [LOCAL ] IEX: Primary data saved (38334 records). [2025-09-17T04:23:24.302373] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-17T04:23:24.302520] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IEX took 36.6s. Estimated remaining: 3h 6m 36s. Rate: 6.8 symbols/min [2025-09-17T04:23:24.487022] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:24.518280] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:23:24.537762] [DEBUG] [LOCAL ] IGD: Loaded 13912 existing records from primary storage. [2025-09-17T04:23:24.537951] [INFO ] [MAIN ] IGD: Loaded 13912 existing records. [2025-09-17T04:23:24.695220] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-17T04:23:24.728241] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:24.729577] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-17T04:23:24.729678] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-17T04:23:24.730121] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-17T04:23:24.730198] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-17T04:23:25.106206] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:25.122457] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T04:23:25.490147] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-11. [2025-09-17T04:23:25.497949] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T04:23:26.290117] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-17T04:23:26.371557] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T04:23:27.067387] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T04:23:27.090072] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-17T04:23:27.890184] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-17T04:23:27.983520] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T04:23:28.690172] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-17T04:23:28.854762] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T04:23:29.490185] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-17T04:23:29.616190] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T04:23:30.290164] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-17T04:23:30.767594] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:23:31.005099] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T04:23:31.090156] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-17T04:23:31.890193] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-17T04:23:32.082106] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T04:23:32.690156] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-17T04:23:33.003174] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T04:23:33.406527] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T04:23:33.490164] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-17T04:23:33.593275] [DEBUG] [REMOTE ] IGA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T04:23:33.593740] [WARN ] [REMOTE ] IGA: No data returned for month 2025-07 [2025-09-17T04:23:34.290199] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-17T04:23:35.063069] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:23:35.090162] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-17T04:23:35.890188] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-17T04:23:36.189028] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T04:23:36.690227] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-17T04:23:37.482303] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T04:23:37.484457] [INFO ] [REMOTE ] IGA: Full fetch complete (11531 records). [2025-09-17T04:23:37.484633] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-17T04:23:37.496175] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-17T04:23:37.681246] [WARN ] [VALIDATOR ] IGA: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T04:23:37.681708] [FATAL] [MAIN ] IGA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:23:37.682147] [WARN ] [MAIN ] IGA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:23:37.682261] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-17T04:23:37.682532] [DEBUG] [LOCAL ] IGA: No primary data file found to delete. [2025-09-17T04:23:37.682603] [INFO ] [LOCAL ] IGA: Starting deletion of derivative data. [2025-09-17T04:23:37.701576] [DEBUG] [LOCAL ] IGA: Deleted derivative data file. [2025-09-17T04:23:37.717226] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IGA took 21.9s. Estimated remaining: 3h 6m 32s. Rate: 6.8 symbols/min [2025-09-17T04:23:37.789074] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T04:23:37.910674] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:37.916518] [DEBUG] [LOCAL ] IGI: Loaded 2729 existing records from primary storage. [2025-09-17T04:23:37.916671] [INFO ] [MAIN ] IGI: Loaded 2729 existing records. [2025-09-17T04:23:38.098437] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:38.098778] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-17T04:23:38.098847] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-17T04:23:38.099214] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-17T04:23:38.099282] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-17T04:23:38.295331] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-17T04:23:38.477752] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:38.642431] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T04:23:39.090200] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-11. [2025-09-17T04:23:39.574265] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T04:23:39.890161] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-17T04:23:40.279462] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T04:23:40.466992] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T04:23:40.690168] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-17T04:23:41.490166] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-17T04:23:41.946224] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T04:23:42.234055] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:23:42.240604] [INFO ] [REMOTE ] IFF: Full fetch complete (72452 records). [2025-09-17T04:23:42.240845] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-17T04:23:42.295926] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-17T04:23:42.651442] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-17T04:23:42.651612] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-17T04:23:42.653125] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-17T04:23:42.653190] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-17T04:23:42.655114] [DEBUG] [LOCAL ] IFF: Trimmed 72452 records to 50928 (keeping 200 days of data) [2025-09-17T04:23:42.763266] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T04:23:42.985334] [DEBUG] [LOCAL ] IFF: Primary data saved (50928 records). [2025-09-17T04:23:42.985530] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-17T04:23:42.985704] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFF took 54.7s. Estimated remaining: 3h 6m 20s. Rate: 6.8 symbols/min [2025-09-17T04:23:43.095179] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-17T04:23:43.156581] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:43.179482] [DEBUG] [LOCAL ] IGR: Loaded 22600 existing records from primary storage. [2025-09-17T04:23:43.179682] [INFO ] [MAIN ] IGR: Loaded 22600 existing records. [2025-09-17T04:23:43.354607] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:43.354896] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-17T04:23:43.355015] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-17T04:23:43.355719] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-17T04:23:43.355781] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-17T04:23:43.721605] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:43.726199] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T04:23:43.890145] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-17T04:23:44.690166] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-17T04:23:44.914399] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T04:23:45.002173] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T04:23:45.490169] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-17T04:23:46.290151] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-11. [2025-09-17T04:23:46.466767] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:23:46.470091] [INFO ] [REMOTE ] IFS: Full fetch complete (31063 records). [2025-09-17T04:23:46.470202] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-17T04:23:46.835241] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-17T04:23:46.835359] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-17T04:23:46.836002] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-17T04:23:46.836070] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-17T04:23:46.836946] [DEBUG] [LOCAL ] IFS: Trimmed 31063 records to 22964 (keeping 200 days of data) [2025-09-17T04:23:46.997240] [DEBUG] [LOCAL ] IFS: Primary data saved (22964 records). [2025-09-17T04:23:46.997594] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-17T04:23:46.997776] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IFS took 42.2s. Estimated remaining: 3h 6m 5s. Rate: 6.9 symbols/min [2025-09-17T04:23:47.100489] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-17T04:23:47.175284] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:47.181148] [DEBUG] [LOCAL ] IH: Loaded 2033 existing records from primary storage. [2025-09-17T04:23:47.181248] [INFO ] [MAIN ] IH: Loaded 2033 existing records. [2025-09-17T04:23:47.355535] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:47.355854] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-17T04:23:47.355914] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-17T04:23:47.356151] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-17T04:23:47.356252] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-17T04:23:47.697135] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T04:23:47.770468] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:47.793012] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T04:23:47.890097] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-11. [2025-09-17T04:23:48.410109] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T04:23:48.690417] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-17T04:23:49.490230] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-17T04:23:50.045477] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T04:23:50.113211] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:23:50.290224] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-17T04:23:51.090203] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-17T04:23:51.659291] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:23:51.890166] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-17T04:23:51.986812] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T04:23:52.690201] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-17T04:23:53.217181] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T04:23:53.263223] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T04:23:53.490189] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-17T04:23:54.290196] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-17T04:23:54.787992] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T04:23:54.861436] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T04:23:55.090175] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-17T04:23:55.890241] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-17T04:23:56.123339] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T04:23:56.397787] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T04:23:56.399166] [INFO ] [REMOTE ] IGI: Full fetch complete (5199 records). [2025-09-17T04:23:56.399272] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-17T04:23:56.697838] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-17T04:23:56.790061] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-17T04:23:56.790228] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-17T04:23:56.790561] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-17T04:23:56.790665] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-17T04:23:56.791311] [DEBUG] [LOCAL ] IGI: Trimmed 5199 records to 3770 (keeping 200 days of data) [2025-09-17T04:23:56.816652] [DEBUG] [LOCAL ] IGI: Primary data saved (3770 records). [2025-09-17T04:23:56.816865] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-17T04:23:56.817023] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGI took 19.1s. Estimated remaining: 3h 5m 58s. Rate: 6.9 symbols/min [2025-09-17T04:23:56.999013] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:57.011473] [DEBUG] [LOCAL ] IHD: Loaded 5213 existing records from primary storage. [2025-09-17T04:23:57.011714] [INFO ] [MAIN ] IHD: Loaded 5213 existing records. [2025-09-17T04:23:57.207779] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:57.208538] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T04:23:57.210222] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-17T04:23:57.210306] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-17T04:23:57.210775] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-17T04:23:57.210868] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-17T04:23:57.495272] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-17T04:23:57.606818] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:57.993681] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T04:23:58.290162] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-17T04:23:59.090150] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-17T04:23:59.352599] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T04:23:59.774812] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T04:23:59.890159] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-11. [2025-09-17T04:24:00.635439] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T04:24:00.690216] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-17T04:24:01.490206] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-17T04:24:02.172113] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:24:02.290145] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-17T04:24:02.774893] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T04:24:03.090143] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-17T04:24:03.890228] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-17T04:24:04.511380] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-17T04:24:04.555441] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:24:04.558853] [INFO ] [REMOTE ] IGD: Full fetch complete (29461 records). [2025-09-17T04:24:04.559012] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-17T04:24:04.698962] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-17T04:24:04.938788] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-17T04:24:04.946139] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-17T04:24:04.947744] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-17T04:24:04.948082] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T04:24:04.951497] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-17T04:24:04.952303] [DEBUG] [LOCAL ] IGD: Trimmed 29461 records to 19381 (keeping 200 days of data) [2025-09-17T04:24:05.070452] [DEBUG] [LOCAL ] IGD: Primary data saved (19381 records). [2025-09-17T04:24:05.070700] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-17T04:24:05.070850] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGD took 40.8s. Estimated remaining: 3h 5m 48s. Rate: 6.9 symbols/min [2025-09-17T04:24:05.241325] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:05.260883] [DEBUG] [LOCAL ] IHG: Loaded 17709 existing records from primary storage. [2025-09-17T04:24:05.261097] [INFO ] [MAIN ] IHG: Loaded 17709 existing records. [2025-09-17T04:24:05.454997] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:05.455386] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-17T04:24:05.455456] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-17T04:24:05.456188] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-17T04:24:05.456280] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-17T04:24:05.498339] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-17T04:24:05.819150] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:05.836095] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T04:24:06.290163] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-11. [2025-09-17T04:24:06.331035] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T04:24:07.090142] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-17T04:24:07.387684] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:24:07.831224] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T04:24:07.890176] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-17T04:24:08.690224] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-17T04:24:08.931982] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:24:09.490136] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-17T04:24:09.661803] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T04:24:10.290187] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-17T04:24:10.901779] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T04:24:11.090172] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-17T04:24:11.441896] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:24:11.890169] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-17T04:24:12.390233] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T04:24:12.618240] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T04:24:12.690163] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-17T04:24:13.118866] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T04:24:13.490158] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-17T04:24:14.080463] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T04:24:14.290202] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-17T04:24:15.090117] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-17T04:24:15.439300] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T04:24:15.853678] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:24:15.890116] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-17T04:24:16.690184] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-17T04:24:17.004304] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T04:24:17.490154] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-17T04:24:18.031278] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T04:24:18.290153] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-17T04:24:18.654862] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T04:24:19.014421] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T04:24:19.090143] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-17T04:24:19.472812] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T04:24:19.890154] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-17T04:24:20.690170] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-17T04:24:21.034536] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T04:24:21.039158] [INFO ] [REMOTE ] IGR: Full fetch complete (45891 records). [2025-09-17T04:24:21.039352] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-17T04:24:21.436887] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T04:24:21.456390] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-17T04:24:21.456160] [INFO ] [REMOTE ] IHD: Full fetch complete (11998 records). [2025-09-17T04:24:21.456935] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-17T04:24:21.456812] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-17T04:24:21.458123] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-17T04:24:21.458384] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-17T04:24:21.490458] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-17T04:24:21.563164] [DEBUG] [LOCAL ] IGR: Trimmed 45891 records to 30578 (keeping 200 days of data) [2025-09-17T04:24:21.927148] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-17T04:24:21.928465] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-17T04:24:21.930283] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-17T04:24:21.931030] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-17T04:24:21.933457] [DEBUG] [LOCAL ] IHD: Trimmed 11998 records to 7200 (keeping 200 days of data) [2025-09-17T04:24:21.972864] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T04:24:21.996386] [DEBUG] [LOCAL ] IHD: Primary data saved (7200 records). [2025-09-17T04:24:21.997937] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-17T04:24:21.998831] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IHD took 25.2s. Estimated remaining: 3h 5m 49s. Rate: 6.8 symbols/min [2025-09-17T04:24:22.230446] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:22.274975] [DEBUG] [LOCAL ] IGR: Primary data saved (30578 records). [2025-09-17T04:24:22.272902] [DEBUG] [LOCAL ] IHS: Loaded 29352 existing records from primary storage. [2025-09-17T04:24:22.275314] [INFO ] [MAIN ] IHS: Loaded 29352 existing records. [2025-09-17T04:24:22.295904] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-17T04:24:22.275190] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-17T04:24:22.320162] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IGR took 39.3s. Estimated remaining: 3h 5m 31s. Rate: 6.9 symbols/min [2025-09-17T04:24:22.581078] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:22.596815] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-17T04:24:22.642467] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:22.639984] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-17T04:24:22.643458] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-17T04:24:22.643568] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-17T04:24:22.751135] [DEBUG] [LOCAL ] IIF: Loaded 4047 existing records from primary storage. [2025-09-17T04:24:22.753994] [INFO ] [MAIN ] IIF: Loaded 4047 existing records. [2025-09-17T04:24:23.093814] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-17T04:24:23.140318] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:23.168194] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-17T04:24:23.168057] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T04:24:23.212791] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-17T04:24:23.244684] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:23.245212] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-17T04:24:23.245325] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-17T04:24:23.618426] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:23.890146] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-17T04:24:24.496456] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:24:24.524521] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T04:24:24.690147] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-17T04:24:25.490166] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-11. [2025-09-17T04:24:25.975276] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T04:24:26.290216] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-17T04:24:26.783813] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:24:26.906683] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T04:24:26.907766] [INFO ] [REMOTE ] IH: Full fetch complete (4901 records). [2025-09-17T04:24:26.907867] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-17T04:24:27.100063] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-17T04:24:27.284487] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-17T04:24:27.284675] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-17T04:24:27.284924] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-17T04:24:27.284979] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-17T04:24:27.285418] [DEBUG] [LOCAL ] IH: Trimmed 4901 records to 3612 (keeping 200 days of data) [2025-09-17T04:24:27.306913] [DEBUG] [LOCAL ] IH: Primary data saved (3612 records). [2025-09-17T04:24:27.307038] [INFO ] [MAIN ] IH: Full history saved. [2025-09-17T04:24:27.307142] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IH took 40.3s. Estimated remaining: 3h 5m 17s. Rate: 6.9 symbols/min [2025-09-17T04:24:27.484415] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:27.498706] [DEBUG] [LOCAL ] IIIN: Loaded 11751 existing records from primary storage. [2025-09-17T04:24:27.498887] [INFO ] [MAIN ] IIIN: Loaded 11751 existing records. [2025-09-17T04:24:27.691111] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:27.691470] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-17T04:24:27.691542] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-17T04:24:27.692145] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-17T04:24:27.692214] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-17T04:24:27.895392] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-17T04:24:28.076295] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:28.489167] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T04:24:28.690232] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-17T04:24:29.218806] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:24:29.490157] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-17T04:24:29.838179] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:24:30.290168] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-11. [2025-09-17T04:24:30.452779] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T04:24:31.020675] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:24:31.090159] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-17T04:24:31.890220] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-17T04:24:32.198310] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T04:24:32.690155] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-11. [2025-09-17T04:24:32.878505] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:24:33.164848] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T04:24:33.490151] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-17T04:24:34.212157] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T04:24:34.290239] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-17T04:24:35.078397] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T04:24:35.090093] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-17T04:24:35.801203] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:24:35.890095] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-17T04:24:36.535090] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T04:24:36.690188] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-17T04:24:37.490105] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-17T04:24:37.834877] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:24:38.290158] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-17T04:24:38.571181] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T04:24:39.090196] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-17T04:24:39.715384] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T04:24:39.752842] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T04:24:39.890213] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-17T04:24:40.690150] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-17T04:24:40.938505] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T04:24:40.942090] [INFO ] [REMOTE ] IHG: Full fetch complete (33374 records). [2025-09-17T04:24:40.942250] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-17T04:24:41.483382] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-17T04:24:41.483791] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T04:24:41.484024] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-17T04:24:41.490851] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-17T04:24:41.490597] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-17T04:24:41.492451] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-17T04:24:41.494942] [DEBUG] [LOCAL ] IHG: Trimmed 33374 records to 24896 (keeping 200 days of data) [2025-09-17T04:24:41.750072] [DEBUG] [LOCAL ] IHG: Primary data saved (24896 records). [2025-09-17T04:24:41.751858] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-17T04:24:41.752016] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IHG took 36.7s. Estimated remaining: 3h 5m 15s. Rate: 6.9 symbols/min [2025-09-17T04:24:42.007914] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:42.026190] [DEBUG] [LOCAL ] IIM: Loaded 11438 existing records from primary storage. [2025-09-17T04:24:42.026448] [INFO ] [MAIN ] IIM: Loaded 11438 existing records. [2025-09-17T04:24:42.290477] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-17T04:24:42.322770] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:42.323068] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-17T04:24:42.323156] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-17T04:24:42.323733] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-17T04:24:42.323829] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-17T04:24:42.649760] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T04:24:42.742525] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:42.934484] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T04:24:43.090178] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-17T04:24:43.799854] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T04:24:43.890145] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-17T04:24:44.535482] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T04:24:44.690216] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-17T04:24:45.175209] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T04:24:45.176307] [INFO ] [REMOTE ] IIF: Full fetch complete (9702 records). [2025-09-17T04:24:45.176394] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-17T04:24:45.500530] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-17T04:24:45.543523] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-17T04:24:45.543637] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-17T04:24:45.543959] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-17T04:24:45.544009] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-17T04:24:45.544536] [DEBUG] [LOCAL ] IIF: Trimmed 9702 records to 5891 (keeping 200 days of data) [2025-09-17T04:24:45.583371] [DEBUG] [LOCAL ] IIF: Primary data saved (5891 records). [2025-09-17T04:24:45.583598] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-17T04:24:45.583732] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IIF took 23.2s. Estimated remaining: 3h 5m 1s. Rate: 6.9 symbols/min [2025-09-17T04:24:45.761601] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:45.785741] [DEBUG] [LOCAL ] IIPR: Loaded 20792 existing records from primary storage. [2025-09-17T04:24:45.785995] [INFO ] [MAIN ] IIPR: Loaded 20792 existing records. [2025-09-17T04:24:45.973822] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:45.974209] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-17T04:24:45.974276] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-17T04:24:45.975166] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-17T04:24:45.975270] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-17T04:24:46.295301] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-11. [2025-09-17T04:24:46.353119] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:46.620279] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T04:24:47.082206] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T04:24:47.090006] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-17T04:24:47.890166] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-17T04:24:48.098086] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T04:24:48.667023] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T04:24:48.690099] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-17T04:24:49.490189] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-17T04:24:49.739093] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T04:24:50.290145] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-11. [2025-09-17T04:24:50.402201] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:24:51.090211] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-17T04:24:51.637178] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T04:24:51.890164] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-17T04:24:52.017950] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T04:24:52.690212] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-17T04:24:53.366995] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T04:24:53.490151] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-17T04:24:54.091607] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:24:54.290168] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-17T04:24:54.970735] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:24:55.090155] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-17T04:24:55.895215] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-17T04:24:55.914720] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:24:56.348482] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T04:24:56.690089] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-17T04:24:56.971223] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T04:24:57.490128] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-17T04:24:58.206844] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T04:24:58.290188] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-17T04:24:58.472767] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T04:24:59.090172] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-17T04:24:59.501051] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T04:24:59.890204] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-17T04:25:00.285706] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T04:25:00.690163] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-17T04:25:01.064943] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T04:25:01.490175] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-17T04:25:01.705579] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T04:25:02.290179] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-17T04:25:02.567786] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T04:25:03.090248] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-17T04:25:03.147726] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T04:25:03.149917] [INFO ] [REMOTE ] IIIN: Full fetch complete (25247 records). [2025-09-17T04:25:03.150063] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-17T04:25:03.532634] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-17T04:25:03.532805] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-17T04:25:03.533524] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-17T04:25:03.533614] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-17T04:25:03.534600] [DEBUG] [LOCAL ] IIIN: Trimmed 25247 records to 16995 (keeping 200 days of data) [2025-09-17T04:25:03.645354] [DEBUG] [LOCAL ] IIIN: Primary data saved (16995 records). [2025-09-17T04:25:03.645571] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-17T04:25:03.645709] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IIIN took 36.3s. Estimated remaining: 3h 5m 3s. Rate: 6.8 symbols/min [2025-09-17T04:25:03.822761] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:03.857626] [DEBUG] [LOCAL ] IMAX: Loaded 31866 existing records from primary storage. [2025-09-17T04:25:03.857902] [INFO ] [MAIN ] IMAX: Loaded 31866 existing records. [2025-09-17T04:25:03.895554] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-17T04:25:04.066290] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:04.066661] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-17T04:25:04.066725] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-17T04:25:04.067596] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-17T04:25:04.067688] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-17T04:25:04.372457] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T04:25:04.451449] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:04.690146] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-11. [2025-09-17T04:25:05.245255] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T04:25:05.490189] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-17T04:25:06.112483] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:25:06.290176] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-17T04:25:06.378348] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T04:25:07.090216] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-17T04:25:07.738553] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:25:07.890194] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-17T04:25:08.555465] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T04:25:08.690143] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-17T04:25:08.908898] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T04:25:09.490199] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-17T04:25:09.853722] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T04:25:10.290154] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-17T04:25:10.428636] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T04:25:11.090211] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-17T04:25:11.677782] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:25:11.683169] [INFO ] [REMOTE ] IHS: Full fetch complete (52576 records). [2025-09-17T04:25:11.683358] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-17T04:25:11.897588] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-17T04:25:11.948259] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T04:25:12.107746] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-17T04:25:12.107888] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-17T04:25:12.108751] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-17T04:25:12.108813] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-17T04:25:12.110235] [DEBUG] [LOCAL ] IHS: Trimmed 52576 records to 39153 (keeping 200 days of data) [2025-09-17T04:25:12.348030] [DEBUG] [LOCAL ] IHS: Primary data saved (39153 records). [2025-09-17T04:25:12.348258] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-17T04:25:12.348408] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IHS took 50.3s. Estimated remaining: 3h 4m 54s. Rate: 6.8 symbols/min [2025-09-17T04:25:12.524572] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:12.570707] [DEBUG] [LOCAL ] INFA: Loaded 37288 existing records from primary storage. [2025-09-17T04:25:12.570943] [INFO ] [MAIN ] INFA: Loaded 37288 existing records. [2025-09-17T04:25:12.695347] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-17T04:25:12.764168] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:12.764479] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-17T04:25:12.764542] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-17T04:25:12.766021] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-17T04:25:12.766094] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-17T04:25:13.140772] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:13.250964] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T04:25:13.490167] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-11. [2025-09-17T04:25:13.735357] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:25:14.290135] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-17T04:25:15.058805] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:25:15.090124] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-17T04:25:15.272085] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:25:15.275127] [INFO ] [REMOTE ] IIM: Full fetch complete (25434 records). [2025-09-17T04:25:15.275262] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-17T04:25:15.653155] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-17T04:25:15.653305] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-17T04:25:15.653946] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-17T04:25:15.654006] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-17T04:25:15.655262] [DEBUG] [LOCAL ] IIM: Trimmed 25434 records to 15974 (keeping 200 days of data) [2025-09-17T04:25:15.755991] [DEBUG] [LOCAL ] IIM: Primary data saved (15974 records). [2025-09-17T04:25:15.756175] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-17T04:25:15.756274] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIM took 34.0s. Estimated remaining: 3h 4m 39s. Rate: 6.9 symbols/min [2025-09-17T04:25:15.895243] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-17T04:25:15.947608] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:15.991496] [DEBUG] [LOCAL ] INFY: Loaded 39957 existing records from primary storage. [2025-09-17T04:25:15.991759] [INFO ] [MAIN ] INFY: Loaded 39957 existing records. [2025-09-17T04:25:16.187099] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:16.187421] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-17T04:25:16.187483] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-17T04:25:16.188545] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-17T04:25:16.188621] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-17T04:25:16.559045] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:16.582362] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T04:25:16.690094] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-17T04:25:17.490135] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-11. [2025-09-17T04:25:17.604220] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T04:25:18.290147] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-17T04:25:18.321595] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T04:25:19.090143] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-17T04:25:19.223760] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T04:25:19.287998] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T04:25:19.890196] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-17T04:25:20.369577] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:25:20.690241] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-17T04:25:21.490171] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-17T04:25:21.734787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:25:21.770506] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T04:25:22.290173] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-17T04:25:22.957074] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T04:25:23.090158] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-17T04:25:23.890225] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-17T04:25:24.038993] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T04:25:24.393431] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T04:25:24.397412] [INFO ] [REMOTE ] IIPR: Full fetch complete (43778 records). [2025-09-17T04:25:24.397601] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-17T04:25:24.698794] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-17T04:25:24.839167] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-17T04:25:24.839302] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-17T04:25:24.840228] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-17T04:25:24.840300] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-17T04:25:24.841416] [DEBUG] [LOCAL ] IIPR: Trimmed 43778 records to 29629 (keeping 200 days of data) [2025-09-17T04:25:25.036329] [DEBUG] [LOCAL ] IIPR: Primary data saved (29629 records). [2025-09-17T04:25:25.036508] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-17T04:25:25.036609] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIPR took 39.5s. Estimated remaining: 3h 4m 31s. Rate: 6.9 symbols/min [2025-09-17T04:25:25.213779] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:25.256215] [DEBUG] [LOCAL ] ING: Loaded 37640 existing records from primary storage. [2025-09-17T04:25:25.256424] [INFO ] [MAIN ] ING: Loaded 37640 existing records. [2025-09-17T04:25:25.439857] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:25.440152] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-17T04:25:25.440213] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-17T04:25:25.441266] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-17T04:25:25.441337] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-17T04:25:25.508025] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-17T04:25:25.816454] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:25.845932] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T04:25:26.290165] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-17T04:25:26.436971] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T04:25:26.999069] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:25:27.090124] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-17T04:25:27.890174] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-11. [2025-09-17T04:25:28.014490] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T04:25:28.646374] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:25:28.690161] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-17T04:25:29.490151] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-17T04:25:29.610094] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:25:29.829578] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:25:30.290172] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-17T04:25:31.090186] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-17T04:25:31.354326] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T04:25:31.895216] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-17T04:25:31.914483] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T04:25:32.574842] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T04:25:32.580332] [INFO ] [REMOTE ] IMAX: Full fetch complete (59277 records). [2025-09-17T04:25:32.580500] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-17T04:25:32.695300] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-17T04:25:32.980170] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-17T04:25:32.980297] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-17T04:25:32.981434] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-17T04:25:32.981562] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-17T04:25:32.983089] [DEBUG] [LOCAL ] IMAX: Trimmed 59277 records to 42625 (keeping 200 days of data) [2025-09-17T04:25:33.253576] [DEBUG] [LOCAL ] IMAX: Primary data saved (42625 records). [2025-09-17T04:25:33.253785] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-17T04:25:33.253900] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. IMAX took 29.6s. Estimated remaining: 3h 4m 21s. Rate: 6.9 symbols/min [2025-09-17T04:25:33.424259] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:33.444549] [DEBUG] [LOCAL ] INGM: Loaded 20171 existing records from primary storage. [2025-09-17T04:25:33.444760] [INFO ] [MAIN ] INGM: Loaded 20171 existing records. [2025-09-17T04:25:33.499269] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-17T04:25:33.654016] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:33.654553] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-17T04:25:33.654627] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-17T04:25:33.655428] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-17T04:25:33.655507] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-17T04:25:34.071276] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:34.074448] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T04:25:34.120303] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:25:34.290156] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-17T04:25:35.090175] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-11. [2025-09-17T04:25:35.331664] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T04:25:35.902701] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-17T04:25:35.931921] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T04:25:36.392721] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T04:25:36.690205] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-17T04:25:37.466371] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:25:37.490081] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-17T04:25:38.290173] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-17T04:25:38.414015] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T04:25:39.044351] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:25:39.090110] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-17T04:25:39.248701] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T04:25:39.890223] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-17T04:25:40.690162] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-17T04:25:40.799144] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:25:40.920177] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:25:41.490224] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-17T04:25:42.290198] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-17T04:25:42.622394] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T04:25:43.030875] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:25:43.038144] [INFO ] [REMOTE ] INFA: Full fetch complete (71855 records). [2025-09-17T04:25:43.038329] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-17T04:25:43.102975] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-17T04:25:43.367207] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:25:43.471911] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-17T04:25:43.472066] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-17T04:25:43.473180] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-17T04:25:43.473280] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-17T04:25:43.479123] [DEBUG] [LOCAL ] INFA: Trimmed 71855 records to 50208 (keeping 200 days of data) [2025-09-17T04:25:43.800760] [DEBUG] [LOCAL ] INFA: Primary data saved (50208 records). [2025-09-17T04:25:43.800964] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-17T04:25:43.801062] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. INFA took 31.5s. Estimated remaining: 3h 4m 15s. Rate: 6.8 symbols/min [2025-09-17T04:25:43.895787] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-17T04:25:43.983036] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:44.007473] [DEBUG] [LOCAL ] INGR: Loaded 24186 existing records from primary storage. [2025-09-17T04:25:44.007714] [INFO ] [MAIN ] INGR: Loaded 24186 existing records. [2025-09-17T04:25:44.184660] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:44.184943] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-17T04:25:44.185007] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-17T04:25:44.185781] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-17T04:25:44.185854] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-17T04:25:44.553062] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:44.690160] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-11. [2025-09-17T04:25:44.891709] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T04:25:45.309615] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T04:25:45.490197] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-17T04:25:46.014117] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T04:25:46.290100] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-17T04:25:46.403137] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T04:25:47.090128] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-17T04:25:47.890212] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-17T04:25:48.216398] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T04:25:48.450954] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:25:48.690107] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-17T04:25:49.138938] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:25:49.490222] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-17T04:25:50.290157] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-17T04:25:50.383119] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:25:50.392885] [INFO ] [REMOTE ] INFY: Full fetch complete (77373 records). [2025-09-17T04:25:50.393096] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-17T04:25:50.796944] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-17T04:25:50.797072] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-17T04:25:50.798132] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-17T04:25:50.798212] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-17T04:25:50.799828] [DEBUG] [LOCAL ] INFY: Trimmed 77373 records to 53598 (keeping 200 days of data) [2025-09-17T04:25:51.091681] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:25:51.090714] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-17T04:25:51.204741] [DEBUG] [LOCAL ] INFY: Primary data saved (53598 records). [2025-09-17T04:25:51.204978] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-17T04:25:51.205108] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INFY took 35.4s. Estimated remaining: 3h 4m 4s. Rate: 6.9 symbols/min [2025-09-17T04:25:51.386085] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:51.419895] [DEBUG] [LOCAL ] INN: Loaded 31561 existing records from primary storage. [2025-09-17T04:25:51.420110] [INFO ] [MAIN ] INN: Loaded 31561 existing records. [2025-09-17T04:25:51.611098] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:51.611506] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-17T04:25:51.611590] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-17T04:25:51.617633] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-17T04:25:51.622885] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-17T04:25:51.679591] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:25:51.900377] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-17T04:25:52.020240] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:52.515019] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T04:25:52.690149] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-17T04:25:52.879038] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T04:25:53.490214] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-11. [2025-09-17T04:25:53.857370] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:25:54.290169] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-17T04:25:54.878821] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T04:25:55.090184] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-17T04:25:55.756700] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:25:55.890127] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-17T04:25:55.983425] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:25:56.690173] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-17T04:25:57.311041] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:25:57.490133] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-17T04:25:58.290159] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-17T04:25:58.527906] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T04:25:58.547726] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T04:25:58.551429] [INFO ] [REMOTE ] INGM: Full fetch complete (42326 records). [2025-09-17T04:25:58.551565] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-17T04:25:58.936989] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-17T04:25:58.937123] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-17T04:25:58.938198] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-17T04:25:58.938281] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-17T04:25:58.939605] [DEBUG] [LOCAL ] INGM: Trimmed 42326 records to 29364 (keeping 200 days of data) [2025-09-17T04:25:59.096475] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-17T04:25:59.134357] [DEBUG] [LOCAL ] INGM: Primary data saved (29364 records). [2025-09-17T04:25:59.134498] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-17T04:25:59.134627] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INGM took 25.9s. Estimated remaining: 3h 3m 55s. Rate: 6.9 symbols/min [2025-09-17T04:25:59.320206] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:59.341200] [DEBUG] [LOCAL ] INR: Loaded 19261 existing records from primary storage. [2025-09-17T04:25:59.341397] [INFO ] [MAIN ] INR: Loaded 19261 existing records. [2025-09-17T04:25:59.525084] [WARN ] [MAIN ] INR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:59.525632] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-17T04:25:59.525749] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-17T04:25:59.526600] [DEBUG] [LOCAL ] INR: Deleted primary data file. [2025-09-17T04:25:59.526928] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-17T04:25:59.848158] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:25:59.895300] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-17T04:25:59.939788] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:00.690189] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-11. [2025-09-17T04:26:00.908441] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:26:00.908915] [WARN ] [REMOTE ] INR: No data returned for month 2024-11 [2025-09-17T04:26:00.973411] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T04:26:01.430606] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T04:26:01.490205] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-17T04:26:01.695820] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:26:01.696310] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-17T04:26:02.290171] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-17T04:26:03.090131] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-17T04:26:03.657058] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:26:03.890199] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-17T04:26:04.690161] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-17T04:26:04.962041] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T04:26:05.094451] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T04:26:05.244021] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:26:05.490179] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-17T04:26:06.290156] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-17T04:26:06.983051] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:26:07.090111] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-17T04:26:07.621622] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:26:07.890143] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-17T04:26:08.680008] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:26:08.690987] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-17T04:26:09.202508] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T04:26:09.490120] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-17T04:26:09.584156] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T04:26:10.290164] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-17T04:26:10.925975] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T04:26:10.931527] [INFO ] [REMOTE ] INGR: Full fetch complete (49296 records). [2025-09-17T04:26:10.931685] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-17T04:26:11.093829] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-17T04:26:11.317312] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-17T04:26:11.317431] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-17T04:26:11.318149] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-17T04:26:11.318210] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-17T04:26:11.319294] [DEBUG] [LOCAL ] INGR: Trimmed 49296 records to 33338 (keeping 200 days of data) [2025-09-17T04:26:11.537720] [DEBUG] [LOCAL ] INGR: Primary data saved (33338 records). [2025-09-17T04:26:11.537912] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-17T04:26:11.538030] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INGR took 27.7s. Estimated remaining: 3h 3m 50s. Rate: 6.8 symbols/min [2025-09-17T04:26:11.712169] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:26:11.749177] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:11.788781] [DEBUG] [LOCAL ] INSP: Loaded 28015 existing records from primary storage. [2025-09-17T04:26:11.789066] [INFO ] [MAIN ] INSP: Loaded 28015 existing records. [2025-09-17T04:26:11.897239] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-17T04:26:11.983546] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:11.983915] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-17T04:26:11.983991] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-17T04:26:11.984901] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-17T04:26:11.984968] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-17T04:26:12.356870] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:12.507145] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T04:26:12.690148] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-17T04:26:13.490139] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-11. [2025-09-17T04:26:13.525310] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T04:26:13.672504] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T04:26:14.290198] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-17T04:26:14.964026] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:26:15.090109] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-17T04:26:15.243898] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T04:26:15.890208] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-17T04:26:16.686197] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T04:26:16.695362] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-17T04:26:16.748381] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T04:26:17.490144] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-17T04:26:18.290219] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-17T04:26:18.435522] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T04:26:18.442792] [INFO ] [REMOTE ] ING: Full fetch complete (73489 records). [2025-09-17T04:26:18.442983] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-17T04:26:18.841310] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-17T04:26:18.841428] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-17T04:26:18.842409] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-17T04:26:18.842468] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-17T04:26:18.844539] [DEBUG] [LOCAL ] ING: Trimmed 73489 records to 50913 (keeping 200 days of data) [2025-09-17T04:26:19.102928] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-17T04:26:19.107913] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:26:19.141450] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T04:26:19.231726] [DEBUG] [LOCAL ] ING: Primary data saved (50913 records). [2025-09-17T04:26:19.231946] [INFO ] [MAIN ] ING: Full history saved. [2025-09-17T04:26:19.232079] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. ING took 54.2s. Estimated remaining: 3h 3m 40s. Rate: 6.8 symbols/min [2025-09-17T04:26:19.411476] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:19.441738] [DEBUG] [LOCAL ] INSW: Loaded 29451 existing records from primary storage. [2025-09-17T04:26:19.441936] [INFO ] [MAIN ] INSW: Loaded 29451 existing records. [2025-09-17T04:26:19.622523] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:19.622869] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-17T04:26:19.622932] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-17T04:26:19.624477] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-17T04:26:19.624550] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-17T04:26:19.895278] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-17T04:26:19.999632] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:20.517953] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:26:20.690208] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-11. [2025-09-17T04:26:21.263515] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T04:26:21.490215] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-17T04:26:22.116051] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:26:22.290169] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-17T04:26:23.047317] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:26:23.090072] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-17T04:26:23.475155] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T04:26:23.890142] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-17T04:26:24.575448] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T04:26:24.690172] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-17T04:26:25.490117] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-17T04:26:25.589551] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T04:26:26.104607] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T04:26:26.290204] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-17T04:26:26.905528] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:26:27.090119] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-17T04:26:27.817606] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T04:26:27.890139] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-17T04:26:28.544319] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T04:26:28.552328] [INFO ] [REMOTE ] INN: Full fetch complete (57683 records). [2025-09-17T04:26:28.552637] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-17T04:26:28.699045] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-17T04:26:29.205547] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-17T04:26:29.205790] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-17T04:26:29.207632] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-17T04:26:29.207775] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-17T04:26:29.209827] [DEBUG] [LOCAL ] INN: Trimmed 57683 records to 41964 (keeping 200 days of data) [2025-09-17T04:26:29.490207] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-17T04:26:29.540832] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T04:26:29.553531] [DEBUG] [LOCAL ] INN: Primary data saved (41964 records). [2025-09-17T04:26:29.553763] [INFO ] [MAIN ] INN: Full history saved. [2025-09-17T04:26:29.553883] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INN took 38.3s. Estimated remaining: 3h 3m 33s. Rate: 6.8 symbols/min [2025-09-17T04:26:29.750449] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:29.790947] [DEBUG] [LOCAL ] INVH: Loaded 39610 existing records from primary storage. [2025-09-17T04:26:29.791180] [INFO ] [MAIN ] INVH: Loaded 39610 existing records. [2025-09-17T04:26:29.978307] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:29.978716] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-17T04:26:29.978868] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-17T04:26:29.979753] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-17T04:26:29.979816] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-17T04:26:30.125919] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:26:30.291100] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-17T04:26:30.369819] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:30.691420] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T04:26:31.090362] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-11. [2025-09-17T04:26:31.682759] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:26:31.890257] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-17T04:26:32.375979] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:26:32.690198] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-17T04:26:33.490206] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-17T04:26:33.556074] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:26:34.290191] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-17T04:26:34.418688] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T04:26:34.829093] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T04:26:34.833798] [INFO ] [REMOTE ] INR: Full fetch complete (31852 records). [2025-09-17T04:26:34.833981] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-17T04:26:35.032170] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 157 unique days, need 200 days [2025-09-17T04:26:35.032715] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:26:35.032821] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:26:35.033073] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-17T04:26:35.033167] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-17T04:26:35.033224] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-17T04:26:35.033733] [DEBUG] [LOCAL ] INR: Deleted derivative data file. [2025-09-17T04:26:35.033863] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INR took 35.9s. Estimated remaining: 3h 3m 21s. Rate: 6.9 symbols/min [2025-09-17T04:26:35.101804] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-17T04:26:35.280717] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:35.304451] [DEBUG] [LOCAL ] INVX: Loaded 21435 existing records from primary storage. [2025-09-17T04:26:35.305031] [INFO ] [MAIN ] INVX: Loaded 21435 existing records. [2025-09-17T04:26:35.492776] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:35.493105] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-17T04:26:35.493181] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-17T04:26:35.494045] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-17T04:26:35.494125] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-17T04:26:35.880272] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:35.898991] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-11. [2025-09-17T04:26:35.904696] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T04:26:36.559895] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T04:26:36.690124] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-17T04:26:37.186388] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:26:37.490188] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-17T04:26:38.159595] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T04:26:38.290131] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-17T04:26:38.849458] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:26:39.090139] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-17T04:26:39.853243] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:26:39.890092] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-17T04:26:40.690102] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-17T04:26:40.831773] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T04:26:41.428530] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T04:26:41.490157] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-17T04:26:42.030962] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T04:26:42.290174] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-17T04:26:42.809546] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T04:26:42.814575] [INFO ] [REMOTE ] INSW: Full fetch complete (60945 records). [2025-09-17T04:26:42.814761] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-17T04:26:43.095319] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-17T04:26:43.216547] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-17T04:26:43.216700] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-17T04:26:43.217814] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-17T04:26:43.217876] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-17T04:26:43.219294] [DEBUG] [LOCAL ] INSW: Trimmed 60945 records to 40774 (keeping 200 days of data) [2025-09-17T04:26:43.488403] [DEBUG] [LOCAL ] INSW: Primary data saved (40774 records). [2025-09-17T04:26:43.488595] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-17T04:26:43.488742] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSW took 24.3s. Estimated remaining: 3h 3m 12s. Rate: 6.9 symbols/min [2025-09-17T04:26:43.665953] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:43.708707] [DEBUG] [LOCAL ] IONQ: Loaded 40138 existing records from primary storage. [2025-09-17T04:26:43.708942] [INFO ] [MAIN ] IONQ: Loaded 40138 existing records. [2025-09-17T04:26:43.904123] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:43.893579] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-17T04:26:43.905497] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-17T04:26:43.905708] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-17T04:26:43.906929] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-17T04:26:43.907007] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-17T04:26:44.131160] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T04:26:44.329468] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:44.500072] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T04:26:44.690150] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-11. [2025-09-17T04:26:44.831706] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T04:26:45.490224] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-17T04:26:46.290205] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-17T04:26:47.090136] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-17T04:26:47.249176] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-11 (2.56 seconds). [2025-09-17T04:26:47.337280] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T04:26:47.759288] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T04:26:47.890117] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-17T04:26:48.338806] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:26:48.690162] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-17T04:26:49.490135] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-17T04:26:49.538461] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:26:49.735147] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T04:26:50.290170] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-17T04:26:51.090189] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-17T04:26:51.890221] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-17T04:26:52.097332] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:26:52.144710] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-17T04:26:52.537189] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:26:52.690152] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-17T04:26:53.177334] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:26:53.183584] [INFO ] [REMOTE ] INSP: Full fetch complete (51914 records). [2025-09-17T04:26:53.183819] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-17T04:26:53.495214] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-17T04:26:53.596464] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-17T04:26:53.596598] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-17T04:26:53.597781] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-17T04:26:53.597854] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-17T04:26:53.599244] [DEBUG] [LOCAL ] INSP: Trimmed 51914 records to 36440 (keeping 200 days of data) [2025-09-17T04:26:53.826910] [DEBUG] [LOCAL ] INSP: Primary data saved (36440 records). [2025-09-17T04:26:53.827106] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-17T04:26:53.827214] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INSP took 42.3s. Estimated remaining: 3h 3m 5s. Rate: 6.8 symbols/min [2025-09-17T04:26:53.999958] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:54.020293] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T04:26:54.066969] [DEBUG] [LOCAL ] IOT: Loaded 39868 existing records from primary storage. [2025-09-17T04:26:54.067160] [INFO ] [MAIN ] IOT: Loaded 39868 existing records. [2025-09-17T04:26:54.249158] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:54.249678] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-17T04:26:54.249745] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-17T04:26:54.250971] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-17T04:26:54.251037] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-17T04:26:54.295273] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-17T04:26:54.604960] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:55.090152] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-11. [2025-09-17T04:26:55.584946] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:26:55.890160] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-17T04:26:56.150914] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-17T04:26:56.690186] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-17T04:26:56.929347] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T04:26:57.490140] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-17T04:26:57.627263] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:26:58.290205] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-17T04:26:58.785915] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T04:26:58.922220] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-17T04:26:59.090091] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-17T04:26:59.878427] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:26:59.890073] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-17T04:27:00.690191] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-17T04:27:01.490269] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-17T04:27:01.608574] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T04:27:02.232547] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (3.14 seconds). [2025-09-17T04:27:02.290099] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-17T04:27:03.090165] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-17T04:27:03.267234] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T04:27:03.664128] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (2.97 seconds). [2025-09-17T04:27:03.890213] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-17T04:27:04.690169] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-17T04:27:05.601090] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-17T04:27:05.611535] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-17T04:27:05.934425] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T04:27:05.953446] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:27:05.958387] [INFO ] [REMOTE ] INVX: Full fetch complete (44568 records). [2025-09-17T04:27:05.958527] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-17T04:27:06.297698] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-17T04:27:06.347682] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-17T04:27:06.347798] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-17T04:27:06.348661] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-17T04:27:06.348720] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-17T04:27:06.349844] [DEBUG] [LOCAL ] INVX: Trimmed 44568 records to 29384 (keeping 200 days of data) [2025-09-17T04:27:06.527710] [DEBUG] [LOCAL ] INVX: Primary data saved (29384 records). [2025-09-17T04:27:06.527896] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-17T04:27:06.527996] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INVX took 31.5s. Estimated remaining: 3h 3m 0s. Rate: 6.8 symbols/min [2025-09-17T04:27:06.703707] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:06.748226] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (4.46 seconds). [2025-09-17T04:27:06.788874] [DEBUG] [LOCAL ] IP: Loaded 39704 existing records from primary storage. [2025-09-17T04:27:06.789094] [INFO ] [MAIN ] IP: Loaded 39704 existing records. [2025-09-17T04:27:06.968832] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:06.969149] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-17T04:27:06.969213] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-17T04:27:06.970343] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-17T04:27:06.970632] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-17T04:27:07.091054] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-17T04:27:07.348956] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:07.381836] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:27:07.890147] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-17T04:27:08.093851] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:27:08.690145] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-17T04:27:09.490129] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-11. [2025-09-17T04:27:09.611726] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-17T04:27:09.743057] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T04:27:09.946287] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:27:09.952868] [INFO ] [REMOTE ] INVH: Full fetch complete (76488 records). [2025-09-17T04:27:09.953027] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-17T04:27:10.302290] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-17T04:27:10.360695] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-17T04:27:10.360824] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-17T04:27:10.362069] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-17T04:27:10.362153] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-17T04:27:10.363881] [DEBUG] [LOCAL ] INVH: Trimmed 76488 records to 53145 (keeping 200 days of data) [2025-09-17T04:27:10.700806] [DEBUG] [LOCAL ] INVH: Primary data saved (53145 records). [2025-09-17T04:27:10.700975] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-17T04:27:10.701079] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVH took 41.1s. Estimated remaining: 3h 2m 46s. Rate: 6.9 symbols/min [2025-09-17T04:27:11.090124] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-17T04:27:11.198904] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T04:27:11.890146] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-17T04:27:12.291812] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T04:27:12.690131] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-17T04:27:13.645375] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T04:27:13.656442] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-17T04:27:13.693053] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-17T04:27:14.290246] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-17T04:27:14.297964] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T04:27:15.099998] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-17T04:27:15.119977] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T04:27:15.890211] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-17T04:27:17.977656] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-17T04:27:17.990922] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-17T04:27:18.051158] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-09-17T04:27:18.064056] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-17T04:27:18.987898] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (3.10 seconds). [2025-09-17T04:27:18.998274] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-17T04:27:19.919165] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T04:27:19.931942] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-17T04:27:20.326046] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-17T04:27:20.338322] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-17T04:27:20.912039] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T04:27:20.923556] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-17T04:27:21.535791] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T04:27:21.542498] [INFO ] [REMOTE ] IOT: Full fetch complete (77211 records). [2025-09-17T04:27:21.542689] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-17T04:27:21.962761] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-17T04:27:21.962918] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-17T04:27:21.964136] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-17T04:27:21.964235] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-17T04:27:21.965934] [DEBUG] [LOCAL ] IOT: Trimmed 77211 records to 53473 (keeping 200 days of data) [2025-09-17T04:27:22.303069] [DEBUG] [LOCAL ] IOT: Primary data saved (53473 records). [2025-09-17T04:27:22.303311] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-17T04:27:22.303451] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IOT took 28.5s. Estimated remaining: 3h 2m 41s. Rate: 6.8 symbols/min [2025-09-17T04:27:22.857861] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T04:27:22.869338] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-17T04:27:22.971207] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-17T04:27:22.977688] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-17T04:27:22.977837] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-17T04:27:23.371918] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-17T04:27:23.372053] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-17T04:27:23.373078] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-17T04:27:23.373142] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-17T04:27:23.374887] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-17T04:27:23.708832] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-17T04:27:23.709039] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-17T04:27:23.709157] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IONQ took 40.2s. Estimated remaining: 3h 2m 24s. Rate: 6.9 symbols/min [2025-09-17T04:27:24.754482] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T04:27:24.766240] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-17T04:27:26.472505] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:27:26.483943] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-17T04:27:28.388324] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T04:27:28.400348] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-17T04:27:30.148067] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T04:27:30.160463] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-17T04:27:31.942471] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T04:27:31.949474] [INFO ] [REMOTE ] IP: Full fetch complete (76851 records). [2025-09-17T04:27:31.949684] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-17T04:27:32.345046] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-17T04:27:32.345193] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-17T04:27:32.346266] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-17T04:27:32.346347] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-17T04:27:32.348064] [DEBUG] [LOCAL ] IP: Trimmed 76851 records to 53330 (keeping 200 days of data) [2025-09-17T04:27:32.700417] [DEBUG] [LOCAL ] IP: Primary data saved (53330 records). [2025-09-17T04:27:32.700661] [INFO ] [MAIN ] IP: Full history saved. [2025-09-17T04:27:32.700855] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IP took 26.2s. Estimated remaining: 3h 2m 15s. Rate: 6.9 symbols/min [2025-09-17T04:27:33.258088] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.344013] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.423099] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.440362] [DEBUG] [LOCAL ] IQV: No existing data file found in primary storage. [2025-09-17T04:27:33.445963] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.446331] [WARN ] [MAIN ] IQV: No existing data found, performing full refresh instead. [2025-09-17T04:27:33.447509] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-17T04:27:33.447820] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-17T04:27:33.448013] [DEBUG] [LOCAL ] IQV: No primary data file found to delete. [2025-09-17T04:27:33.448316] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-17T04:27:33.591749] [DEBUG] [LOCAL ] IQI: Loaded 13543 existing records from primary storage. [2025-09-17T04:27:33.597447] [DEBUG] [LOCAL ] IPI: Loaded 15552 existing records from primary storage. [2025-09-17T04:27:33.647338] [INFO ] [MAIN ] IQI: Loaded 13543 existing records. [2025-09-17T04:27:33.647438] [INFO ] [MAIN ] IPI: Loaded 15552 existing records. [2025-09-17T04:27:33.675704] [DEBUG] [LOCAL ] IPG: Loaded 39697 existing records from primary storage. [2025-09-17T04:27:33.776160] [INFO ] [MAIN ] IPG: Loaded 39697 existing records. [2025-09-17T04:27:34.275686] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:34.332386] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:34.371881] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-17T04:27:34.366308] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-11. [2025-09-17T04:27:34.382075] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:34.401663] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-17T04:27:34.414072] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-17T04:27:34.414008] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-17T04:27:34.449193] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:34.449492] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-17T04:27:34.449568] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-17T04:27:34.449782] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-17T04:27:34.449932] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-17T04:27:34.449864] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-17T04:27:34.450117] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-17T04:27:34.455286] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-17T04:27:34.549375] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-17T04:27:35.380222] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:35.434892] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-11. [2025-09-17T04:27:35.608738] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:35.635731] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-11. [2025-09-17T04:27:35.635449] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:35.636999] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-11. [2025-09-17T04:27:36.025497] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:27:36.036197] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-17T04:27:36.482187] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T04:27:36.488314] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-17T04:27:36.513369] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:27:36.517260] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-17T04:27:36.941236] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T04:27:36.951896] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-17T04:27:37.158421] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T04:27:37.162390] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-17T04:27:37.335948] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T04:27:37.341140] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-17T04:27:37.500722] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:27:37.511214] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-17T04:27:37.804410] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T04:27:37.808751] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-17T04:27:37.991264] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T04:27:37.996465] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-17T04:27:38.745371] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T04:27:38.757138] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-17T04:27:38.800503] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T04:27:38.804882] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-17T04:27:38.976972] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T04:27:38.988594] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-17T04:27:39.020592] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T04:27:39.025899] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-17T04:27:39.670148] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T04:27:39.674235] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-17T04:27:39.844439] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T04:27:39.890168] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-17T04:27:40.194423] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T04:27:40.424969] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T04:27:40.690157] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-17T04:27:40.756572] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T04:27:41.487034] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T04:27:41.492243] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-17T04:27:42.163975] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T04:27:42.290237] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-17T04:27:42.419499] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T04:27:43.090146] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-17T04:27:43.863564] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T04:27:43.890119] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-17T04:27:44.055583] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T04:27:44.690208] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-17T04:27:45.279169] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T04:27:45.490197] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-17T04:27:46.290227] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-17T04:27:46.461143] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T04:27:46.517496] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T04:27:47.090172] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-17T04:27:47.561146] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T04:27:47.890166] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-17T04:27:48.123442] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T04:27:48.690135] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-17T04:27:49.490163] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-17T04:27:49.615564] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T04:27:50.049247] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T04:27:50.290097] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-17T04:27:50.478087] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T04:27:51.090135] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-17T04:27:51.853980] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:27:51.890205] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-17T04:27:52.690111] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-17T04:27:52.896312] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T04:27:53.004919] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T04:27:53.490128] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-17T04:27:53.721819] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:27:53.724635] [INFO ] [REMOTE ] IQI: Full fetch complete (27448 records). [2025-09-17T04:27:53.724775] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-17T04:27:54.103531] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-17T04:27:54.103697] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-17T04:27:54.105090] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-17T04:27:54.105197] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-17T04:27:54.106368] [DEBUG] [LOCAL ] IQI: Trimmed 27448 records to 18105 (keeping 200 days of data) [2025-09-17T04:27:54.232151] [DEBUG] [LOCAL ] IQI: Primary data saved (18105 records). [2025-09-17T04:27:54.232461] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-17T04:27:54.232625] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 21.5s. Estimated remaining: 3h 2m 21s. Rate: 6.8 symbols/min [2025-09-17T04:27:54.297735] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-17T04:27:54.421143] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:54.458344] [DEBUG] [LOCAL ] IR: Loaded 39275 existing records from primary storage. [2025-09-17T04:27:54.458551] [INFO ] [MAIN ] IR: Loaded 39275 existing records. [2025-09-17T04:27:54.698320] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:54.698627] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-17T04:27:54.698716] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-17T04:27:54.704967] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-17T04:27:54.711253] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-17T04:27:54.776845] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:27:55.075658] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:55.090093] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-11. [2025-09-17T04:27:55.890215] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-17T04:27:56.234465] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:27:56.690172] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-17T04:27:56.750296] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:27:57.316354] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:27:57.490154] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-17T04:27:58.290157] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-17T04:27:58.414000] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:27:59.090126] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-17T04:27:59.284695] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T04:27:59.316233] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:27:59.320578] [INFO ] [REMOTE ] IPI: Full fetch complete (28784 records). [2025-09-17T04:27:59.320733] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-17T04:27:59.701184] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-17T04:27:59.701308] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-17T04:27:59.701999] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-17T04:27:59.702056] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-17T04:27:59.702962] [DEBUG] [LOCAL ] IPI: Trimmed 28784 records to 21385 (keeping 200 days of data) [2025-09-17T04:27:59.831254] [DEBUG] [LOCAL ] IPI: Primary data saved (21385 records). [2025-09-17T04:27:59.831427] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-17T04:27:59.831530] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPI took 27.1s. Estimated remaining: 3h 2m 8s. Rate: 6.8 symbols/min [2025-09-17T04:27:59.895365] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-17T04:28:00.011425] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:00.056668] [DEBUG] [LOCAL ] IRM: Loaded 36386 existing records from primary storage. [2025-09-17T04:28:00.056910] [INFO ] [MAIN ] IRM: Loaded 36386 existing records. [2025-09-17T04:28:00.235085] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:00.235394] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-17T04:28:00.235448] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-17T04:28:00.236787] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-17T04:28:00.236858] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-17T04:28:00.613871] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:00.649746] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T04:28:00.690085] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-17T04:28:01.490165] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-11. [2025-09-17T04:28:01.680618] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T04:28:02.290153] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-17T04:28:02.503957] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:28:02.919759] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:28:03.090158] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-17T04:28:03.893880] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-17T04:28:03.896271] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T04:28:03.904587] [INFO ] [REMOTE ] IQV: Full fetch complete (72491 records). [2025-09-17T04:28:03.904828] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-17T04:28:04.311161] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-17T04:28:04.311284] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-17T04:28:04.312804] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-17T04:28:04.313084] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-17T04:28:04.315066] [DEBUG] [LOCAL ] IQV: Trimmed 72491 records to 50594 (keeping 200 days of data) [2025-09-17T04:28:04.643230] [DEBUG] [LOCAL ] IQV: Primary data saved (50594 records). [2025-09-17T04:28:04.643487] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-17T04:28:04.643602] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IQV took 31.9s. Estimated remaining: 3h 1m 55s. Rate: 6.8 symbols/min [2025-09-17T04:28:04.690873] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-17T04:28:04.827819] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:04.866672] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T04:28:04.882949] [DEBUG] [LOCAL ] IRS: Loaded 16397 existing records from primary storage. [2025-09-17T04:28:04.883364] [INFO ] [MAIN ] IRS: Loaded 16397 existing records. [2025-09-17T04:28:05.059725] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:05.060028] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-17T04:28:05.060093] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-17T04:28:05.060605] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-17T04:28:05.060710] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-17T04:28:05.411366] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:05.490090] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-11. [2025-09-17T04:28:05.591128] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:28:05.600831] [INFO ] [REMOTE ] IPG: Full fetch complete (77081 records). [2025-09-17T04:28:05.601052] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-17T04:28:06.012226] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-17T04:28:06.012392] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-17T04:28:06.013903] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-17T04:28:06.014000] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-17T04:28:06.019363] [DEBUG] [LOCAL ] IPG: Trimmed 77081 records to 53335 (keeping 200 days of data) [2025-09-17T04:28:06.282084] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:28:06.293847] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-17T04:28:06.409668] [DEBUG] [LOCAL ] IPG: Primary data saved (53335 records). [2025-09-17T04:28:06.409894] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-17T04:28:06.410066] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IPG took 33.7s. Estimated remaining: 3h 1m 39s. Rate: 6.9 symbols/min [2025-09-17T04:28:06.588075] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:06.631066] [DEBUG] [LOCAL ] IRT: Loaded 37574 existing records from primary storage. [2025-09-17T04:28:06.631305] [INFO ] [MAIN ] IRT: Loaded 37574 existing records. [2025-09-17T04:28:06.822150] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:06.822543] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-17T04:28:06.822747] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-17T04:28:06.829218] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-17T04:28:06.838444] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-17T04:28:06.845037] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T04:28:07.095266] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-17T04:28:07.241400] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:07.890150] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-11. [2025-09-17T04:28:08.090495] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T04:28:08.400506] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:28:08.690147] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-17T04:28:09.232576] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T04:28:09.490145] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-17T04:28:09.799457] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T04:28:10.290146] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-17T04:28:11.090106] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-17T04:28:11.223068] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T04:28:11.890113] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-17T04:28:11.946187] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:28:12.690218] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-17T04:28:12.906010] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T04:28:13.490152] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-17T04:28:13.692219] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T04:28:13.718125] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T04:28:14.290182] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-17T04:28:14.856466] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:28:15.090167] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-17T04:28:15.890117] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-17T04:28:16.037542] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T04:28:16.506625] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:28:16.690164] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-17T04:28:16.722872] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T04:28:17.490202] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-17T04:28:18.290181] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-17T04:28:18.501561] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:28:18.655950] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T04:28:19.090102] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-17T04:28:19.411627] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T04:28:19.890190] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-17T04:28:20.690173] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-17T04:28:20.843474] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:28:21.490215] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-17T04:28:21.688503] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:28:21.719896] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T04:28:22.290155] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-17T04:28:23.066096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:28:23.090097] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-17T04:28:23.365451] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T04:28:23.890152] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-17T04:28:24.589795] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:28:24.690165] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-17T04:28:24.925514] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:28:25.490220] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-17T04:28:26.290137] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-17T04:28:26.397425] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:28:26.556850] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:28:27.090158] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-17T04:28:27.788288] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:28:27.890111] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-17T04:28:28.272708] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:28:28.277222] [INFO ] [REMOTE ] IRS: Full fetch complete (31913 records). [2025-09-17T04:28:28.277383] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-17T04:28:28.694380] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-17T04:28:28.694691] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-17T04:28:28.695785] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-17T04:28:28.696571] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-17T04:28:28.696669] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-17T04:28:28.697841] [DEBUG] [LOCAL ] IRS: Trimmed 31913 records to 21041 (keeping 200 days of data) [2025-09-17T04:28:28.831594] [DEBUG] [LOCAL ] IRS: Primary data saved (21041 records). [2025-09-17T04:28:28.831781] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-17T04:28:28.831895] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IRS took 24.2s. Estimated remaining: 3h 1m 45s. Rate: 6.8 symbols/min [2025-09-17T04:28:29.008231] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:29.023080] [DEBUG] [LOCAL ] ISD: Loaded 11160 existing records from primary storage. [2025-09-17T04:28:29.023304] [INFO ] [MAIN ] ISD: Loaded 11160 existing records. [2025-09-17T04:28:29.211228] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:29.211539] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-17T04:28:29.211627] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-17T04:28:29.212209] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-17T04:28:29.212286] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-17T04:28:29.494304] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-17T04:28:29.589942] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:29.623976] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T04:28:30.290207] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-11. [2025-09-17T04:28:30.443473] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:28:30.868242] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T04:28:31.090227] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-17T04:28:31.268206] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:28:31.890248] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-17T04:28:32.690176] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-17T04:28:32.811879] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T04:28:33.490186] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-17T04:28:33.561036] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T04:28:34.290333] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-17T04:28:34.394055] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:28:34.405272] [INFO ] [REMOTE ] IR: Full fetch complete (75847 records). [2025-09-17T04:28:34.407049] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-17T04:28:34.417130] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T04:28:35.051497] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-17T04:28:35.051675] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-17T04:28:35.052927] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-17T04:28:35.053013] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-17T04:28:35.055407] [DEBUG] [LOCAL ] IR: Trimmed 75847 records to 52700 (keeping 200 days of data) [2025-09-17T04:28:35.137268] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-17T04:28:35.437173] [DEBUG] [LOCAL ] IR: Primary data saved (52700 records). [2025-09-17T04:28:35.437391] [INFO ] [MAIN ] IR: Full history saved. [2025-09-17T04:28:35.437553] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IR took 41.2s. Estimated remaining: 3h 1m 34s. Rate: 6.8 symbols/min [2025-09-17T04:28:35.611358] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:35.644340] [DEBUG] [LOCAL ] IT: Loaded 31073 existing records from primary storage. [2025-09-17T04:28:35.644531] [INFO ] [MAIN ] IT: Loaded 31073 existing records. [2025-09-17T04:28:35.826358] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:35.826722] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-17T04:28:35.826786] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-17T04:28:35.827756] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-17T04:28:35.827821] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-17T04:28:35.909672] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-17T04:28:36.217316] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T04:28:36.239729] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:36.247167] [INFO ] [REMOTE ] IRM: Full fetch complete (72122 records). [2025-09-17T04:28:36.247355] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-17T04:28:36.655479] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-17T04:28:36.656147] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-17T04:28:36.657331] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-17T04:28:36.657543] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-17T04:28:36.675765] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T04:28:36.693546] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-11. [2025-09-17T04:28:36.693445] [DEBUG] [LOCAL ] IRM: Trimmed 72122 records to 49594 (keeping 200 days of data) [2025-09-17T04:28:36.717795] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T04:28:37.066284] [DEBUG] [LOCAL ] IRM: Primary data saved (49594 records). [2025-09-17T04:28:37.066500] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-17T04:28:37.066625] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRM took 37.2s. Estimated remaining: 3h 1m 17s. Rate: 6.9 symbols/min [2025-09-17T04:28:37.241795] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:37.265711] [DEBUG] [LOCAL ] ITGR: Loaded 22250 existing records from primary storage. [2025-09-17T04:28:37.265922] [INFO ] [MAIN ] ITGR: Loaded 22250 existing records. [2025-09-17T04:28:37.457009] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:37.457342] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-17T04:28:37.457403] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-17T04:28:37.458310] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-17T04:28:37.458637] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-17T04:28:37.495368] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-17T04:28:37.840797] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:37.861735] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T04:28:38.290177] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-17T04:28:38.501728] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T04:28:39.090207] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-11. [2025-09-17T04:28:39.890133] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-17T04:28:39.946344] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T04:28:40.144510] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T04:28:40.690146] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-17T04:28:40.876968] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T04:28:41.490103] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-17T04:28:41.731288] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:28:42.290188] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-17T04:28:42.789370] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T04:28:43.090165] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-17T04:28:43.329378] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T04:28:43.890168] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-17T04:28:44.477754] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:28:44.485304] [INFO ] [REMOTE ] IRT: Full fetch complete (72169 records). [2025-09-17T04:28:44.485567] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-17T04:28:44.698199] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-17T04:28:44.895683] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-17T04:28:44.895803] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-17T04:28:44.896818] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-17T04:28:44.896902] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-17T04:28:44.898504] [DEBUG] [LOCAL ] IRT: Trimmed 72169 records to 50449 (keeping 200 days of data) [2025-09-17T04:28:45.228131] [DEBUG] [LOCAL ] IRT: Primary data saved (50449 records). [2025-09-17T04:28:45.228345] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-17T04:28:45.228504] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. IRT took 38.8s. Estimated remaining: 3h 1m 8s. Rate: 6.9 symbols/min [2025-09-17T04:28:45.399290] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:45.418285] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T04:28:45.444433] [DEBUG] [LOCAL ] ITT: Loaded 23458 existing records from primary storage. [2025-09-17T04:28:45.444761] [INFO ] [MAIN ] ITT: Loaded 23458 existing records. [2025-09-17T04:28:45.497623] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-17T04:28:45.567272] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:28:45.646132] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:45.646406] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-17T04:28:45.646469] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-17T04:28:45.647217] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-17T04:28:45.647280] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-17T04:28:46.006991] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:46.290137] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-11. [2025-09-17T04:28:46.690767] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T04:28:47.090152] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-17T04:28:47.175983] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T04:28:47.890171] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-17T04:28:48.501268] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T04:28:48.690135] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-17T04:28:48.708006] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:28:49.490189] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-17T04:28:50.187061] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:28:50.290106] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-17T04:28:50.868187] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T04:28:51.090146] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-17T04:28:51.705121] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:28:51.890159] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-17T04:28:52.491714] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T04:28:52.690163] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-17T04:28:52.923384] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T04:28:53.493201] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-17T04:28:53.496629] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T04:28:54.290157] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-17T04:28:54.980794] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:28:55.090149] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-17T04:28:55.873595] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T04:28:55.890104] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-17T04:28:56.066785] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T04:28:56.690156] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-17T04:28:57.239432] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T04:28:57.490155] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-17T04:28:58.084202] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:28:58.290146] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-17T04:28:58.709675] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T04:28:59.090142] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-17T04:28:59.679474] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:28:59.890150] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-17T04:29:00.528436] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T04:29:00.690194] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-17T04:29:01.491052] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-17T04:29:01.509334] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T04:29:01.679514] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T04:29:02.290135] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-17T04:29:02.717728] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T04:29:03.090180] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-17T04:29:03.890165] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-17T04:29:04.154252] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T04:29:04.310956] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T04:29:04.314999] [INFO ] [REMOTE ] ITGR: Full fetch complete (40806 records). [2025-09-17T04:29:04.315152] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-17T04:29:04.704480] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-17T04:29:04.755706] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-17T04:29:04.755825] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-17T04:29:04.756559] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-17T04:29:04.756617] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-17T04:29:04.757610] [DEBUG] [LOCAL ] ITGR: Trimmed 40806 records to 31609 (keeping 200 days of data) [2025-09-17T04:29:04.864258] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T04:29:04.979660] [DEBUG] [LOCAL ] ITGR: Primary data saved (31609 records). [2025-09-17T04:29:04.979865] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-17T04:29:04.979976] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. ITGR took 27.9s. Estimated remaining: 3h 1m 11s. Rate: 6.8 symbols/min [2025-09-17T04:29:05.153185] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:05.194487] [DEBUG] [LOCAL ] ITUB: Loaded 39769 existing records from primary storage. [2025-09-17T04:29:05.194713] [INFO ] [MAIN ] ITUB: Loaded 39769 existing records. [2025-09-17T04:29:05.377741] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:05.378035] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-17T04:29:05.378095] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-17T04:29:05.379151] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-17T04:29:05.379216] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-17T04:29:05.495296] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-17T04:29:05.741707] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:06.290155] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-11. [2025-09-17T04:29:06.479206] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T04:29:06.485120] [INFO ] [REMOTE ] IT: Full fetch complete (54435 records). [2025-09-17T04:29:06.485287] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-17T04:29:06.872618] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-17T04:29:06.872750] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-17T04:29:06.873655] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-17T04:29:06.873733] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-17T04:29:06.875022] [DEBUG] [LOCAL ] IT: Trimmed 54435 records to 40982 (keeping 200 days of data) [2025-09-17T04:29:07.092807] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-17T04:29:07.142676] [DEBUG] [LOCAL ] IT: Primary data saved (40982 records). [2025-09-17T04:29:07.142989] [INFO ] [MAIN ] IT: Full history saved. [2025-09-17T04:29:07.143141] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. IT took 31.7s. Estimated remaining: 3h 0m 55s. Rate: 6.8 symbols/min [2025-09-17T04:29:07.275737] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T04:29:07.354843] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:07.388859] [DEBUG] [LOCAL ] ITW: Loaded 34070 existing records from primary storage. [2025-09-17T04:29:07.389049] [INFO ] [MAIN ] ITW: Loaded 34070 existing records. [2025-09-17T04:29:07.565738] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:07.565987] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-17T04:29:07.566040] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-17T04:29:07.566984] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-17T04:29:07.567048] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-17T04:29:07.898637] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-17T04:29:07.926050] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:08.008740] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T04:29:08.010942] [INFO ] [REMOTE ] ISD: Full fetch complete (23914 records). [2025-09-17T04:29:08.011036] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-17T04:29:08.383390] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-17T04:29:08.383565] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-17T04:29:08.384248] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-17T04:29:08.384375] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-17T04:29:08.385584] [DEBUG] [LOCAL ] ISD: Trimmed 23914 records to 15843 (keeping 200 days of data) [2025-09-17T04:29:08.486287] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T04:29:08.519706] [DEBUG] [LOCAL ] ISD: Primary data saved (15843 records). [2025-09-17T04:29:08.519825] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-17T04:29:08.519911] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ISD took 39.7s. Estimated remaining: 3h 0m 38s. Rate: 6.9 symbols/min [2025-09-17T04:29:08.689584] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:08.690102] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-11. [2025-09-17T04:29:08.723751] [DEBUG] [LOCAL ] IVR: Loaded 35217 existing records from primary storage. [2025-09-17T04:29:08.723918] [INFO ] [MAIN ] IVR: Loaded 35217 existing records. [2025-09-17T04:29:08.906764] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:08.907244] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-17T04:29:08.907354] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-17T04:29:08.908289] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-17T04:29:08.908357] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-17T04:29:09.266426] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:09.406899] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T04:29:09.490090] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-17T04:29:10.269515] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T04:29:10.290079] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-17T04:29:10.643350] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T04:29:11.090181] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-17T04:29:11.894536] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-11. [2025-09-17T04:29:11.896121] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:29:12.255400] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:29:12.690205] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-17T04:29:13.490144] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-17T04:29:13.728622] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T04:29:14.290154] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-17T04:29:14.328452] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T04:29:14.715086] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T04:29:15.090149] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-17T04:29:15.890133] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-17T04:29:16.115477] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T04:29:16.690096] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-17T04:29:16.759870] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:29:16.895749] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T04:29:16.899463] [INFO ] [REMOTE ] ITT: Full fetch complete (46625 records). [2025-09-17T04:29:16.899613] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-17T04:29:17.333606] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-17T04:29:17.333734] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-17T04:29:17.334586] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-17T04:29:17.334671] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-17T04:29:17.335794] [DEBUG] [LOCAL ] ITT: Trimmed 46625 records to 33531 (keeping 200 days of data) [2025-09-17T04:29:17.501985] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-17T04:29:17.553378] [DEBUG] [LOCAL ] ITT: Primary data saved (33531 records). [2025-09-17T04:29:17.553541] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-17T04:29:17.553686] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. ITT took 32.3s. Estimated remaining: 3h 0m 30s. Rate: 6.9 symbols/min [2025-09-17T04:29:17.724123] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:17.745156] [DEBUG] [LOCAL ] IVT: Loaded 22503 existing records from primary storage. [2025-09-17T04:29:17.745308] [INFO ] [MAIN ] IVT: Loaded 22503 existing records. [2025-09-17T04:29:17.927345] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:17.927635] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-17T04:29:17.927707] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-17T04:29:17.928424] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-17T04:29:17.928495] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-17T04:29:18.299938] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:18.293639] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-17T04:29:18.335181] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T04:29:19.090220] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-11. [2025-09-17T04:29:19.221195] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T04:29:19.890097] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-17T04:29:19.984476] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T04:29:20.369292] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T04:29:20.690190] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-17T04:29:21.274669] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T04:29:21.490199] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-17T04:29:21.959482] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T04:29:22.290169] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-17T04:29:23.089341] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:29:23.097798] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-17T04:29:23.890150] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-17T04:29:24.101807] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:29:24.690183] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-17T04:29:24.880866] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:29:24.931423] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:29:25.490161] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-17T04:29:26.290154] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-17T04:29:26.341612] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:29:26.829677] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:29:27.090241] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-17T04:29:27.890137] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-17T04:29:28.005812] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T04:29:28.075380] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T04:29:28.690192] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-17T04:29:29.398135] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T04:29:29.490158] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-17T04:29:29.895984] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T04:29:30.290139] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-17T04:29:31.090145] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-17T04:29:31.285173] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:29:31.890168] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-17T04:29:32.037234] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T04:29:32.160613] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:29:32.690148] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-17T04:29:33.165088] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T04:29:33.490178] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-17T04:29:34.290173] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-17T04:29:34.461773] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:29:35.090153] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-17T04:29:35.211122] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T04:29:35.239860] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T04:29:35.890140] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-17T04:29:36.695211] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-17T04:29:36.709839] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T04:29:37.490095] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-17T04:29:37.773025] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T04:29:37.961125] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T04:29:38.290147] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-17T04:29:39.039345] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:29:39.090088] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-17T04:29:39.525570] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T04:29:39.533771] [INFO ] [REMOTE ] ITW: Full fetch complete (66571 records). [2025-09-17T04:29:39.533984] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-17T04:29:39.890178] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-17T04:29:39.929145] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-17T04:29:39.929251] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-17T04:29:39.930292] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-17T04:29:39.930371] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-17T04:29:39.931957] [DEBUG] [LOCAL ] ITW: Trimmed 66571 records to 46545 (keeping 200 days of data) [2025-09-17T04:29:40.229391] [DEBUG] [LOCAL ] ITW: Primary data saved (46545 records). [2025-09-17T04:29:40.229568] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-17T04:29:40.229679] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITW took 33.1s. Estimated remaining: 3h 0m 36s. Rate: 6.8 symbols/min [2025-09-17T04:29:40.398461] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:40.455140] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T04:29:40.462938] [DEBUG] [LOCAL ] IVZ: Loaded 39555 existing records from primary storage. [2025-09-17T04:29:40.463473] [INFO ] [MAIN ] IVZ: Loaded 39555 existing records. [2025-09-17T04:29:40.647616] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:40.648022] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-17T04:29:40.648090] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-17T04:29:40.649296] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-17T04:29:40.649365] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-17T04:29:40.695344] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-17T04:29:41.021291] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:41.490208] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-17T04:29:41.729728] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T04:29:41.958149] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T04:29:42.290201] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-17T04:29:42.832709] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:29:43.090191] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-11. [2025-09-17T04:29:43.792268] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:29:43.798403] [INFO ] [REMOTE ] IVR: Full fetch complete (68664 records). [2025-09-17T04:29:43.798660] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-17T04:29:43.895247] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-17T04:29:44.204637] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-17T04:29:44.204786] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-17T04:29:44.205765] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-17T04:29:44.205838] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-17T04:29:44.207475] [DEBUG] [LOCAL ] IVR: Trimmed 68664 records to 47725 (keeping 200 days of data) [2025-09-17T04:29:44.505382] [DEBUG] [LOCAL ] IVR: Primary data saved (47725 records). [2025-09-17T04:29:44.505580] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-17T04:29:44.505701] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. IVR took 36.0s. Estimated remaining: 3h 0m 23s. Rate: 6.8 symbols/min [2025-09-17T04:29:44.684587] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:44.690130] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-17T04:29:44.705519] [DEBUG] [LOCAL ] IX: Loaded 16330 existing records from primary storage. [2025-09-17T04:29:44.705685] [INFO ] [MAIN ] IX: Loaded 16330 existing records. [2025-09-17T04:29:44.888190] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:44.888574] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-17T04:29:44.888683] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-17T04:29:44.916410] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-17T04:29:44.917671] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T04:29:44.921482] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-17T04:29:45.292429] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:45.490133] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-11. [2025-09-17T04:29:45.824535] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T04:29:45.872459] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:29:45.876272] [INFO ] [REMOTE ] IVT: Full fetch complete (45511 records). [2025-09-17T04:29:45.876380] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-17T04:29:46.178845] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T04:29:46.263928] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-17T04:29:46.264037] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-17T04:29:46.264862] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-17T04:29:46.264922] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-17T04:29:46.266053] [DEBUG] [LOCAL ] IVT: Trimmed 45511 records to 31028 (keeping 200 days of data) [2025-09-17T04:29:46.322290] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-17T04:29:46.457354] [DEBUG] [LOCAL ] IVT: Primary data saved (31028 records). [2025-09-17T04:29:46.457528] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-17T04:29:46.457683] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. IVT took 28.9s. Estimated remaining: 3h 0m 7s. Rate: 6.9 symbols/min [2025-09-17T04:29:46.627694] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:46.656889] [DEBUG] [LOCAL ] J: Loaded 29574 existing records from primary storage. [2025-09-17T04:29:46.657095] [INFO ] [MAIN ] J: Loaded 29574 existing records. [2025-09-17T04:29:46.834472] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:46.834830] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-17T04:29:46.834901] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-17T04:29:46.835770] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-17T04:29:46.835841] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-17T04:29:47.095256] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-17T04:29:47.195558] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:47.890169] [INFO ] [REMOTE ] J: Fetching primary data for 2024-11. [2025-09-17T04:29:48.151927] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T04:29:48.690236] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-17T04:29:48.823750] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T04:29:48.993062] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:29:49.490147] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-17T04:29:50.290175] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-17T04:29:50.481000] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T04:29:50.489409] [INFO ] [REMOTE ] ITUB: Full fetch complete (77026 records). [2025-09-17T04:29:50.489609] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-17T04:29:50.887872] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-17T04:29:50.888000] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-17T04:29:50.889173] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-17T04:29:50.889242] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-17T04:29:50.890943] [DEBUG] [LOCAL ] ITUB: Trimmed 77026 records to 53304 (keeping 200 days of data) [2025-09-17T04:29:51.006100] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T04:29:51.093374] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-17T04:29:51.171742] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:29:51.291222] [DEBUG] [LOCAL ] ITUB: Primary data saved (53304 records). [2025-09-17T04:29:51.291423] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-17T04:29:51.291540] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. ITUB took 46.3s. Estimated remaining: 2h 59m 54s. Rate: 6.9 symbols/min [2025-09-17T04:29:51.461276] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:51.500043] [DEBUG] [LOCAL ] JBGS: Loaded 31570 existing records from primary storage. [2025-09-17T04:29:51.500245] [INFO ] [MAIN ] JBGS: Loaded 31570 existing records. [2025-09-17T04:29:51.689552] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T04:29:51.697638] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:51.697946] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-17T04:29:51.698010] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-17T04:29:51.698855] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-17T04:29:51.698927] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-17T04:29:51.895229] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-17T04:29:52.059863] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:52.690156] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-17T04:29:53.428425] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:29:53.490184] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-11. [2025-09-17T04:29:54.290210] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-17T04:29:54.406095] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T04:29:54.888406] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T04:29:55.090195] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-17T04:29:55.721909] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T04:29:55.890134] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-17T04:29:56.444380] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T04:29:56.690212] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-17T04:29:57.490142] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-17T04:29:57.776159] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T04:29:58.065843] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T04:29:58.290144] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-17T04:29:58.970189] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T04:29:59.090139] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-17T04:29:59.167092] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T04:29:59.890163] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-17T04:30:00.690148] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-17T04:30:01.005717] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T04:30:01.490195] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-17T04:30:01.533624] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T04:30:01.581609] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T04:30:02.290149] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-17T04:30:03.090150] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-17T04:30:03.890154] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-17T04:30:05.357518] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (3.87 seconds). [2025-09-17T04:30:05.371249] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-17T04:30:05.499696] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:30:05.505003] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-17T04:30:05.671475] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (3.38 seconds). [2025-09-17T04:30:06.290132] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-17T04:30:06.416709] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (3.33 seconds). [2025-09-17T04:30:06.526165] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T04:30:06.900738] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T04:30:07.090166] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-17T04:30:07.890132] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-17T04:30:07.955141] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:30:08.472297] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:30:08.690180] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-17T04:30:09.490136] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-17T04:30:09.682624] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T04:30:10.014175] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:30:10.290167] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-17T04:30:10.389229] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T04:30:11.090141] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-17T04:30:11.745915] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:30:11.890190] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-17T04:30:12.173580] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T04:30:12.690193] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-17T04:30:13.420818] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T04:30:13.490101] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-17T04:30:14.186351] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T04:30:14.290181] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-17T04:30:14.652587] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T04:30:14.657952] [INFO ] [REMOTE ] J: Full fetch complete (59153 records). [2025-09-17T04:30:14.658119] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-17T04:30:15.055918] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-17T04:30:15.056043] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-17T04:30:15.056904] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-17T04:30:15.056962] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-17T04:30:15.058218] [DEBUG] [LOCAL ] J: Trimmed 59153 records to 40591 (keeping 200 days of data) [2025-09-17T04:30:15.117287] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-17T04:30:15.338943] [DEBUG] [LOCAL ] J: Primary data saved (40591 records). [2025-09-17T04:30:15.339177] [INFO ] [MAIN ] J: Full history saved. [2025-09-17T04:30:15.339319] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. J took 28.9s. Estimated remaining: 3h 0m 1s. Rate: 6.8 symbols/min [2025-09-17T04:30:15.523509] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:15.564280] [DEBUG] [LOCAL ] JBI: Loaded 31900 existing records from primary storage. [2025-09-17T04:30:15.564570] [INFO ] [MAIN ] JBI: Loaded 31900 existing records. [2025-09-17T04:30:15.755667] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:15.756145] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-17T04:30:15.756379] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-17T04:30:15.757359] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-17T04:30:15.757437] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-17T04:30:15.905670] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-17T04:30:15.957963] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T04:30:16.181620] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:16.548373] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:30:16.690218] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-11. [2025-09-17T04:30:17.490149] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-17T04:30:18.290131] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-17T04:30:18.717060] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-17T04:30:18.949546] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T04:30:19.090173] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-17T04:30:19.289746] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T04:30:19.410114] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-11 (2.72 seconds). [2025-09-17T04:30:19.890204] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-17T04:30:20.687936] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T04:30:20.703258] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-17T04:30:21.490127] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-17T04:30:21.558338] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:30:21.642220] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:30:21.645138] [INFO ] [REMOTE ] IX: Full fetch complete (26394 records). [2025-09-17T04:30:21.645241] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-17T04:30:22.018475] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-17T04:30:22.018599] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-17T04:30:22.019240] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-17T04:30:22.019306] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-17T04:30:22.021005] [DEBUG] [LOCAL ] IX: Trimmed 26394 records to 22934 (keeping 200 days of data) [2025-09-17T04:30:22.165292] [DEBUG] [LOCAL ] IX: Primary data saved (22934 records). [2025-09-17T04:30:22.165487] [INFO ] [MAIN ] IX: Full history saved. [2025-09-17T04:30:22.165606] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IX took 37.7s. Estimated remaining: 2h 59m 51s. Rate: 6.8 symbols/min [2025-09-17T04:30:22.295251] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-17T04:30:22.349577] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:22.396716] [DEBUG] [LOCAL ] JBL: Loaded 35457 existing records from primary storage. [2025-09-17T04:30:22.396976] [INFO ] [MAIN ] JBL: Loaded 35457 existing records. [2025-09-17T04:30:22.581905] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:22.582404] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-17T04:30:22.582485] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-17T04:30:22.583349] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-17T04:30:22.583415] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-17T04:30:22.946866] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:22.960556] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:30:22.967661] [INFO ] [REMOTE ] JBGS: Full fetch complete (58599 records). [2025-09-17T04:30:22.967785] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-17T04:30:23.095204] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-17T04:30:23.397329] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-17T04:30:23.397438] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-17T04:30:23.398371] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-17T04:30:23.398449] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-17T04:30:23.400194] [DEBUG] [LOCAL ] JBGS: Trimmed 58599 records to 42383 (keeping 200 days of data) [2025-09-17T04:30:23.667230] [DEBUG] [LOCAL ] JBGS: Primary data saved (42383 records). [2025-09-17T04:30:23.667398] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-17T04:30:23.667516] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. JBGS took 32.4s. Estimated remaining: 2h 59m 34s. Rate: 6.8 symbols/min [2025-09-17T04:30:23.846866] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:23.868630] [DEBUG] [LOCAL ] JBND: Loaded 19070 existing records from primary storage. [2025-09-17T04:30:23.868832] [INFO ] [MAIN ] JBND: Loaded 19070 existing records. [2025-09-17T04:30:23.900796] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-11. [2025-09-17T04:30:24.053744] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:24.054167] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-17T04:30:24.054263] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-17T04:30:24.055110] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-17T04:30:24.055188] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-17T04:30:24.178392] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T04:30:24.267754] [INFO ] [REMOTE ] IVZ: Full fetch complete (76518 records). [2025-09-17T04:30:24.335078] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-17T04:30:24.559954] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:24.696735] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-11. [2025-09-17T04:30:24.854888] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-17T04:30:24.855054] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-17T04:30:24.856268] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-17T04:30:24.856405] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-17T04:30:24.858850] [DEBUG] [LOCAL ] IVZ: Trimmed 76518 records to 53141 (keeping 200 days of data) [2025-09-17T04:30:24.983326] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T04:30:25.241551] [DEBUG] [LOCAL ] IVZ: Primary data saved (53141 records). [2025-09-17T04:30:25.241780] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-17T04:30:25.241942] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. IVZ took 45.0s. Estimated remaining: 2h 59m 17s. Rate: 6.9 symbols/min [2025-09-17T04:30:25.419761] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:25.419970] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-17T04:30:25.420021] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-17T04:30:25.420131] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-17T04:30:25.420184] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-17T04:30:25.420236] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-17T04:30:25.420281] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-17T04:30:25.495275] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-17T04:30:25.760620] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T04:30:25.804033] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:25.833994] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T04:30:26.290150] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-17T04:30:26.842833] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T04:30:27.090140] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-17T04:30:27.601784] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:30:27.890197] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-17T04:30:28.533054] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T04:30:28.690166] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-17T04:30:28.785148] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:30:29.490158] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-17T04:30:30.272546] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T04:30:30.290088] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-11. [2025-09-17T04:30:30.447251] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T04:30:30.495528] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:30.495936] [WARN ] [REMOTE ] JBS: No data returned for month 2024-11 [2025-09-17T04:30:31.090140] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-17T04:30:31.360396] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:31.360771] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-17T04:30:31.890155] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-17T04:30:32.690177] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-17T04:30:33.446289] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:30:33.493249] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-17T04:30:33.497942] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T04:30:34.290228] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-17T04:30:35.087750] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T04:30:35.091094] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-17T04:30:35.356149] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T04:30:35.890178] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-17T04:30:36.672145] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T04:30:36.690093] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-17T04:30:37.490142] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-17T04:30:37.658784] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:30:37.676533] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:37.677084] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-17T04:30:38.093069] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T04:30:38.290179] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-17T04:30:39.090142] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-17T04:30:39.890174] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-17T04:30:40.087327] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:40.087714] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-17T04:30:40.141196] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T04:30:40.640602] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:30:40.690112] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-17T04:30:41.490165] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-17T04:30:41.684877] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:41.685300] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-17T04:30:42.168594] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:30:42.290142] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-17T04:30:42.475495] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:42.476030] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-17T04:30:43.090165] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-17T04:30:43.271332] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:43.271622] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-17T04:30:43.890216] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-17T04:30:44.690192] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-17T04:30:45.113182] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T04:30:45.490191] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-17T04:30:46.162985] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T04:30:46.290156] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-17T04:30:46.629408] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T04:30:47.090211] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-17T04:30:47.890138] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-17T04:30:47.924823] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T04:30:48.165270] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T04:30:48.690153] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-17T04:30:49.285885] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T04:30:49.294843] [INFO ] [REMOTE ] JBI: Full fetch complete (64644 records). [2025-09-17T04:30:49.295176] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-17T04:30:49.492304] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-17T04:30:49.702357] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-17T04:30:49.702473] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-17T04:30:49.703428] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-17T04:30:49.703496] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-17T04:30:49.705243] [DEBUG] [LOCAL ] JBI: Trimmed 64644 records to 44256 (keeping 200 days of data) [2025-09-17T04:30:49.982093] [DEBUG] [LOCAL ] JBI: Primary data saved (44256 records). [2025-09-17T04:30:49.982280] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-17T04:30:49.982437] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBI took 34.6s. Estimated remaining: 2h 59m 26s. Rate: 6.8 symbols/min [2025-09-17T04:30:50.161351] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:50.188403] [DEBUG] [LOCAL ] JBTM: Loaded 24015 existing records from primary storage. [2025-09-17T04:30:50.188699] [INFO ] [MAIN ] JBTM: Loaded 24015 existing records. [2025-09-17T04:30:50.291136] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-17T04:30:50.372250] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:50.372507] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-17T04:30:50.372583] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-17T04:30:50.373537] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-09-17T04:30:50.373602] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-17T04:30:50.736991] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:50.771066] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T04:30:50.979907] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T04:30:51.090127] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-17T04:30:51.479425] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T04:30:51.890171] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-17T04:30:52.690193] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-17T04:30:52.889597] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:30:53.490149] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-17T04:30:53.713683] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T04:30:53.861252] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:30:54.290192] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-11. [2025-09-17T04:30:54.512051] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:54.512437] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-11 [2025-09-17T04:30:55.090152] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-17T04:30:55.143614] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:30:55.151544] [INFO ] [REMOTE ] JBL: Full fetch complete (69615 records). [2025-09-17T04:30:55.151749] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-17T04:30:55.549131] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-17T04:30:55.549247] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-17T04:30:55.550191] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-17T04:30:55.550252] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-17T04:30:55.551772] [DEBUG] [LOCAL ] JBL: Trimmed 69615 records to 48381 (keeping 200 days of data) [2025-09-17T04:30:55.862556] [DEBUG] [LOCAL ] JBL: Primary data saved (48381 records). [2025-09-17T04:30:55.862751] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-17T04:30:55.862861] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBL took 33.7s. Estimated remaining: 2h 59m 14s. Rate: 6.8 symbols/min [2025-09-17T04:30:55.895184] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-17T04:30:56.034341] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:56.041491] [DEBUG] [LOCAL ] JCE: Loaded 4761 existing records from primary storage. [2025-09-17T04:30:56.041629] [INFO ] [MAIN ] JCE: Loaded 4761 existing records. [2025-09-17T04:30:56.220087] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:56.220389] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-17T04:30:56.220479] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-17T04:30:56.220806] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-17T04:30:56.220867] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-17T04:30:56.588411] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:56.690133] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-11. [2025-09-17T04:30:56.867178] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T04:30:56.873480] [INFO ] [REMOTE ] JBS: Full fetch complete (24448 records). [2025-09-17T04:30:56.873622] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-17T04:30:57.066693] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 64 unique days, need 200 days [2025-09-17T04:30:57.067126] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:30:57.067215] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:30:57.067293] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-17T04:30:57.067395] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-17T04:30:57.067466] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-17T04:30:57.067552] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-17T04:30:57.067680] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBS took 31.8s. Estimated remaining: 2h 58m 57s. Rate: 6.9 symbols/min [2025-09-17T04:30:57.251748] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:57.248028] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T04:30:57.275722] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T04:30:57.322551] [DEBUG] [LOCAL ] JCI: Loaded 39917 existing records from primary storage. [2025-09-17T04:30:57.322772] [INFO ] [MAIN ] JCI: Loaded 39917 existing records. [2025-09-17T04:30:57.499012] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-17T04:30:57.507162] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:57.508129] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-17T04:30:57.508211] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-17T04:30:57.509194] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-17T04:30:57.509272] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-17T04:30:57.757298] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:57.789284] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-17T04:30:57.866936] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:58.290151] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-17T04:30:59.019421] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T04:30:59.090145] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-17T04:30:59.890089] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-11. [2025-09-17T04:31:00.365578] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:31:00.690132] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-17T04:31:01.344823] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T04:31:01.490119] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-17T04:31:01.637882] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:31:02.091101] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:31:02.290140] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-17T04:31:03.090132] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-17T04:31:03.570408] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T04:31:03.574816] [INFO ] [REMOTE ] JBND: Full fetch complete (32501 records). [2025-09-17T04:31:03.574928] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-17T04:31:03.779010] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T04:31:03.895178] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-17T04:31:03.973711] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-17T04:31:03.973869] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-17T04:31:03.974718] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-17T04:31:03.974781] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-17T04:31:03.975790] [DEBUG] [LOCAL ] JBND: Trimmed 32501 records to 24961 (keeping 200 days of data) [2025-09-17T04:31:04.140051] [DEBUG] [LOCAL ] JBND: Primary data saved (24961 records). [2025-09-17T04:31:04.140222] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-17T04:31:04.140325] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JBND took 40.5s. Estimated remaining: 2h 58m 47s. Rate: 6.9 symbols/min [2025-09-17T04:31:04.312091] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:04.355835] [DEBUG] [LOCAL ] JEF: Loaded 36773 existing records from primary storage. [2025-09-17T04:31:04.356073] [INFO ] [MAIN ] JEF: Loaded 36773 existing records. [2025-09-17T04:31:04.533578] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:04.533897] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-17T04:31:04.533972] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-17T04:31:04.534939] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-17T04:31:04.535011] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-17T04:31:04.691421] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-17T04:31:04.917182] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:05.213886] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T04:31:05.490165] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-11. [2025-09-17T04:31:06.290164] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-17T04:31:06.573591] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T04:31:07.028188] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T04:31:07.090140] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-17T04:31:07.175565] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T04:31:07.890175] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-17T04:31:08.471512] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T04:31:08.642526] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T04:31:08.690089] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-17T04:31:09.369205] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T04:31:09.490141] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-17T04:31:10.289973] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T04:31:10.290160] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-17T04:31:11.090183] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-17T04:31:11.775473] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T04:31:11.890135] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-17T04:31:11.983695] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T04:31:12.686367] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T04:31:12.688180] [INFO ] [REMOTE ] JCE: Full fetch complete (8788 records). [2025-09-17T04:31:12.688271] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-17T04:31:12.699689] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-17T04:31:13.060907] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-17T04:31:13.061026] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-17T04:31:13.061394] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-17T04:31:13.061456] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-17T04:31:13.061985] [DEBUG] [LOCAL ] JCE: Trimmed 8788 records to 6270 (keeping 200 days of data) [2025-09-17T04:31:13.103573] [DEBUG] [LOCAL ] JCE: Primary data saved (6270 records). [2025-09-17T04:31:13.103786] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-17T04:31:13.103898] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JCE took 17.2s. Estimated remaining: 2h 58m 38s. Rate: 6.9 symbols/min [2025-09-17T04:31:13.277074] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:13.312276] [DEBUG] [LOCAL ] JELD: Loaded 34406 existing records from primary storage. [2025-09-17T04:31:13.312499] [INFO ] [MAIN ] JELD: Loaded 34406 existing records. [2025-09-17T04:31:13.500926] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-17T04:31:13.506992] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:13.508240] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-17T04:31:13.508307] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-17T04:31:13.509106] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-17T04:31:13.509184] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-17T04:31:13.867220] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:14.290194] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-17T04:31:14.591600] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T04:31:15.090159] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-11. [2025-09-17T04:31:15.208418] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T04:31:15.276592] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:31:15.890148] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-17T04:31:16.605772] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:31:16.690181] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-17T04:31:17.490196] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-17T04:31:17.710449] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T04:31:18.111733] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:31:18.290171] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-17T04:31:19.090127] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-17T04:31:19.148892] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:31:19.468940] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:31:19.890202] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-17T04:31:20.555377] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:31:20.690123] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-17T04:31:21.490217] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-17T04:31:21.710470] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T04:31:22.006004] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T04:31:22.290221] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-17T04:31:23.090097] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-17T04:31:23.136757] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T04:31:23.568960] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T04:31:23.890197] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-17T04:31:24.474774] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:31:24.690187] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-17T04:31:25.330790] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T04:31:25.490193] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-17T04:31:26.290170] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-17T04:31:26.421312] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T04:31:26.503095] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T04:31:27.090195] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-17T04:31:27.890126] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-17T04:31:27.934796] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T04:31:28.442441] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:31:28.690152] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-17T04:31:29.362105] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:31:29.490531] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-17T04:31:29.998700] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T04:31:30.290225] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-17T04:31:31.090119] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-17T04:31:31.233749] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:31:31.890156] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-17T04:31:32.174453] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T04:31:32.690229] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-17T04:31:32.792895] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:31:33.214230] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:31:33.490187] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-17T04:31:34.037896] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:31:34.042345] [INFO ] [REMOTE ] JBTM: Full fetch complete (40552 records). [2025-09-17T04:31:34.042498] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-17T04:31:34.232606] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 175 unique days, need 200 days [2025-09-17T04:31:34.233105] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:31:34.233156] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:31:34.233201] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-17T04:31:34.233264] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-17T04:31:34.233315] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-17T04:31:34.233677] [DEBUG] [LOCAL ] JBTM: Deleted derivative data file. [2025-09-17T04:31:34.233775] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBTM took 44.3s. Estimated remaining: 2h 58m 43s. Rate: 6.8 symbols/min [2025-09-17T04:31:34.296989] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-17T04:31:34.410085] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:34.418469] [DEBUG] [LOCAL ] JEQ: Loaded 5934 existing records from primary storage. [2025-09-17T04:31:34.418636] [INFO ] [MAIN ] JEQ: Loaded 5934 existing records. [2025-09-17T04:31:34.604317] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:34.604628] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-17T04:31:34.604709] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-17T04:31:34.604985] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-17T04:31:34.605043] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-17T04:31:34.976546] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:35.005680] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T04:31:35.090182] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-11. [2025-09-17T04:31:35.637210] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T04:31:35.890154] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-17T04:31:36.108351] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T04:31:36.548105] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T04:31:36.690123] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-17T04:31:37.319620] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T04:31:37.490218] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-17T04:31:37.588340] [DEBUG] [REMOTE ] JCI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-17T04:31:37.588749] [WARN ] [REMOTE ] JCI: No data returned for month 2025-09 [2025-09-17T04:31:37.588842] [INFO ] [REMOTE ] JCI: Full fetch complete (72964 records). [2025-09-17T04:31:37.588937] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-17T04:31:37.590507] [FATAL] [VALIDATOR ] JCI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T04:31:37.590623] [FATAL] [MAIN ] JCI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:31:37.590695] [WARN ] [MAIN ] JCI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:31:37.590743] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-17T04:31:37.590823] [DEBUG] [LOCAL ] JCI: No primary data file found to delete. [2025-09-17T04:31:37.590941] [INFO ] [LOCAL ] JCI: Starting deletion of derivative data. [2025-09-17T04:31:37.591340] [DEBUG] [LOCAL ] JCI: Deleted derivative data file. [2025-09-17T04:31:37.591483] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 40.5s. Estimated remaining: 2h 58m 28s. Rate: 6.8 symbols/min [2025-09-17T04:31:37.774126] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:37.796170] [DEBUG] [LOCAL ] JFR: Loaded 21662 existing records from primary storage. [2025-09-17T04:31:37.796362] [INFO ] [MAIN ] JFR: Loaded 21662 existing records. [2025-09-17T04:31:37.976722] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:37.976971] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-17T04:31:37.977032] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-17T04:31:37.977815] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-17T04:31:37.977881] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-17T04:31:38.295323] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-17T04:31:38.362473] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:38.973376] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T04:31:39.090220] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-17T04:31:39.890158] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-17T04:31:40.015912] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T04:31:40.690208] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-17T04:31:41.416020] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T04:31:41.490101] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-17T04:31:41.633879] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:31:42.199962] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T04:31:42.290175] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-11. [2025-09-17T04:31:43.090108] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-17T04:31:43.550412] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T04:31:43.554306] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T04:31:43.890142] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-17T04:31:44.690165] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-17T04:31:45.213512] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:31:45.390264] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T04:31:45.490204] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-17T04:31:46.290175] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-17T04:31:46.702362] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T04:31:47.090144] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-17T04:31:47.848592] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:31:47.890127] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-17T04:31:48.582957] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T04:31:48.690170] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-17T04:31:49.141739] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T04:31:49.490388] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-17T04:31:50.085695] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T04:31:50.290151] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-17T04:31:51.051390] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:31:51.090191] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-17T04:31:51.461848] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T04:31:51.890161] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-17T04:31:51.955989] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T04:31:52.690196] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-17T04:31:53.490222] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-17T04:31:53.522409] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:31:53.528434] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T04:31:53.530278] [INFO ] [REMOTE ] JEQ: Full fetch complete (11228 records). [2025-09-17T04:31:53.530410] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-17T04:31:53.530494] [INFO ] [REMOTE ] JEF: Full fetch complete (72601 records). [2025-09-17T04:31:53.536214] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-17T04:31:54.272373] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-17T04:31:54.278618] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-17T04:31:54.294154] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-17T04:31:54.295560] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-17T04:31:54.312824] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-17T04:31:54.392518] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-17T04:31:54.392897] [DEBUG] [LOCAL ] JEQ: Trimmed 11228 records to 8973 (keeping 200 days of data) [2025-09-17T04:31:54.393405] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-17T04:31:54.395765] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-17T04:31:54.396196] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-17T04:31:54.449088] [DEBUG] [LOCAL ] JEF: Trimmed 72601 records to 49988 (keeping 200 days of data) [2025-09-17T04:31:54.523798] [DEBUG] [LOCAL ] JEQ: Primary data saved (8973 records). [2025-09-17T04:31:54.537840] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-17T04:31:54.567226] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JEQ took 20.3s. Estimated remaining: 2h 58m 28s. Rate: 6.8 symbols/min [2025-09-17T04:31:54.760821] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:54.791030] [DEBUG] [LOCAL ] JGH: Loaded 8121 existing records from primary storage. [2025-09-17T04:31:54.856890] [INFO ] [MAIN ] JGH: Loaded 8121 existing records. [2025-09-17T04:31:54.977998] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T04:31:55.031442] [INFO ] [REMOTE ] JELD: Full fetch complete (63014 records). [2025-09-17T04:31:55.064871] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-17T04:31:55.108210] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:55.164444] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-17T04:31:55.185889] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-17T04:31:55.191909] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-17T04:31:55.197334] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-17T04:31:55.848946] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-17T04:31:55.876242] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-17T04:31:55.880740] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-17T04:31:55.881148] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-17T04:31:55.975014] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:55.977314] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T04:31:55.978717] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-11. [2025-09-17T04:31:55.989021] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-17T04:31:55.994660] [DEBUG] [LOCAL ] JELD: Trimmed 63014 records to 46260 (keeping 200 days of data) [2025-09-17T04:31:56.054160] [DEBUG] [LOCAL ] JEF: Primary data saved (49988 records). [2025-09-17T04:31:56.080532] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-17T04:31:56.084821] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JEF took 51.9s. Estimated remaining: 2h 58m 11s. Rate: 6.8 symbols/min [2025-09-17T04:31:56.279226] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:56.414249] [DEBUG] [LOCAL ] JHG: Loaded 35502 existing records from primary storage. [2025-09-17T04:31:56.415401] [INFO ] [MAIN ] JHG: Loaded 35502 existing records. [2025-09-17T04:31:56.630802] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:56.632395] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-17T04:31:56.633289] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-17T04:31:56.634254] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-17T04:31:56.635146] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-17T04:31:56.753230] [DEBUG] [LOCAL ] JELD: Primary data saved (46260 records). [2025-09-17T04:31:56.763700] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-17T04:31:56.820986] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JELD took 43.7s. Estimated remaining: 2h 57m 54s. Rate: 6.9 symbols/min [2025-09-17T04:31:56.989122] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T04:31:57.015379] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-17T04:31:57.143178] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:57.190809] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:57.197126] [DEBUG] [LOCAL ] JHI: Loaded 2505 existing records from primary storage. [2025-09-17T04:31:57.197260] [INFO ] [MAIN ] JHI: Loaded 2505 existing records. [2025-09-17T04:31:57.377512] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:57.383490] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-17T04:31:57.392896] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-17T04:31:57.393870] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T04:31:57.393907] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-17T04:31:57.394061] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-17T04:31:57.498255] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-17T04:31:57.759262] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:57.889078] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T04:31:58.290142] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-17T04:31:58.957567] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:31:58.971560] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T04:31:59.090125] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-17T04:31:59.508361] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T04:31:59.890130] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-11. [2025-09-17T04:32:00.690147] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-17T04:32:01.490138] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-11. [2025-09-17T04:32:01.554506] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:32:01.917965] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T04:32:02.010697] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T04:32:02.290146] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-17T04:32:03.090166] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-17T04:32:03.546691] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:32:03.550743] [INFO ] [REMOTE ] JFR: Full fetch complete (47868 records). [2025-09-17T04:32:03.550862] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-17T04:32:03.681681] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T04:32:03.895334] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-17T04:32:03.971541] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-17T04:32:03.971693] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-17T04:32:03.972803] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-17T04:32:03.972934] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-17T04:32:03.974358] [DEBUG] [LOCAL ] JFR: Trimmed 47868 records to 30705 (keeping 200 days of data) [2025-09-17T04:32:04.182594] [DEBUG] [LOCAL ] JFR: Primary data saved (30705 records). [2025-09-17T04:32:04.182894] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-17T04:32:04.183051] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JFR took 26.6s. Estimated remaining: 2h 57m 44s. Rate: 6.9 symbols/min [2025-09-17T04:32:04.361932] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:04.366242] [DEBUG] [LOCAL ] JHS: Loaded 2298 existing records from primary storage. [2025-09-17T04:32:04.366344] [INFO ] [MAIN ] JHS: Loaded 2298 existing records. [2025-09-17T04:32:04.546487] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:04.546823] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-17T04:32:04.546886] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-17T04:32:04.547137] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-17T04:32:04.547194] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-17T04:32:04.651746] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T04:32:04.695277] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-17T04:32:04.911309] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:05.490226] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-17T04:32:06.269133] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T04:32:06.290098] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-17T04:32:06.457683] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T04:32:07.090220] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-17T04:32:07.166472] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T04:32:07.585556] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T04:32:07.890213] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-11. [2025-09-17T04:32:08.245611] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T04:32:08.690210] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-17T04:32:09.490202] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-17T04:32:10.267230] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:32:10.296009] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-17T04:32:10.315683] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:32:10.675190] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T04:32:11.090137] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-17T04:32:11.890153] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-17T04:32:12.644116] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T04:32:12.690152] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-17T04:32:12.702568] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T04:32:13.490152] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-17T04:32:14.119001] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T04:32:14.290161] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-17T04:32:14.510088] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:32:14.938865] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T04:32:15.090136] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-17T04:32:15.635803] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T04:32:15.890145] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-17T04:32:16.381685] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T04:32:16.690171] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-17T04:32:17.490153] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-17T04:32:17.504389] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T04:32:18.290156] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-17T04:32:19.090115] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-17T04:32:19.145693] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T04:32:19.215939] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T04:32:19.218837] [INFO ] [REMOTE ] JGH: Full fetch complete (14595 records). [2025-09-17T04:32:19.218956] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-17T04:32:19.588372] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-17T04:32:19.588521] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-17T04:32:19.589065] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-17T04:32:19.589130] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-17T04:32:19.589873] [DEBUG] [LOCAL ] JGH: Trimmed 14595 records to 10937 (keeping 200 days of data) [2025-09-17T04:32:19.662523] [DEBUG] [LOCAL ] JGH: Primary data saved (10937 records). [2025-09-17T04:32:19.662730] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-17T04:32:19.662844] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JGH took 25.1s. Estimated remaining: 2h 57m 42s. Rate: 6.8 symbols/min [2025-09-17T04:32:19.770908] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T04:32:19.845840] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:19.882867] [DEBUG] [LOCAL ] JHX: Loaded 39604 existing records from primary storage. [2025-09-17T04:32:19.883043] [INFO ] [MAIN ] JHX: Loaded 39604 existing records. [2025-09-17T04:32:19.895237] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-17T04:32:20.077948] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:20.078570] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-17T04:32:20.078707] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-17T04:32:20.079533] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-17T04:32:20.079598] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-17T04:32:20.465827] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:20.471903] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T04:32:20.690183] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-11. [2025-09-17T04:32:21.490190] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-17T04:32:21.555577] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T04:32:21.842690] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T04:32:22.290199] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-17T04:32:23.090149] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-17T04:32:23.291894] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T04:32:23.890157] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-17T04:32:24.690236] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-17T04:32:24.749471] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T04:32:24.801819] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:32:25.184155] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T04:32:25.490237] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-17T04:32:25.807560] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-17T04:32:26.290222] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-17T04:32:26.853453] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:32:27.090174] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-17T04:32:27.564790] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T04:32:27.890155] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-17T04:32:28.359737] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T04:32:28.690161] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-17T04:32:29.491268] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-17T04:32:29.494819] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T04:32:30.191747] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T04:32:30.193203] [INFO ] [REMOTE ] JHI: Full fetch complete (5285 records). [2025-09-17T04:32:30.193306] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-17T04:32:30.295331] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-17T04:32:30.569571] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-17T04:32:30.569700] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-17T04:32:30.569926] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-17T04:32:30.569986] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-17T04:32:30.570393] [DEBUG] [LOCAL ] JHI: Trimmed 5285 records to 3757 (keeping 200 days of data) [2025-09-17T04:32:30.594536] [DEBUG] [LOCAL ] JHI: Primary data saved (3757 records). [2025-09-17T04:32:30.594706] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-17T04:32:30.594832] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHI took 33.7s. Estimated remaining: 2h 57m 36s. Rate: 6.8 symbols/min [2025-09-17T04:32:30.768298] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:30.782140] [DEBUG] [LOCAL ] JILL: Loaded 11627 existing records from primary storage. [2025-09-17T04:32:30.782294] [INFO ] [MAIN ] JILL: Loaded 11627 existing records. [2025-09-17T04:32:30.966789] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:30.967097] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-17T04:32:30.967169] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-17T04:32:30.967607] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-17T04:32:30.967693] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-17T04:32:31.095304] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-17T04:32:31.349873] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:31.518271] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:32:31.890145] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-11. [2025-09-17T04:32:32.654712] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:32:32.690125] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-17T04:32:32.805560] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T04:32:33.490139] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-17T04:32:34.042094] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T04:32:34.206719] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:32:34.290173] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-17T04:32:35.090181] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-17T04:32:35.553745] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:32:35.890439] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T04:32:35.890550] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-17T04:32:36.690197] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-17T04:32:37.475774] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T04:32:37.490075] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-17T04:32:37.681947] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:32:38.290209] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-17T04:32:39.090211] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-17T04:32:39.172221] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T04:32:39.303216] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T04:32:39.890152] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-17T04:32:40.573033] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:32:40.678832] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T04:32:40.690079] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-17T04:32:41.490202] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-17T04:32:41.702468] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T04:32:42.290139] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-17T04:32:42.753987] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T04:32:42.982829] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T04:32:42.988835] [INFO ] [REMOTE ] JHG: Full fetch complete (68575 records). [2025-09-17T04:32:42.988994] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-17T04:32:43.090632] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-17T04:32:43.377787] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-17T04:32:43.377896] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-17T04:32:43.378897] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-17T04:32:43.378972] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-17T04:32:43.380474] [DEBUG] [LOCAL ] JHG: Trimmed 68575 records to 48272 (keeping 200 days of data) [2025-09-17T04:32:43.685952] [DEBUG] [LOCAL ] JHG: Primary data saved (48272 records). [2025-09-17T04:32:43.686159] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-17T04:32:43.686287] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 47.6s. Estimated remaining: 2h 57m 32s. Rate: 6.8 symbols/min [2025-09-17T04:32:43.857554] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:43.870751] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T04:32:43.893326] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-17T04:32:43.909216] [DEBUG] [LOCAL ] JKS: Loaded 28572 existing records from primary storage. [2025-09-17T04:32:43.909397] [INFO ] [MAIN ] JKS: Loaded 28572 existing records. [2025-09-17T04:32:44.088332] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:44.088599] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-17T04:32:44.088800] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-17T04:32:44.089505] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-17T04:32:44.089567] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-17T04:32:44.455538] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:44.690150] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-17T04:32:44.767384] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:32:45.490219] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-11. [2025-09-17T04:32:46.290202] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-17T04:32:46.488694] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:32:46.861682] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T04:32:46.946025] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T04:32:46.947488] [INFO ] [REMOTE ] JHS: Full fetch complete (4477 records). [2025-09-17T04:32:46.947618] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-17T04:32:47.095925] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-17T04:32:47.321121] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-17T04:32:47.321230] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-17T04:32:47.321396] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-17T04:32:47.321447] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-17T04:32:47.321847] [DEBUG] [LOCAL ] JHS: Trimmed 4477 records to 2951 (keeping 200 days of data) [2025-09-17T04:32:47.340451] [DEBUG] [LOCAL ] JHS: Primary data saved (2951 records). [2025-09-17T04:32:47.340527] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-17T04:32:47.340625] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JHS took 43.2s. Estimated remaining: 2h 57m 18s. Rate: 6.8 symbols/min [2025-09-17T04:32:47.515014] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:47.546096] [DEBUG] [LOCAL ] JLL: Loaded 24106 existing records from primary storage. [2025-09-17T04:32:47.546307] [INFO ] [MAIN ] JLL: Loaded 24106 existing records. [2025-09-17T04:32:47.750297] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:47.750573] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-17T04:32:47.750635] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-17T04:32:47.751230] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-17T04:32:47.751293] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-17T04:32:47.895356] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-17T04:32:48.127088] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:48.690169] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-11. [2025-09-17T04:32:48.981681] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T04:32:49.005047] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T04:32:49.490124] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-17T04:32:49.965840] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T04:32:50.290138] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-17T04:32:51.090180] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-17T04:32:51.417940] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T04:32:51.424551] [INFO ] [REMOTE ] JHX: Full fetch complete (55162 records). [2025-09-17T04:32:51.424763] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-17T04:32:51.839726] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-17T04:32:51.839845] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-17T04:32:51.840716] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-17T04:32:51.840776] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-17T04:32:51.842024] [DEBUG] [LOCAL ] JHX: Trimmed 55162 records to 48640 (keeping 200 days of data) [2025-09-17T04:32:51.900077] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-17T04:32:52.133123] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:32:52.206360] [DEBUG] [LOCAL ] JHX: Primary data saved (48640 records). [2025-09-17T04:32:52.206567] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-17T04:32:52.206717] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHX took 32.5s. Estimated remaining: 2h 57m 5s. Rate: 6.9 symbols/min [2025-09-17T04:32:52.380731] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:52.398822] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:32:52.407697] [DEBUG] [LOCAL ] JLS: Loaded 2896 existing records from primary storage. [2025-09-17T04:32:52.408840] [INFO ] [MAIN ] JLS: Loaded 2896 existing records. [2025-09-17T04:32:52.590978] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:52.591271] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-17T04:32:52.591332] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-17T04:32:52.591613] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-17T04:32:52.591698] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-17T04:32:52.692965] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-17T04:32:52.964159] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T04:32:52.970037] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:53.490152] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-17T04:32:53.983360] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T04:32:54.046637] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:32:54.290139] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-17T04:32:55.090175] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-17T04:32:55.895320] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-11. [2025-09-17T04:32:55.910453] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T04:32:56.266623] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T04:32:56.460419] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:32:56.690145] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-17T04:32:57.490142] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-17T04:32:58.195056] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:32:58.232184] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T04:32:58.290161] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-17T04:32:59.090152] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-17T04:32:59.221613] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T04:32:59.225530] [INFO ] [REMOTE ] JILL: Full fetch complete (23040 records). [2025-09-17T04:32:59.225694] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-17T04:32:59.625610] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-17T04:32:59.625788] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-17T04:32:59.626375] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-17T04:32:59.626432] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-17T04:32:59.628496] [DEBUG] [LOCAL ] JILL: Trimmed 23040 records to 16699 (keeping 200 days of data) [2025-09-17T04:32:59.736729] [DEBUG] [LOCAL ] JILL: Primary data saved (16699 records). [2025-09-17T04:32:59.736919] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-17T04:32:59.737079] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JILL took 29.1s. Estimated remaining: 2h 56m 55s. Rate: 6.9 symbols/min [2025-09-17T04:32:59.890167] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-17T04:33:00.451834] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T04:33:00.614127] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:33:00.690133] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-17T04:33:01.085810] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T04:33:01.490173] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-17T04:33:02.290236] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-17T04:33:03.090228] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-17T04:33:04.532223] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-17T04:33:04.539731] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-17T04:33:04.622507] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T04:33:04.690077] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-17T04:33:05.503660] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T04:33:05.505676] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-17T04:33:05.782241] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (3.49 seconds). [2025-09-17T04:33:06.098282] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T04:33:06.231938] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T04:33:06.290153] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-17T04:33:07.090153] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-17T04:33:07.867437] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T04:33:07.890155] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-17T04:33:08.215873] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T04:33:08.654820] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:33:08.690099] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-17T04:33:09.490165] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-17T04:33:09.928095] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T04:33:10.142323] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T04:33:10.290164] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-17T04:33:11.090191] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-17T04:33:11.814669] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:33:11.890141] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-17T04:33:12.388692] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:33:12.469316] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T04:33:12.690182] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-17T04:33:13.490149] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-17T04:33:14.024498] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:33:14.054704] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T04:33:14.055877] [INFO ] [REMOTE ] JLS: Full fetch complete (5724 records). [2025-09-17T04:33:14.055965] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-17T04:33:14.298929] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-17T04:33:14.428348] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-17T04:33:14.428466] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-17T04:33:14.428675] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-17T04:33:14.428762] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-17T04:33:14.429186] [DEBUG] [LOCAL ] JLS: Trimmed 5724 records to 4101 (keeping 200 days of data) [2025-09-17T04:33:14.454393] [DEBUG] [LOCAL ] JLS: Primary data saved (4101 records). [2025-09-17T04:33:14.454532] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-17T04:33:14.454719] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLS took 22.2s. Estimated remaining: 2h 56m 52s. Rate: 6.8 symbols/min [2025-09-17T04:33:15.090238] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-17T04:33:15.968340] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T04:33:15.976139] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-17T04:33:17.057381] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T04:33:17.062557] [INFO ] [REMOTE ] JKS: Full fetch complete (59675 records). [2025-09-17T04:33:17.062720] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-17T04:33:17.445424] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-17T04:33:17.445555] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-17T04:33:17.446488] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-17T04:33:17.446552] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-17T04:33:17.448091] [DEBUG] [LOCAL ] JKS: Trimmed 59675 records to 40291 (keeping 200 days of data) [2025-09-17T04:33:17.722451] [DEBUG] [LOCAL ] JKS: Primary data saved (40291 records). [2025-09-17T04:33:17.722676] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-17T04:33:17.722832] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JKS took 34.0s. Estimated remaining: 2h 56m 38s. Rate: 6.9 symbols/min [2025-09-17T04:33:17.887226] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T04:33:17.896967] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-17T04:33:19.239986] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T04:33:19.245910] [INFO ] [REMOTE ] JLL: Full fetch complete (44605 records). [2025-09-17T04:33:19.246219] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-17T04:33:19.667878] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-17T04:33:19.668005] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-17T04:33:19.668817] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-17T04:33:19.668880] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-17T04:33:19.670783] [DEBUG] [LOCAL ] JLL: Trimmed 44605 records to 32308 (keeping 200 days of data) [2025-09-17T04:33:19.889488] [DEBUG] [LOCAL ] JLL: Primary data saved (32308 records). [2025-09-17T04:33:19.889764] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-17T04:33:19.889900] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JLL took 32.5s. Estimated remaining: 2h 56m 22s. Rate: 6.9 symbols/min [2025-09-17T04:33:20.534744] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.662058] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.670829] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-17T04:33:20.674393] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.699571] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.700554] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-17T04:33:20.704592] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-17T04:33:20.704843] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-17T04:33:20.704906] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-17T04:33:20.704963] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-17T04:33:21.053241] [DEBUG] [LOCAL ] JMIA: Loaded 37976 existing records from primary storage. [2025-09-17T04:33:21.081047] [DEBUG] [LOCAL ] JNJ: Loaded 40103 existing records from primary storage. [2025-09-17T04:33:21.081171] [INFO ] [MAIN ] JMIA: Loaded 37976 existing records. [2025-09-17T04:33:21.118708] [INFO ] [MAIN ] JNJ: Loaded 40103 existing records. [2025-09-17T04:33:21.075054] [DEBUG] [LOCAL ] JOBY: Loaded 40161 existing records from primary storage. [2025-09-17T04:33:21.125056] [INFO ] [MAIN ] JOBY: Loaded 40161 existing records. [2025-09-17T04:33:21.337195] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:21.414358] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-11. [2025-09-17T04:33:21.805178] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:21.805848] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:21.815030] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:21.815554] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-17T04:33:21.816310] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-17T04:33:21.816705] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-17T04:33:21.816867] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-17T04:33:21.817031] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-17T04:33:21.817341] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-17T04:33:21.818357] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-17T04:33:21.818389] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-17T04:33:21.818631] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-17T04:33:21.831441] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-17T04:33:21.823877] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-17T04:33:21.870033] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-17T04:33:22.044206] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T04:33:22.074258] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-17T04:33:22.553907] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T04:33:22.616366] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-17T04:33:22.884063] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:22.889469] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:22.906418] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-11. [2025-09-17T04:33:22.900964] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-11. [2025-09-17T04:33:22.980501] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:22.980976] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-11. [2025-09-17T04:33:23.003363] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T04:33:23.004312] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-17T04:33:23.424089] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T04:33:23.425232] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-17T04:33:23.717444] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T04:33:23.890154] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-17T04:33:24.333528] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T04:33:24.693761] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-17T04:33:24.708043] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T04:33:25.143170] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-17T04:33:25.484787] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T04:33:25.496312] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-17T04:33:25.515627] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-11 (2.61 seconds). [2025-09-17T04:33:25.978179] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T04:33:26.290198] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-17T04:33:26.767442] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T04:33:27.090201] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-17T04:33:27.890143] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-17T04:33:28.690164] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-17T04:33:28.874668] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:33:29.490149] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-17T04:33:30.290248] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-17T04:33:30.504951] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-17T04:33:30.733184] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T04:33:31.090124] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-17T04:33:31.166862] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:33:31.280029] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-17T04:33:31.553284] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T04:33:31.554135] [INFO ] [REMOTE ] JMM: Full fetch complete (2265 records). [2025-09-17T04:33:31.554247] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-17T04:33:31.742773] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-17T04:33:31.742995] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:33:31.743082] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:33:31.743153] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-17T04:33:31.743242] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-17T04:33:31.743322] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-17T04:33:31.743410] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-17T04:33:31.743514] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 11.9s. Estimated remaining: 2h 56m 16s. Rate: 6.9 symbols/min [2025-09-17T04:33:31.913628] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-17T04:33:31.917144] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:31.939725] [DEBUG] [LOCAL ] JOE: Loaded 17782 existing records from primary storage. [2025-09-17T04:33:31.939880] [INFO ] [MAIN ] JOE: Loaded 17782 existing records. [2025-09-17T04:33:32.118442] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:32.118726] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-17T04:33:32.118808] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-17T04:33:32.119335] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-17T04:33:32.119411] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-17T04:33:32.497296] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:32.690148] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-17T04:33:33.490202] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-17T04:33:34.222772] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-17T04:33:34.290116] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-17T04:33:34.552514] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T04:33:35.090261] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-17T04:33:35.890167] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-11. [2025-09-17T04:33:35.950826] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-17T04:33:36.428654] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-17T04:33:36.690135] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-17T04:33:36.745465] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T04:33:36.846183] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T04:33:37.490145] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-17T04:33:38.290148] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-17T04:33:38.991266] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-17T04:33:39.090143] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-17T04:33:39.250363] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:33:39.890200] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-17T04:33:40.062785] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:33:40.690191] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-17T04:33:41.369989] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T04:33:41.490077] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-17T04:33:41.603329] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T04:33:42.290214] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-17T04:33:42.673320] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T04:33:43.090112] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-17T04:33:43.222625] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T04:33:43.410558] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:33:43.890206] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-17T04:33:44.690162] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-17T04:33:45.387877] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-17T04:33:45.490099] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-17T04:33:45.643535] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T04:33:45.982179] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T04:33:46.290147] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-17T04:33:47.090095] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-17T04:33:47.376804] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T04:33:47.890183] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-17T04:33:48.673188] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T04:33:48.690089] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-17T04:33:48.933461] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T04:33:49.490290] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-17T04:33:50.248547] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T04:33:50.290077] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-17T04:33:51.098229] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-17T04:33:51.100996] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-17T04:33:51.164199] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T04:33:51.171166] [INFO ] [REMOTE ] JMIA: Full fetch complete (73048 records). [2025-09-17T04:33:51.171374] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-17T04:33:51.600860] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-17T04:33:51.601029] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-17T04:33:51.602356] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-17T04:33:51.602459] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-17T04:33:51.604689] [DEBUG] [LOCAL ] JMIA: Trimmed 73048 records to 50420 (keeping 200 days of data) [2025-09-17T04:33:51.894780] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-17T04:33:51.970072] [DEBUG] [LOCAL ] JMIA: Primary data saved (50420 records). [2025-09-17T04:33:51.970326] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-17T04:33:51.970455] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JMIA took 32.1s. Estimated remaining: 2h 56m 20s. Rate: 6.8 symbols/min [2025-09-17T04:33:52.182415] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:52.200332] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T04:33:52.209097] [DEBUG] [LOCAL ] JOF: Loaded 5071 existing records from primary storage. [2025-09-17T04:33:52.209256] [INFO ] [MAIN ] JOF: Loaded 5071 existing records. [2025-09-17T04:33:52.429455] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:52.430037] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-17T04:33:52.430176] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-17T04:33:52.430796] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-17T04:33:52.430895] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-17T04:33:52.695231] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-17T04:33:52.790894] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T04:33:52.894575] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:53.490137] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-17T04:33:53.869605] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T04:33:54.147777] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T04:33:54.290166] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-17T04:33:55.090096] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-17T04:33:55.193057] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T04:33:55.608527] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T04:33:55.615557] [INFO ] [REMOTE ] JNJ: Full fetch complete (77782 records). [2025-09-17T04:33:55.615788] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-17T04:33:55.895341] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-17T04:33:56.022603] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-17T04:33:56.022763] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-17T04:33:56.023924] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-17T04:33:56.023997] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-17T04:33:56.025694] [DEBUG] [LOCAL ] JNJ: Trimmed 77782 records to 53753 (keeping 200 days of data) [2025-09-17T04:33:56.380851] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-17T04:33:56.381029] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-17T04:33:56.381145] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JNJ took 36.5s. Estimated remaining: 2h 56m 6s. Rate: 6.8 symbols/min [2025-09-17T04:33:56.560004] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:56.586371] [DEBUG] [LOCAL ] JPC: Loaded 27000 existing records from primary storage. [2025-09-17T04:33:56.586559] [INFO ] [MAIN ] JPC: Loaded 27000 existing records. [2025-09-17T04:33:56.707593] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-11. [2025-09-17T04:33:56.792857] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:56.793126] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-17T04:33:56.793188] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-17T04:33:56.793891] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-17T04:33:56.793962] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-17T04:33:57.161995] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:57.179827] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T04:33:57.324768] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T04:33:57.495963] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-17T04:33:57.502164] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-17T04:33:58.290164] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-17T04:33:58.631137] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T04:33:59.090136] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-17T04:33:59.890156] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-11. [2025-09-17T04:33:59.953822] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T04:34:00.690193] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-17T04:34:00.995228] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-17T04:34:01.119679] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:34:01.464583] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:34:01.490119] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-17T04:34:02.077689] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T04:34:02.290145] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-17T04:34:03.090154] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-17T04:34:03.692026] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:34:03.890212] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-17T04:34:04.690140] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-17T04:34:04.861805] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-17T04:34:04.868432] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-17T04:34:04.868619] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-17T04:34:05.259478] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T04:34:05.285865] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-17T04:34:05.286068] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-17T04:34:05.287276] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-17T04:34:05.287843] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-17T04:34:05.289385] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53798 (keeping 200 days of data) [2025-09-17T04:34:05.504859] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-17T04:34:05.627880] [DEBUG] [LOCAL ] JOBY: Primary data saved (53798 records). [2025-09-17T04:34:05.628101] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-17T04:34:05.628239] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JOBY took 45.7s. Estimated remaining: 2h 55m 58s. Rate: 6.8 symbols/min [2025-09-17T04:34:05.797405] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:05.803382] [DEBUG] [LOCAL ] JPI: Loaded 3856 existing records from primary storage. [2025-09-17T04:34:05.803538] [INFO ] [MAIN ] JPI: Loaded 3856 existing records. [2025-09-17T04:34:05.979027] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:05.979864] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-17T04:34:05.979983] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-17T04:34:05.980365] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-17T04:34:05.980420] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-17T04:34:06.309574] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-17T04:34:06.340582] [INFO ] [REMOTE ] JPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:06.347126] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T04:34:06.375763] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T04:34:07.090138] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-17T04:34:07.425153] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T04:34:07.429048] [INFO ] [REMOTE ] JOE: Full fetch complete (36397 records). [2025-09-17T04:34:07.429154] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-17T04:34:07.839073] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-17T04:34:07.839279] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-17T04:34:07.840096] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-17T04:34:07.840163] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-17T04:34:07.841451] [DEBUG] [LOCAL ] JOE: Trimmed 36397 records to 24912 (keeping 200 days of data) [2025-09-17T04:34:07.907522] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-11. [2025-09-17T04:34:08.025438] [DEBUG] [LOCAL ] JOE: Primary data saved (24912 records). [2025-09-17T04:34:08.025694] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-17T04:34:08.025867] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOE took 36.3s. Estimated remaining: 2h 55m 43s. Rate: 6.9 symbols/min [2025-09-17T04:34:08.212304] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:08.259548] [DEBUG] [LOCAL ] JPM: Loaded 40144 existing records from primary storage. [2025-09-17T04:34:08.259799] [INFO ] [MAIN ] JPM: Loaded 40144 existing records. [2025-09-17T04:34:08.454564] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:08.455061] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-17T04:34:08.460809] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-17T04:34:08.461020] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T04:34:08.464635] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-17T04:34:08.464740] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-17T04:34:08.695277] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-17T04:34:08.841728] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:08.865443] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T04:34:09.493181] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-11. [2025-09-17T04:34:09.494138] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T04:34:10.290221] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-17T04:34:11.090219] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-17T04:34:11.669632] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:34:11.732851] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T04:34:11.734782] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-17T04:34:11.890140] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-17T04:34:12.477452] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T04:34:12.690143] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-12. [2025-09-17T04:34:13.303130] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T04:34:13.490239] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-17T04:34:14.290173] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-17T04:34:14.921680] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T04:34:15.090192] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-17T04:34:15.795994] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T04:34:15.840271] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T04:34:15.890134] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-17T04:34:16.415484] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T04:34:16.417491] [INFO ] [REMOTE ] JOF: Full fetch complete (9416 records). [2025-09-17T04:34:16.417587] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-17T04:34:16.695355] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-17T04:34:16.810102] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-17T04:34:16.810241] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-17T04:34:16.810754] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-17T04:34:16.810856] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-17T04:34:16.811417] [DEBUG] [LOCAL ] JOF: Trimmed 9416 records to 7173 (keeping 200 days of data) [2025-09-17T04:34:16.858434] [DEBUG] [LOCAL ] JOF: Primary data saved (7173 records). [2025-09-17T04:34:16.858615] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-17T04:34:16.858752] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JOF took 24.9s. Estimated remaining: 2h 55m 34s. Rate: 6.9 symbols/min [2025-09-17T04:34:17.030985] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:17.055590] [DEBUG] [LOCAL ] JQC: Loaded 24293 existing records from primary storage. [2025-09-17T04:34:17.055832] [INFO ] [MAIN ] JQC: Loaded 24293 existing records. [2025-09-17T04:34:17.242629] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:17.242996] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-17T04:34:17.243073] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-17T04:34:17.243962] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-17T04:34:17.244040] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-17T04:34:17.499470] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-17T04:34:17.604389] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:18.249549] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T04:34:18.290097] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-17T04:34:19.090162] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-11. [2025-09-17T04:34:19.524313] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T04:34:19.850903] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:34:19.890105] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-01. [2025-09-17T04:34:20.274954] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T04:34:20.545564] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:34:20.690133] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-17T04:34:21.119806] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T04:34:21.490186] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-17T04:34:22.290164] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-17T04:34:22.899425] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T04:34:22.968177] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T04:34:23.090203] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-17T04:34:23.890204] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-17T04:34:24.690214] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-17T04:34:25.172402] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T04:34:25.326150] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T04:34:25.405265] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T04:34:25.490136] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-17T04:34:25.968271] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T04:34:26.290139] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-17T04:34:27.090196] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-17T04:34:27.668423] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T04:34:27.890178] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-17T04:34:28.458124] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:34:28.690233] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-17T04:34:29.373626] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:34:29.490187] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-17T04:34:30.290177] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-17T04:34:30.890595] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T04:34:31.070196] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:34:31.090111] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-17T04:34:31.156873] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T04:34:31.890204] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-17T04:34:32.457029] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T04:34:32.461942] [INFO ] [REMOTE ] JPC: Full fetch complete (55847 records). [2025-09-17T04:34:32.462085] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-17T04:34:32.695302] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-17T04:34:32.870682] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-17T04:34:32.870821] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-17T04:34:32.872560] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-17T04:34:32.872680] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-17T04:34:32.874254] [DEBUG] [LOCAL ] JPC: Trimmed 55847 records to 37342 (keeping 200 days of data) [2025-09-17T04:34:33.100858] [DEBUG] [LOCAL ] JPC: Primary data saved (37342 records). [2025-09-17T04:34:33.101072] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-17T04:34:33.101175] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JPC took 36.7s. Estimated remaining: 2h 55m 33s. Rate: 6.8 symbols/min [2025-09-17T04:34:33.280590] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:33.294216] [DEBUG] [LOCAL ] JRI: Loaded 11215 existing records from primary storage. [2025-09-17T04:34:33.294411] [INFO ] [MAIN ] JRI: Loaded 11215 existing records. [2025-09-17T04:34:33.405314] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T04:34:33.481144] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:33.481436] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-17T04:34:33.481498] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-17T04:34:33.481968] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-17T04:34:33.482032] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-17T04:34:33.495276] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-17T04:34:33.842635] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:34.151544] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T04:34:34.242157] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-17T04:34:34.290150] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-17T04:34:35.090195] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-11. [2025-09-17T04:34:35.890171] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-17T04:34:36.023439] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T04:34:36.617356] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T04:34:36.618671] [INFO ] [REMOTE ] JPI: Full fetch complete (7845 records). [2025-09-17T04:34:36.618756] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-17T04:34:36.693770] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-17T04:34:37.014276] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-17T04:34:37.019719] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-17T04:34:37.030177] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-17T04:34:37.030807] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-17T04:34:37.031189] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-17T04:34:37.031674] [DEBUG] [LOCAL ] JPI: Trimmed 7845 records to 5442 (keeping 200 days of data) [2025-09-17T04:34:37.067321] [DEBUG] [LOCAL ] JPI: Primary data saved (5442 records). [2025-09-17T04:34:37.067463] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-17T04:34:37.067554] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JPI took 31.4s. Estimated remaining: 2h 55m 19s. Rate: 6.9 symbols/min [2025-09-17T04:34:37.235725] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:37.245319] [DEBUG] [LOCAL ] JRS: Loaded 8343 existing records from primary storage. [2025-09-17T04:34:37.245460] [INFO ] [MAIN ] JRS: Loaded 8343 existing records. [2025-09-17T04:34:37.429756] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:37.430020] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-17T04:34:37.430079] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-17T04:34:37.430437] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-17T04:34:37.430494] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-17T04:34:37.497554] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-17T04:34:37.820499] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:37.831169] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:34:38.290172] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-17T04:34:39.090186] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-17T04:34:39.638161] [DEBUG] [REMOTE ] JRI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T04:34:39.638844] [WARN ] [REMOTE ] JRI: No data returned for month 2025-01 [2025-09-17T04:34:39.657119] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:34:39.855247] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-17T04:34:39.890089] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-17T04:34:40.690141] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-11. [2025-09-17T04:34:41.407312] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T04:34:41.490157] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-17T04:34:42.218199] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T04:34:42.260026] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-17T04:34:42.290085] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-17T04:34:43.090194] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-17T04:34:43.890142] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-17T04:34:44.498335] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-17T04:34:44.547269] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:34:44.566334] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T04:34:44.690132] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-17T04:34:45.490157] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-17T04:34:46.132436] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T04:34:46.290157] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-17T04:34:47.070353] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T04:34:47.090080] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-17T04:34:47.543044] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T04:34:47.745374] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-17T04:34:47.752296] [INFO ] [REMOTE ] JPM: Full fetch complete (77826 records). [2025-09-17T04:34:47.752490] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-17T04:34:47.896361] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-17T04:34:48.154386] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-17T04:34:48.154495] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-17T04:34:48.155562] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-17T04:34:48.155622] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-17T04:34:48.157186] [DEBUG] [LOCAL ] JPM: Trimmed 77826 records to 53794 (keeping 200 days of data) [2025-09-17T04:34:48.501615] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-17T04:34:48.501813] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-17T04:34:48.501923] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JPM took 40.5s. Estimated remaining: 2h 55m 13s. Rate: 6.8 symbols/min [2025-09-17T04:34:48.671859] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:48.690234] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-17T04:34:48.704868] [DEBUG] [LOCAL ] JXN: Loaded 33286 existing records from primary storage. [2025-09-17T04:34:48.705042] [INFO ] [MAIN ] JXN: Loaded 33286 existing records. [2025-09-17T04:34:48.884344] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:48.884762] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-17T04:34:48.891223] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-17T04:34:48.891954] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T04:34:48.893671] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-17T04:34:48.895121] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-17T04:34:49.260459] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:49.490139] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-17T04:34:50.013927] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T04:34:50.272897] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:34:50.290139] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-17T04:34:51.090085] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-11. [2025-09-17T04:34:51.584945] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:34:51.890176] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-17T04:34:52.638540] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T04:34:52.690083] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-17T04:34:52.745473] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:34:53.490166] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-17T04:34:54.144152] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T04:34:54.164613] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T04:34:54.290181] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-17T04:34:55.090176] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-17T04:34:55.696973] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T04:34:55.890161] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-17T04:34:55.949314] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T04:34:56.690166] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-17T04:34:57.281990] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:34:57.490178] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-17T04:34:57.629677] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T04:34:58.290173] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-17T04:34:59.018347] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T04:34:59.020350] [INFO ] [REMOTE ] JRS: Full fetch complete (15814 records). [2025-09-17T04:34:59.020738] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-17T04:34:59.093404] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-17T04:34:59.474315] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-17T04:34:59.474595] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-17T04:34:59.475974] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-17T04:34:59.476096] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-17T04:34:59.477893] [DEBUG] [LOCAL ] JRS: Trimmed 15814 records to 10999 (keeping 200 days of data) [2025-09-17T04:34:59.580053] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T04:34:59.592273] [DEBUG] [LOCAL ] JRS: Primary data saved (10999 records). [2025-09-17T04:34:59.604537] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-17T04:34:59.605260] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JRS took 22.5s. Estimated remaining: 2h 55m 7s. Rate: 6.8 symbols/min [2025-09-17T04:34:59.801097] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:59.851566] [DEBUG] [LOCAL ] K: Loaded 37359 existing records from primary storage. [2025-09-17T04:34:59.851839] [INFO ] [MAIN ] K: Loaded 37359 existing records. [2025-09-17T04:34:59.895336] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-17T04:35:00.069404] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:00.069823] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-17T04:35:00.069896] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-17T04:35:00.070957] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-17T04:35:00.071033] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-17T04:35:00.283192] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T04:35:00.486873] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:00.690266] [INFO ] [REMOTE ] K: Fetching primary data for 2024-11. [2025-09-17T04:35:01.490304] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-17T04:35:01.677838] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T04:35:02.290215] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-17T04:35:02.364862] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:35:02.578212] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T04:35:03.090232] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-17T04:35:03.246251] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:35:03.890170] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-17T04:35:04.690222] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-17T04:35:04.824488] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T04:35:04.899360] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T04:35:05.490240] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-17T04:35:06.043926] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T04:35:06.231814] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T04:35:06.290206] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-17T04:35:07.090148] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-17T04:35:07.890101] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-17T04:35:07.962972] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:35:08.690147] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-17T04:35:08.745298] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:35:09.139425] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T04:35:09.145230] [INFO ] [REMOTE ] JQC: Full fetch complete (48414 records). [2025-09-17T04:35:09.145427] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-17T04:35:09.502044] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-17T04:35:09.561851] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-17T04:35:09.561964] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-17T04:35:09.563145] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-17T04:35:09.563227] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-17T04:35:09.564917] [DEBUG] [LOCAL ] JQC: Trimmed 48414 records to 33855 (keeping 200 days of data) [2025-09-17T04:35:09.773007] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T04:35:09.790795] [DEBUG] [LOCAL ] JQC: Primary data saved (33855 records). [2025-09-17T04:35:09.790939] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-17T04:35:09.791046] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. JQC took 52.9s. Estimated remaining: 2h 54m 60s. Rate: 6.8 symbols/min [2025-09-17T04:35:09.961800] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:09.973480] [DEBUG] [LOCAL ] KAI: Loaded 9846 existing records from primary storage. [2025-09-17T04:35:09.973658] [INFO ] [MAIN ] KAI: Loaded 9846 existing records. [2025-09-17T04:35:10.151744] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:10.151992] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-17T04:35:10.152041] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-17T04:35:10.152382] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-17T04:35:10.152444] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-17T04:35:10.295240] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-17T04:35:10.514341] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:11.090155] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-11. [2025-09-17T04:35:11.155070] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T04:35:11.204916] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T04:35:11.890157] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-17T04:35:11.909059] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T04:35:12.690141] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-17T04:35:12.750519] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T04:35:12.753483] [INFO ] [REMOTE ] JRI: Full fetch complete (20134 records). [2025-09-17T04:35:12.753606] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-17T04:35:12.943490] [WARN ] [VALIDATOR ] JRI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T04:35:12.943906] [FATAL] [MAIN ] JRI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:35:12.944039] [WARN ] [MAIN ] JRI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:35:12.944148] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-17T04:35:12.944263] [DEBUG] [LOCAL ] JRI: No primary data file found to delete. [2025-09-17T04:35:12.944359] [INFO ] [LOCAL ] JRI: Starting deletion of derivative data. [2025-09-17T04:35:12.944785] [DEBUG] [LOCAL ] JRI: Deleted derivative data file. [2025-09-17T04:35:12.944930] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JRI took 39.8s. Estimated remaining: 2h 54m 45s. Rate: 6.8 symbols/min [2025-09-17T04:35:13.112261] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:13.142705] [DEBUG] [LOCAL ] KAR: Loaded 29727 existing records from primary storage. [2025-09-17T04:35:13.142899] [INFO ] [MAIN ] KAR: Loaded 29727 existing records. [2025-09-17T04:35:13.320169] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:13.320441] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-17T04:35:13.320498] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-17T04:35:13.321203] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-17T04:35:13.321278] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-17T04:35:13.498371] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-17T04:35:13.682868] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:14.290176] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-11. [2025-09-17T04:35:14.400409] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:35:15.090116] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-17T04:35:15.174245] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:35:15.686748] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T04:35:15.890128] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-17T04:35:16.690200] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-17T04:35:16.976668] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T04:35:17.382985] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T04:35:17.410329] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:35:17.490110] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-17T04:35:18.290134] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-17T04:35:18.858314] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T04:35:19.090137] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-17T04:35:19.890151] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-17T04:35:20.029712] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:35:20.525668] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T04:35:20.532965] [INFO ] [REMOTE ] JXN: Full fetch complete (64931 records). [2025-09-17T04:35:20.533163] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-17T04:35:20.691698] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-17T04:35:20.703403] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T04:35:20.936923] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-17T04:35:20.937042] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-17T04:35:20.938100] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-17T04:35:20.938195] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-17T04:35:20.939713] [DEBUG] [LOCAL ] JXN: Trimmed 64931 records to 46086 (keeping 200 days of data) [2025-09-17T04:35:21.243540] [DEBUG] [LOCAL ] JXN: Primary data saved (46086 records). [2025-09-17T04:35:21.243721] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-17T04:35:21.243831] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. JXN took 32.7s. Estimated remaining: 2h 54m 36s. Rate: 6.9 symbols/min [2025-09-17T04:35:21.413405] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:21.432122] [DEBUG] [LOCAL ] KB: Loaded 17934 existing records from primary storage. [2025-09-17T04:35:21.432286] [INFO ] [MAIN ] KB: Loaded 17934 existing records. [2025-09-17T04:35:21.495294] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-17T04:35:21.615175] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:21.615446] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-17T04:35:21.615510] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-17T04:35:21.616040] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-17T04:35:21.616100] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-17T04:35:21.976603] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:22.213002] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T04:35:22.290204] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-11. [2025-09-17T04:35:22.523406] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T04:35:23.090164] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-17T04:35:23.324992] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T04:35:23.890305] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-17T04:35:24.053521] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T04:35:24.690197] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-17T04:35:25.490154] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-17T04:35:25.569422] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:35:25.973584] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T04:35:26.290163] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-17T04:35:26.340935] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T04:35:27.090172] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-17T04:35:27.627766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:35:27.704283] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T04:35:27.890211] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-17T04:35:28.690143] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-17T04:35:29.490200] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-17T04:35:29.640973] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T04:35:29.717537] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T04:35:30.290127] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-17T04:35:30.554759] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T04:35:31.090175] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-17T04:35:31.403429] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T04:35:31.890161] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-17T04:35:32.228470] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:35:32.690137] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-17T04:35:32.783053] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T04:35:33.490139] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-17T04:35:34.207939] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:35:34.290161] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-17T04:35:34.763879] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T04:35:34.800106] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T04:35:35.090133] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-17T04:35:35.890204] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-17T04:35:36.690203] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-17T04:35:36.747107] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T04:35:36.753682] [INFO ] [REMOTE ] K: Full fetch complete (71594 records). [2025-09-17T04:35:36.753891] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-17T04:35:37.178764] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-17T04:35:37.178984] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-17T04:35:37.180123] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-17T04:35:37.180292] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-17T04:35:37.198481] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T04:35:37.204659] [DEBUG] [LOCAL ] K: Trimmed 71594 records to 49749 (keeping 200 days of data) [2025-09-17T04:35:37.496180] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-17T04:35:37.532004] [DEBUG] [LOCAL ] K: Primary data saved (49749 records). [2025-09-17T04:35:37.532127] [INFO ] [MAIN ] K: Full history saved. [2025-09-17T04:35:37.532239] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. K took 37.9s. Estimated remaining: 2h 54m 35s. Rate: 6.8 symbols/min [2025-09-17T04:35:37.700693] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:37.717815] [DEBUG] [LOCAL ] KBDC: Loaded 14804 existing records from primary storage. [2025-09-17T04:35:37.717967] [INFO ] [MAIN ] KBDC: Loaded 14804 existing records. [2025-09-17T04:35:37.901600] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:37.901943] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-17T04:35:37.902057] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-17T04:35:37.902520] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-17T04:35:37.902587] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-17T04:35:38.291245] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-17T04:35:38.291047] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:38.319559] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:35:38.369899] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T04:35:38.371810] [INFO ] [REMOTE ] KAI: Full fetch complete (18674 records). [2025-09-17T04:35:38.371894] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-17T04:35:38.736440] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-17T04:35:38.736543] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-17T04:35:38.736956] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-17T04:35:38.737009] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-17T04:35:38.737635] [DEBUG] [LOCAL ] KAI: Trimmed 18674 records to 13670 (keeping 200 days of data) [2025-09-17T04:35:38.832575] [DEBUG] [LOCAL ] KAI: Primary data saved (13670 records). [2025-09-17T04:35:38.832781] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-17T04:35:38.832912] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KAI took 29.0s. Estimated remaining: 2h 54m 18s. Rate: 6.8 symbols/min [2025-09-17T04:35:39.004284] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:39.043382] [DEBUG] [LOCAL ] KBH: Loaded 36047 existing records from primary storage. [2025-09-17T04:35:39.043553] [INFO ] [MAIN ] KBH: Loaded 36047 existing records. [2025-09-17T04:35:39.100288] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-11. [2025-09-17T04:35:39.227484] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:39.227762] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-17T04:35:39.227815] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-17T04:35:39.229021] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-17T04:35:39.229083] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-17T04:35:39.582195] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:39.598226] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:35:39.887231] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T04:35:39.890074] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-11. [2025-09-17T04:35:40.690210] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-17T04:35:41.453300] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:35:41.486856] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T04:35:41.490222] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-17T04:35:42.290120] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-17T04:35:42.777329] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:35:43.090238] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-17T04:35:43.830075] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:35:43.890238] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-17T04:35:44.048030] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T04:35:44.690153] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-17T04:35:45.225901] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T04:35:45.490142] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-17T04:35:46.113749] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T04:35:46.290155] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-17T04:35:46.404486] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:35:47.090160] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-17T04:35:47.158054] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T04:35:47.888398] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T04:35:47.892922] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-17T04:35:48.690113] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-17T04:35:48.912346] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T04:35:48.915072] [INFO ] [REMOTE ] KB: Full fetch complete (34852 records). [2025-09-17T04:35:48.915176] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-17T04:35:49.300026] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-17T04:35:49.300158] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-17T04:35:49.301020] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-17T04:35:49.301081] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-17T04:35:49.302059] [DEBUG] [LOCAL ] KB: Trimmed 34852 records to 24566 (keeping 200 days of data) [2025-09-17T04:35:49.465962] [DEBUG] [LOCAL ] KB: Primary data saved (24566 records). [2025-09-17T04:35:49.466150] [INFO ] [MAIN ] KB: Full history saved. [2025-09-17T04:35:49.466280] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KB took 28.2s. Estimated remaining: 2h 54m 12s. Rate: 6.8 symbols/min [2025-09-17T04:35:49.499246] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-17T04:35:49.652556] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:49.687913] [DEBUG] [LOCAL ] KBR: Loaded 35949 existing records from primary storage. [2025-09-17T04:35:49.688100] [INFO ] [MAIN ] KBR: Loaded 35949 existing records. [2025-09-17T04:35:49.882106] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:49.882389] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-17T04:35:49.882447] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-17T04:35:49.883524] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-17T04:35:49.883593] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-17T04:35:50.276575] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:50.295194] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-11. [2025-09-17T04:35:50.306325] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T04:35:50.905756] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T04:35:51.090127] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-17T04:35:51.588515] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:35:51.890130] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-17T04:35:52.690091] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-17T04:35:52.690971] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T04:35:53.220594] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:35:53.490135] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-17T04:35:54.282138] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:35:54.292032] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-17T04:35:55.046043] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:35:55.090129] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-17T04:35:55.890112] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-17T04:35:55.934602] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T04:35:55.961165] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:35:56.690132] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-17T04:35:57.153961] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:35:57.159488] [INFO ] [REMOTE ] KAR: Full fetch complete (56578 records). [2025-09-17T04:35:57.159720] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-17T04:35:57.502744] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-17T04:35:57.557919] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-17T04:35:57.558052] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-17T04:35:57.558914] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-17T04:35:57.558978] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-17T04:35:57.560372] [DEBUG] [LOCAL ] KAR: Trimmed 56578 records to 40152 (keeping 200 days of data) [2025-09-17T04:35:57.811071] [DEBUG] [LOCAL ] KAR: Primary data saved (40152 records). [2025-09-17T04:35:57.811232] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-17T04:35:57.811334] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KAR took 44.9s. Estimated remaining: 2h 54m 2s. Rate: 6.8 symbols/min [2025-09-17T04:35:57.992050] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:58.046113] [DEBUG] [LOCAL ] KD: Loaded 38888 existing records from primary storage. [2025-09-17T04:35:58.046492] [INFO ] [MAIN ] KD: Loaded 38888 existing records. [2025-09-17T04:35:58.235900] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:58.236384] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-17T04:35:58.236466] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-17T04:35:58.237696] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-17T04:35:58.237774] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-17T04:35:58.325800] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-17T04:35:58.510658] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:35:58.679888] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:58.693084] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T04:35:59.090155] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-17T04:35:59.784822] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T04:35:59.890138] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-11. [2025-09-17T04:36:00.416284] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T04:36:00.690190] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-17T04:36:01.431524] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T04:36:01.490151] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-17T04:36:01.677736] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T04:36:02.290179] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-17T04:36:03.090220] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-17T04:36:03.890169] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-17T04:36:04.598194] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (3.11 seconds). [2025-09-17T04:36:04.667709] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T04:36:04.690105] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-17T04:36:05.246312] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T04:36:05.430849] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-17T04:36:05.490112] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-17T04:36:06.295203] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-17T04:36:06.316277] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T04:36:07.090179] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-17T04:36:07.186619] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:36:07.425372] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T04:36:07.429148] [INFO ] [REMOTE ] KBDC: Full fetch complete (27098 records). [2025-09-17T04:36:07.429241] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-17T04:36:07.811155] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-17T04:36:07.811260] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-17T04:36:07.811843] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-17T04:36:07.811897] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-17T04:36:07.812604] [DEBUG] [LOCAL ] KBDC: Trimmed 27098 records to 20428 (keeping 200 days of data) [2025-09-17T04:36:07.904660] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-17T04:36:07.954702] [DEBUG] [LOCAL ] KBDC: Primary data saved (20428 records). [2025-09-17T04:36:07.954939] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-17T04:36:07.955061] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBDC took 30.4s. Estimated remaining: 2h 53m 55s. Rate: 6.8 symbols/min [2025-09-17T04:36:08.135138] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:08.141110] [DEBUG] [LOCAL ] KEN: Loaded 3309 existing records from primary storage. [2025-09-17T04:36:08.141259] [INFO ] [MAIN ] KEN: Loaded 3309 existing records. [2025-09-17T04:36:08.323466] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:08.323872] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-17T04:36:08.323942] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-17T04:36:08.324323] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-17T04:36:08.324389] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-17T04:36:08.691725] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:08.691878] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-17T04:36:08.870767] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T04:36:09.490157] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-17T04:36:09.573083] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T04:36:10.149302] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:36:10.290086] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-17T04:36:11.090204] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-17T04:36:11.242008] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:36:11.890153] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-17T04:36:12.079365] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T04:36:12.690163] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-11. [2025-09-17T04:36:12.909369] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T04:36:13.152295] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T04:36:13.400586] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T04:36:13.490201] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-17T04:36:14.290214] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-17T04:36:15.090161] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-17T04:36:15.358924] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:36:15.890175] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-17T04:36:16.520338] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T04:36:16.690221] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-17T04:36:17.490135] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-17T04:36:17.517272] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T04:36:17.595972] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-17T04:36:18.165971] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-17T04:36:18.290130] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-17T04:36:19.090181] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-17T04:36:19.149234] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T04:36:19.155759] [INFO ] [REMOTE ] KBH: Full fetch complete (70153 records). [2025-09-17T04:36:19.155923] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-17T04:36:19.547230] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-17T04:36:19.547333] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-17T04:36:19.548234] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-17T04:36:19.548293] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-17T04:36:19.549759] [DEBUG] [LOCAL ] KBH: Trimmed 70153 records to 48821 (keeping 200 days of data) [2025-09-17T04:36:19.653165] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T04:36:19.859483] [DEBUG] [LOCAL ] KBH: Primary data saved (48821 records). [2025-09-17T04:36:19.859656] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-17T04:36:19.859754] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KBH took 41.0s. Estimated remaining: 2h 53m 49s. Rate: 6.8 symbols/min [2025-09-17T04:36:19.895253] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-17T04:36:20.035559] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:20.064274] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T04:36:20.092731] [DEBUG] [LOCAL ] KEP: Loaded 24401 existing records from primary storage. [2025-09-17T04:36:20.092903] [INFO ] [MAIN ] KEP: Loaded 24401 existing records. [2025-09-17T04:36:20.269473] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:20.269784] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-17T04:36:20.269865] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-17T04:36:20.270791] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-17T04:36:20.270872] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-17T04:36:20.621077] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:20.690073] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-11. [2025-09-17T04:36:21.443322] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:36:21.461270] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T04:36:21.490069] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-17T04:36:22.290168] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-17T04:36:22.812051] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:36:23.090207] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-17T04:36:23.890175] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-17T04:36:23.964758] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T04:36:24.278964] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T04:36:24.295241] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T04:36:24.690208] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-17T04:36:25.490180] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-17T04:36:26.278101] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T04:36:26.284218] [INFO ] [REMOTE ] KBR: Full fetch complete (69739 records). [2025-09-17T04:36:26.284396] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-17T04:36:26.297027] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-17T04:36:26.729881] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:36:26.733944] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-17T04:36:26.739248] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-17T04:36:26.741119] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-17T04:36:26.741206] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-17T04:36:26.743322] [DEBUG] [LOCAL ] KBR: Trimmed 69739 records to 48401 (keeping 200 days of data) [2025-09-17T04:36:26.980276] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T04:36:27.077211] [DEBUG] [LOCAL ] KBR: Primary data saved (48401 records). [2025-09-17T04:36:27.077423] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-17T04:36:27.077550] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KBR took 37.6s. Estimated remaining: 2h 53m 39s. Rate: 6.8 symbols/min [2025-09-17T04:36:27.098689] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-17T04:36:27.256677] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:27.256915] [DEBUG] [LOCAL ] KEX: No existing data file found in primary storage. [2025-09-17T04:36:27.256966] [WARN ] [MAIN ] KEX: No existing data found, performing full refresh instead. [2025-09-17T04:36:27.257074] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-17T04:36:27.257128] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-17T04:36:27.257179] [DEBUG] [LOCAL ] KEX: No primary data file found to delete. [2025-09-17T04:36:27.257222] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-17T04:36:27.643005] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:27.890172] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-17T04:36:28.248014] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T04:36:28.690185] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-17T04:36:29.490119] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-11. [2025-09-17T04:36:29.871119] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T04:36:29.935767] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T04:36:30.290121] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-17T04:36:30.551228] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T04:36:31.090129] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-17T04:36:31.293376] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T04:36:31.890134] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-17T04:36:32.353787] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T04:36:32.554189] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:36:32.690138] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-17T04:36:33.490147] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-17T04:36:33.985294] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:36:34.290142] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-17T04:36:35.090147] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-17T04:36:35.447619] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T04:36:35.812690] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:36:35.890164] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-17T04:36:36.603977] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T04:36:36.690099] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-17T04:36:37.490173] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-17T04:36:37.722533] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T04:36:37.729069] [INFO ] [REMOTE ] KD: Full fetch complete (75437 records). [2025-09-17T04:36:37.729216] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-17T04:36:38.156973] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T04:36:38.161161] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-17T04:36:38.163346] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-17T04:36:38.184666] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-17T04:36:38.185605] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T04:36:38.185908] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-17T04:36:38.195368] [DEBUG] [LOCAL ] KD: Trimmed 75437 records to 52317 (keeping 200 days of data) [2025-09-17T04:36:38.290752] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-17T04:36:38.520087] [DEBUG] [LOCAL ] KD: Primary data saved (52317 records). [2025-09-17T04:36:38.520288] [INFO ] [MAIN ] KD: Full history saved. [2025-09-17T04:36:38.520391] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KD took 40.7s. Estimated remaining: 2h 53m 33s. Rate: 6.8 symbols/min [2025-09-17T04:36:38.693089] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:38.693338] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-17T04:36:38.693430] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-17T04:36:38.693544] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-17T04:36:38.693594] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-17T04:36:38.693663] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-17T04:36:38.693707] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-17T04:36:39.058180] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:39.090102] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-11. [2025-09-17T04:36:39.606566] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T04:36:39.890201] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-17T04:36:40.512072] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:36:40.526956] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T04:36:40.690178] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-17T04:36:41.490158] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-17T04:36:41.993559] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T04:36:42.290137] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-17T04:36:42.949215] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T04:36:43.090136] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-17T04:36:43.257337] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:36:43.649317] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:36:43.890137] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-17T04:36:44.690163] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-17T04:36:45.490191] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-17T04:36:45.607066] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T04:36:46.038920] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T04:36:46.040015] [INFO ] [REMOTE ] KEN: Full fetch complete (5899 records). [2025-09-17T04:36:46.040102] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-17T04:36:46.231489] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:36:46.295204] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-17T04:36:46.296331] [INFO ] [REMOTE ] KEP: Full fetch complete (41298 records). [2025-09-17T04:36:46.318685] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-17T04:36:46.552177] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-17T04:36:46.588830] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-17T04:36:46.623589] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-17T04:36:46.685254] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-17T04:36:46.724859] [DEBUG] [LOCAL ] KEN: Trimmed 5899 records to 4689 (keeping 200 days of data) [2025-09-17T04:36:46.836447] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-17T04:36:46.837887] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-17T04:36:46.838488] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-17T04:36:46.839153] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-17T04:36:46.842833] [DEBUG] [LOCAL ] KEP: Trimmed 41298 records to 30335 (keeping 200 days of data) [2025-09-17T04:36:46.845128] [DEBUG] [LOCAL ] KEN: Primary data saved (4689 records). [2025-09-17T04:36:46.845404] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-17T04:36:46.845530] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KEN took 38.9s. Estimated remaining: 2h 53m 24s. Rate: 6.8 symbols/min [2025-09-17T04:36:47.095474] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-17T04:36:47.129892] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:47.226740] [DEBUG] [LOCAL ] KEYS: Loaded 31718 existing records from primary storage. [2025-09-17T04:36:47.228033] [INFO ] [MAIN ] KEYS: Loaded 31718 existing records. [2025-09-17T04:36:47.420474] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:47.423019] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-17T04:36:47.423910] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-17T04:36:47.426111] [DEBUG] [LOCAL ] KEP: Primary data saved (30335 records). [2025-09-17T04:36:47.426235] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-17T04:36:47.426338] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEP took 27.6s. Estimated remaining: 2h 53m 7s. Rate: 6.9 symbols/min [2025-09-17T04:36:47.458789] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-17T04:36:47.496759] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-17T04:36:47.722325] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:47.866428] [DEBUG] [LOCAL ] KF: Loaded 1755 existing records from primary storage. [2025-09-17T04:36:47.890345] [INFO ] [MAIN ] KF: Loaded 1755 existing records. [2025-09-17T04:36:48.091533] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:48.107442] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-11. [2025-09-17T04:36:48.195172] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:48.195583] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-17T04:36:48.195673] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-17T04:36:48.196027] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-17T04:36:48.196097] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-17T04:36:48.319630] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T04:36:48.605940] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:48.690135] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-11. [2025-09-17T04:36:48.870069] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T04:36:49.114070] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T04:36:49.490124] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-17T04:36:49.958756] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T04:36:50.290136] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-17T04:36:50.977033] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:36:51.090142] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-17T04:36:51.897886] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-17T04:36:51.902881] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:36:52.349241] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T04:36:52.454700] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T04:36:52.690336] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-17T04:36:53.490139] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-17T04:36:53.876059] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T04:36:54.290138] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-17T04:36:54.623101] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T04:36:55.090138] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-17T04:36:55.641359] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:36:55.890140] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-17T04:36:56.690161] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-17T04:36:56.764590] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:36:57.129884] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T04:36:57.465410] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:36:57.490096] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-17T04:36:58.290139] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-17T04:36:58.691288] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T04:36:59.090140] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-17T04:36:59.376271] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T04:36:59.890210] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-17T04:37:00.633855] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T04:37:00.690113] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-17T04:37:01.490183] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-17T04:37:01.697525] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T04:37:02.248483] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:37:02.258006] [INFO ] [REMOTE ] KEX: Full fetch complete (54938 records). [2025-09-17T04:37:02.258315] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-17T04:37:02.295414] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-17T04:37:02.671172] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-17T04:37:02.671284] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-17T04:37:02.672087] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-17T04:37:02.672144] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-17T04:37:02.673274] [DEBUG] [LOCAL ] KEX: Trimmed 54938 records to 37680 (keeping 200 days of data) [2025-09-17T04:37:02.904909] [DEBUG] [LOCAL ] KEX: Primary data saved (37680 records). [2025-09-17T04:37:02.905112] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-17T04:37:02.905226] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEX took 35.8s. Estimated remaining: 2h 53m 5s. Rate: 6.8 symbols/min [2025-09-17T04:37:03.011315] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T04:37:03.086115] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:03.090106] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-17T04:37:03.102968] [DEBUG] [LOCAL ] KFRC: Loaded 14991 existing records from primary storage. [2025-09-17T04:37:03.103133] [INFO ] [MAIN ] KFRC: Loaded 14991 existing records. [2025-09-17T04:37:03.286255] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:03.300029] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-17T04:37:03.309044] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-17T04:37:03.311004] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-17T04:37:03.310933] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T04:37:03.311233] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-17T04:37:03.635302] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T04:37:03.708603] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:03.890150] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-17T04:37:04.690135] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-17T04:37:05.255461] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T04:37:05.490174] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-17T04:37:05.839718] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T04:37:06.290131] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-17T04:37:06.722188] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T04:37:07.090119] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-11. [2025-09-17T04:37:07.145974] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:37:07.890175] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-17T04:37:08.068526] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:37:08.690198] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-17T04:37:09.508811] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-17T04:37:09.541215] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:37:09.708338] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:37:09.968561] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T04:37:10.290240] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-17T04:37:11.090253] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-17T04:37:11.894364] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-17T04:37:11.899993] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T04:37:11.922598] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:37:11.929220] [INFO ] [REMOTE ] KEY: Full fetch complete (77096 records). [2025-09-17T04:37:11.929421] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-17T04:37:12.140289] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T04:37:12.141233] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:37:12.141314] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:37:12.141398] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-17T04:37:12.141497] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-17T04:37:12.141553] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-17T04:37:12.141617] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-17T04:37:12.141753] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEY took 33.6s. Estimated remaining: 2h 52m 57s. Rate: 6.8 symbols/min [2025-09-17T04:37:12.329072] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:12.339409] [DEBUG] [LOCAL ] KFS: Loaded 6350 existing records from primary storage. [2025-09-17T04:37:12.339772] [INFO ] [MAIN ] KFS: Loaded 6350 existing records. [2025-09-17T04:37:12.423158] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T04:37:12.454782] [INFO ] [REMOTE ] KF: Full fetch complete (3957 records). [2025-09-17T04:37:12.455081] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-17T04:37:12.658372] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:12.685718] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-17T04:37:12.700175] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-17T04:37:12.754111] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-17T04:37:12.799491] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-17T04:37:12.847934] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-17T04:37:13.071380] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-17T04:37:13.081806] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-17T04:37:13.099939] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-17T04:37:13.106173] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-17T04:37:13.124192] [DEBUG] [LOCAL ] KF: Trimmed 3957 records to 2521 (keeping 200 days of data) [2025-09-17T04:37:13.244001] [DEBUG] [LOCAL ] KF: Primary data saved (2521 records). [2025-09-17T04:37:13.272817] [INFO ] [MAIN ] KF: Full history saved. [2025-09-17T04:37:13.273248] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KF took 25.8s. Estimated remaining: 2h 52m 40s. Rate: 6.9 symbols/min [2025-09-17T04:37:13.480875] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:13.501027] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-17T04:37:13.533761] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:13.556114] [DEBUG] [LOCAL ] KFY: Loaded 21739 existing records from primary storage. [2025-09-17T04:37:13.556288] [INFO ] [MAIN ] KFY: Loaded 21739 existing records. [2025-09-17T04:37:13.738635] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:13.739086] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-17T04:37:13.739219] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-17T04:37:13.747078] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-17T04:37:13.748596] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-17T04:37:13.749482] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T04:37:14.147773] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:14.290133] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-11. [2025-09-17T04:37:14.925735] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T04:37:15.090129] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-17T04:37:15.185603] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T04:37:15.735477] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T04:37:15.890147] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-17T04:37:16.690197] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-17T04:37:16.860497] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T04:37:17.120320] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:37:17.490203] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-17T04:37:18.290203] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-17T04:37:19.090114] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-11. [2025-09-17T04:37:19.196396] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:37:19.331390] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T04:37:19.890145] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-17T04:37:19.968081] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T04:37:20.690182] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-17T04:37:21.160479] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T04:37:21.363142] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T04:37:21.490166] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-17T04:37:22.290209] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-17T04:37:22.410804] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T04:37:22.701136] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T04:37:23.090145] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-17T04:37:23.890102] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-17T04:37:24.180886] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T04:37:24.277370] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-17T04:37:24.690234] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-17T04:37:25.490141] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-17T04:37:26.171176] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:37:26.290139] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-17T04:37:26.681022] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T04:37:27.090191] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-17T04:37:27.582277] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:37:27.890131] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-17T04:37:28.338165] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T04:37:28.690247] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-17T04:37:29.251526] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T04:37:29.490178] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-17T04:37:29.514079] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:37:29.519635] [INFO ] [REMOTE ] KEYS: Full fetch complete (62912 records). [2025-09-17T04:37:29.519780] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-17T04:37:29.909609] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-17T04:37:29.909734] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-17T04:37:29.910612] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-17T04:37:29.910693] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-17T04:37:29.911977] [DEBUG] [LOCAL ] KEYS: Trimmed 62912 records to 43478 (keeping 200 days of data) [2025-09-17T04:37:30.017680] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T04:37:30.187837] [DEBUG] [LOCAL ] KEYS: Primary data saved (43478 records). [2025-09-17T04:37:30.188005] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-17T04:37:30.188100] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KEYS took 43.3s. Estimated remaining: 2h 52m 40s. Rate: 6.8 symbols/min [2025-09-17T04:37:30.292896] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-17T04:37:30.370373] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:30.412266] [DEBUG] [LOCAL ] KGC: Loaded 40050 existing records from primary storage. [2025-09-17T04:37:30.412435] [INFO ] [MAIN ] KGC: Loaded 40050 existing records. [2025-09-17T04:37:30.594620] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:30.594954] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-17T04:37:30.595021] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-17T04:37:30.596171] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-17T04:37:30.596242] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-17T04:37:30.953405] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:31.086334] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T04:37:31.090080] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-17T04:37:31.890105] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-11. [2025-09-17T04:37:32.184959] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T04:37:32.690214] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-17T04:37:33.264263] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T04:37:33.490113] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-17T04:37:33.806626] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T04:37:34.290187] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-17T04:37:34.627440] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:37:35.090153] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-17T04:37:35.363524] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:37:35.366895] [INFO ] [REMOTE ] KFRC: Full fetch complete (24734 records). [2025-09-17T04:37:35.366995] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-17T04:37:35.742444] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-17T04:37:35.751714] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-17T04:37:35.753300] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-17T04:37:35.753467] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-17T04:37:35.752215] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T04:37:35.758203] [DEBUG] [LOCAL ] KFRC: Trimmed 24734 records to 19076 (keeping 200 days of data) [2025-09-17T04:37:35.888713] [DEBUG] [LOCAL ] KFRC: Primary data saved (19076 records). [2025-09-17T04:37:35.888990] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-17T04:37:35.889148] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KFRC took 33.0s. Estimated remaining: 2h 52m 28s. Rate: 6.8 symbols/min [2025-09-17T04:37:35.895275] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-17T04:37:36.106372] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:36.150811] [DEBUG] [LOCAL ] KGS: Loaded 33944 existing records from primary storage. [2025-09-17T04:37:36.151050] [INFO ] [MAIN ] KGS: Loaded 33944 existing records. [2025-09-17T04:37:36.360330] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:36.360853] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-17T04:37:36.360952] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-17T04:37:36.361944] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-17T04:37:36.362032] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-17T04:37:36.706964] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-17T04:37:36.752818] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:37.314289] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:37:37.490194] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-11. [2025-09-17T04:37:37.537564] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T04:37:37.539736] [INFO ] [REMOTE ] KFS: Full fetch complete (10198 records). [2025-09-17T04:37:37.539906] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-17T04:37:37.940463] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-17T04:37:37.940606] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-17T04:37:37.941028] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-17T04:37:37.941095] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-17T04:37:37.941752] [DEBUG] [LOCAL ] KFS: Trimmed 10198 records to 8004 (keeping 200 days of data) [2025-09-17T04:37:37.994882] [DEBUG] [LOCAL ] KFS: Primary data saved (8004 records). [2025-09-17T04:37:37.995104] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-17T04:37:37.995267] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KFS took 25.9s. Estimated remaining: 2h 52m 12s. Rate: 6.9 symbols/min [2025-09-17T04:37:38.175094] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:38.233963] [DEBUG] [LOCAL ] KIM: Loaded 39507 existing records from primary storage. [2025-09-17T04:37:38.234247] [INFO ] [MAIN ] KIM: Loaded 39507 existing records. [2025-09-17T04:37:38.302162] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-17T04:37:38.445325] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:38.445763] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-17T04:37:38.445850] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-17T04:37:38.446955] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-17T04:37:38.447044] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-17T04:37:38.864888] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:38.942935] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T04:37:39.090207] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-17T04:37:39.253491] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T04:37:39.890151] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-17T04:37:40.566882] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T04:37:40.690167] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-17T04:37:41.490145] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-17T04:37:41.809618] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T04:37:42.201842] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T04:37:42.290083] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-17T04:37:42.342039] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:37:43.090229] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-17T04:37:43.462885] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:37:43.890161] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-11. [2025-09-17T04:37:44.465312] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T04:37:44.690134] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-17T04:37:45.490153] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-17T04:37:45.636009] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:37:46.217777] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T04:37:46.290096] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-17T04:37:47.090129] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-17T04:37:47.139915] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T04:37:47.890136] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-17T04:37:48.093627] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T04:37:48.160587] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T04:37:48.690208] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-17T04:37:49.377329] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T04:37:49.490146] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-17T04:37:50.287692] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:37:50.297027] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-17T04:37:51.095233] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-17T04:37:51.119805] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:37:51.832113] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:37:51.890121] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-17T04:37:52.690125] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-17T04:37:53.147806] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T04:37:53.495348] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-17T04:37:53.505417] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:37:53.949602] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T04:37:54.290241] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-17T04:37:55.090147] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-17T04:37:55.533542] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T04:37:55.763858] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T04:37:55.890129] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-17T04:37:56.539930] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:37:56.690151] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-17T04:37:57.490140] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-17T04:37:57.628114] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:37:58.119318] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T04:37:58.290106] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-17T04:37:59.031863] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:37:59.090105] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-17T04:37:59.188003] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T04:37:59.194851] [INFO ] [REMOTE ] KFY: Full fetch complete (43601 records). [2025-09-17T04:37:59.195000] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-17T04:37:59.575928] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-17T04:37:59.576066] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-17T04:37:59.576886] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-17T04:37:59.576951] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-17T04:37:59.578229] [DEBUG] [LOCAL ] KFY: Trimmed 43601 records to 30758 (keeping 200 days of data) [2025-09-17T04:37:59.785395] [DEBUG] [LOCAL ] KFY: Primary data saved (30758 records). [2025-09-17T04:37:59.785603] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-17T04:37:59.785745] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KFY took 46.5s. Estimated remaining: 2h 52m 17s. Rate: 6.8 symbols/min [2025-09-17T04:37:59.895368] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-17T04:37:59.958752] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:59.975916] [DEBUG] [LOCAL ] KIO: Loaded 15558 existing records from primary storage. [2025-09-17T04:37:59.976062] [INFO ] [MAIN ] KIO: Loaded 15558 existing records. [2025-09-17T04:38:00.154388] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:00.154711] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-17T04:38:00.154784] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-17T04:38:00.155381] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-17T04:38:00.155445] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-17T04:38:00.510815] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:00.690114] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-11. [2025-09-17T04:38:00.896615] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T04:38:01.490239] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-17T04:38:01.763399] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T04:38:02.164766] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-17T04:38:02.290225] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-17T04:38:03.090167] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-17T04:38:03.245826] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T04:38:03.639402] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T04:38:03.890170] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-17T04:38:04.114909] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:38:04.690217] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-17T04:38:05.490199] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-17T04:38:05.640902] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T04:38:06.290238] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-17T04:38:06.539016] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T04:38:06.757815] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T04:38:07.090155] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-17T04:38:07.890149] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-17T04:38:08.029068] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:38:08.690114] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-17T04:38:08.823776] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T04:38:08.937627] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T04:38:09.490143] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-17T04:38:10.243435] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:38:10.249570] [INFO ] [REMOTE ] KGS: Full fetch complete (65509 records). [2025-09-17T04:38:10.249761] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-17T04:38:10.295322] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-17T04:38:10.655615] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-17T04:38:10.655794] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-17T04:38:10.656949] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-17T04:38:10.657036] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-17T04:38:10.658855] [DEBUG] [LOCAL ] KGS: Trimmed 65509 records to 45743 (keeping 200 days of data) [2025-09-17T04:38:10.958978] [DEBUG] [LOCAL ] KGS: Primary data saved (45743 records). [2025-09-17T04:38:10.959149] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-17T04:38:10.959252] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGS took 35.1s. Estimated remaining: 2h 52m 10s. Rate: 6.8 symbols/min [2025-09-17T04:38:11.104191] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-17T04:38:11.138605] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:11.182666] [DEBUG] [LOCAL ] KKR: Loaded 39871 existing records from primary storage. [2025-09-17T04:38:11.182907] [INFO ] [MAIN ] KKR: Loaded 39871 existing records. [2025-09-17T04:38:11.371817] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:11.372133] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-17T04:38:11.372187] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-17T04:38:11.373167] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-17T04:38:11.373230] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-17T04:38:11.690279] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:38:11.778951] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-17T04:38:11.809578] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:11.816513] [INFO ] [REMOTE ] KGC: Full fetch complete (77599 records). [2025-09-17T04:38:11.816739] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-17T04:38:11.895224] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-11. [2025-09-17T04:38:12.265240] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-17T04:38:12.265353] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-17T04:38:12.266353] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-17T04:38:12.266433] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-17T04:38:12.268013] [DEBUG] [LOCAL ] KGC: Trimmed 77599 records to 53699 (keeping 200 days of data) [2025-09-17T04:38:12.601299] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:38:12.611612] [INFO ] [REMOTE ] KIM: Full fetch complete (76651 records). [2025-09-17T04:38:12.612305] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-17T04:38:12.691518] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-17T04:38:13.036898] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-17T04:38:13.037275] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-17T04:38:13.039309] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-17T04:38:13.039674] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-17T04:38:13.042268] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-17T04:38:13.042601] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-17T04:38:13.042752] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KGC took 42.9s. Estimated remaining: 2h 51m 55s. Rate: 6.8 symbols/min [2025-09-17T04:38:13.148073] [DEBUG] [LOCAL ] KIM: Trimmed 76651 records to 53076 (keeping 200 days of data) [2025-09-17T04:38:13.312318] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:13.322275] [DEBUG] [LOCAL ] KKRS: Loaded 4505 existing records from primary storage. [2025-09-17T04:38:13.323362] [INFO ] [MAIN ] KKRS: Loaded 4505 existing records. [2025-09-17T04:38:13.514233] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:13.516730] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-17T04:38:13.517594] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-17T04:38:13.518854] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-17T04:38:13.519433] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-17T04:38:13.904610] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:13.905916] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-11. [2025-09-17T04:38:13.931171] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T04:38:14.068438] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T04:38:14.191574] [DEBUG] [LOCAL ] KIM: Primary data saved (53076 records). [2025-09-17T04:38:14.191817] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-17T04:38:14.191956] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KIM took 36.2s. Estimated remaining: 2h 51m 39s. Rate: 6.9 symbols/min [2025-09-17T04:38:14.294601] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-17T04:38:14.367394] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:14.370716] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-17T04:38:14.371303] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T04:38:14.371176] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-17T04:38:14.372935] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-17T04:38:14.372997] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-17T04:38:14.373051] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-17T04:38:14.373088] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-17T04:38:14.738396] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:15.090159] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-17T04:38:15.358543] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T04:38:15.890153] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-17T04:38:16.529999] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T04:38:16.690133] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-17T04:38:16.985567] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T04:38:17.353210] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T04:38:17.490157] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-17T04:38:18.290181] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-11. [2025-09-17T04:38:18.486236] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:18.486670] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-11 [2025-09-17T04:38:19.090105] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-17T04:38:19.121990] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:38:19.424280] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T04:38:19.890130] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-17T04:38:20.090282] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:20.090672] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-17T04:38:20.690219] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-17T04:38:21.269503] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T04:38:21.490159] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-17T04:38:21.696979] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:21.697381] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-17T04:38:22.290183] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-17T04:38:22.488144] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:22.488488] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-17T04:38:23.090138] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-17T04:38:23.890106] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-17T04:38:24.350753] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T04:38:24.690153] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-17T04:38:25.240761] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T04:38:25.490136] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-17T04:38:25.686043] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:25.686400] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-17T04:38:25.734690] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T04:38:26.290134] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-17T04:38:27.090140] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-17T04:38:27.467778] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T04:38:27.890180] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-17T04:38:28.689929] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T04:38:28.690284] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-17T04:38:29.083755] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T04:38:29.490100] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-17T04:38:29.791755] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T04:38:29.794747] [INFO ] [REMOTE ] KIO: Full fetch complete (30901 records). [2025-09-17T04:38:29.794869] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-17T04:38:30.181072] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-17T04:38:30.181188] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-17T04:38:30.181810] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-17T04:38:30.181866] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-17T04:38:30.182756] [DEBUG] [LOCAL ] KIO: Trimmed 30901 records to 21439 (keeping 200 days of data) [2025-09-17T04:38:30.290795] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-17T04:38:30.319833] [DEBUG] [LOCAL ] KIO: Primary data saved (21439 records). [2025-09-17T04:38:30.319992] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-17T04:38:30.320081] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KIO took 30.5s. Estimated remaining: 2h 51m 37s. Rate: 6.8 symbols/min [2025-09-17T04:38:30.489524] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:30.489774] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-17T04:38:30.489827] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-17T04:38:30.489941] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-17T04:38:30.489991] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-17T04:38:30.490038] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-17T04:38:30.490082] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-17T04:38:30.534745] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:30.583006] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-17T04:38:30.852151] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:31.090148] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-11. [2025-09-17T04:38:31.287873] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:31.288241] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-11 [2025-09-17T04:38:31.405190] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T04:38:31.890162] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-17T04:38:32.271746] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T04:38:32.690147] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-17T04:38:33.490145] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-17T04:38:34.245035] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:38:34.290182] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-17T04:38:34.584620] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T04:38:35.045267] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:38:35.090137] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-17T04:38:35.276452] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:35.276885] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-17T04:38:35.890179] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-17T04:38:36.690145] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-17T04:38:37.018773] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T04:38:37.490143] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-17T04:38:37.679202] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:37.679555] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-17T04:38:38.290128] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-17T04:38:38.467714] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T04:38:39.059147] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:38:39.090145] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-17T04:38:39.890143] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-17T04:38:40.690171] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-17T04:38:40.771547] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T04:38:40.881551] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:40.882203] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-17T04:38:41.117216] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:38:41.490158] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-17T04:38:42.290143] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-17T04:38:42.300981] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T04:38:43.075089] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T04:38:43.076751] [INFO ] [REMOTE ] KKRT: Full fetch complete (7991 records). [2025-09-17T04:38:43.076846] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-17T04:38:43.097281] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-17T04:38:43.265516] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 75 unique days, need 200 days [2025-09-17T04:38:43.265963] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:38:43.266019] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:38:43.266068] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-17T04:38:43.266147] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-17T04:38:43.266193] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-17T04:38:43.266253] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-17T04:38:43.266323] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KKRT took 29.1s. Estimated remaining: 2h 51m 32s. Rate: 6.8 symbols/min [2025-09-17T04:38:43.389597] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:43.437601] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-17T04:38:43.439415] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:43.471848] [DEBUG] [LOCAL ] KLC: Loaded 26417 existing records from primary storage. [2025-09-17T04:38:43.472173] [INFO ] [MAIN ] KLC: Loaded 26417 existing records. [2025-09-17T04:38:43.663527] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:43.663856] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-17T04:38:43.663919] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-17T04:38:43.664617] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-17T04:38:43.664715] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-17T04:38:43.898236] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-17T04:38:44.027210] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:44.690166] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-17T04:38:45.265707] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T04:38:45.490178] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-17T04:38:46.062050] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T04:38:46.063228] [INFO ] [REMOTE ] KKRS: Full fetch complete (8069 records). [2025-09-17T04:38:46.063313] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-17T04:38:46.295247] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-11. [2025-09-17T04:38:46.421376] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-17T04:38:46.421489] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-17T04:38:46.421775] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-17T04:38:46.421832] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-17T04:38:46.422277] [DEBUG] [LOCAL ] KKRS: Trimmed 8069 records to 5780 (keeping 200 days of data) [2025-09-17T04:38:46.457912] [DEBUG] [LOCAL ] KKRS: Primary data saved (5780 records). [2025-09-17T04:38:46.458039] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-17T04:38:46.458136] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKRS took 33.4s. Estimated remaining: 2h 51m 18s. Rate: 6.8 symbols/min [2025-09-17T04:38:46.627359] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:46.667118] [DEBUG] [LOCAL ] KLG: Loaded 31005 existing records from primary storage. [2025-09-17T04:38:46.667404] [INFO ] [MAIN ] KLG: Loaded 31005 existing records. [2025-09-17T04:38:46.847425] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:46.847704] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-17T04:38:46.847760] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-17T04:38:46.848419] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-17T04:38:46.848483] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-17T04:38:47.100761] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-17T04:38:47.223123] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:47.253769] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (3.36 seconds). [2025-09-17T04:38:47.329381] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:47.329831] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-17T04:38:47.713146] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:38:47.890143] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-17T04:38:48.690211] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-17T04:38:48.881800] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:48.882208] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-17T04:38:49.490136] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-17T04:38:49.683121] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:49.686442] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-17T04:38:49.688163] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:38:49.698594] [INFO ] [REMOTE ] KKR: Full fetch complete (77307 records). [2025-09-17T04:38:49.698838] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-17T04:38:50.112347] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-17T04:38:50.112487] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-17T04:38:50.113712] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-17T04:38:50.113776] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-17T04:38:50.115863] [DEBUG] [LOCAL ] KKR: Trimmed 77307 records to 53517 (keeping 200 days of data) [2025-09-17T04:38:50.317297] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-17T04:38:50.479563] [DEBUG] [LOCAL ] KKR: Primary data saved (53517 records). [2025-09-17T04:38:50.479779] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-17T04:38:50.479884] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKR took 39.5s. Estimated remaining: 2h 51m 5s. Rate: 6.9 symbols/min [2025-09-17T04:38:51.090213] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-17T04:38:51.286133] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:51.286531] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-17T04:38:51.776360] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:38:51.890142] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-17T04:38:52.073821] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:52.074201] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-17T04:38:52.690137] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-17T04:38:53.490104] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-17T04:38:53.635528] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T04:38:53.638433] [INFO ] [REMOTE ] KLAR: Full fetch complete (1733 records). [2025-09-17T04:38:53.638524] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-17T04:38:53.827573] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-17T04:38:53.828825] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:38:53.828896] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:38:53.828942] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-17T04:38:53.829020] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-17T04:38:53.829066] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-17T04:38:53.829127] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-17T04:38:53.829329] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KLAR took 23.5s. Estimated remaining: 2h 50m 51s. Rate: 6.9 symbols/min [2025-09-17T04:38:54.290193] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-11. [2025-09-17T04:38:54.830317] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:38:55.090138] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-17T04:38:55.979493] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T04:38:55.989147] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-17T04:38:56.167809] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:38:56.690156] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-17T04:38:57.558868] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T04:38:57.569325] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-17T04:38:58.032493] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T04:38:58.290188] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-17T04:38:58.849809] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:38:59.090140] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-17T04:38:59.784263] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T04:38:59.890216] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-17T04:39:00.321028] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T04:39:00.690152] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-17T04:39:01.316068] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:39:01.490153] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-17T04:39:03.072167] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-17T04:39:03.082142] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-17T04:39:04.155991] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-17T04:39:04.163563] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-17T04:39:04.895511] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:39:04.905017] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-17T04:39:05.549223] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T04:39:05.557133] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-17T04:39:06.464127] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:39:06.473036] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-17T04:39:06.937479] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T04:39:06.946121] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-17T04:39:07.912836] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:39:07.922600] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-17T04:39:07.938329] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T04:39:07.943596] [INFO ] [REMOTE ] KLC: Full fetch complete (50606 records). [2025-09-17T04:39:07.943753] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-17T04:39:08.327459] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-17T04:39:08.327575] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-17T04:39:08.328471] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-17T04:39:08.328534] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-17T04:39:08.329904] [DEBUG] [LOCAL ] KLC: Trimmed 50606 records to 36073 (keeping 200 days of data) [2025-09-17T04:39:08.547717] [DEBUG] [LOCAL ] KLC: Primary data saved (36073 records). [2025-09-17T04:39:08.547922] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-17T04:39:08.548030] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KLC took 25.3s. Estimated remaining: 2h 50m 48s. Rate: 6.9 symbols/min [2025-09-17T04:39:09.720113] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:39:09.730829] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-17T04:39:11.217371] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T04:39:11.225745] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-17T04:39:12.696023] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:39:12.701109] [INFO ] [REMOTE ] KLG: Full fetch complete (61873 records). [2025-09-17T04:39:12.701258] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-17T04:39:13.110359] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-17T04:39:13.110497] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-17T04:39:13.111612] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-17T04:39:13.111726] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-17T04:39:13.113212] [DEBUG] [LOCAL ] KLG: Trimmed 61873 records to 41934 (keeping 200 days of data) [2025-09-17T04:39:13.515537] [DEBUG] [LOCAL ] KLG: Primary data saved (41934 records). [2025-09-17T04:39:13.515897] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-17T04:39:13.516063] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KLG took 27.1s. Estimated remaining: 2h 50m 35s. Rate: 6.9 symbols/min [2025-09-17T04:39:14.446631] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.500307] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.510164] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.511408] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.520615] [DEBUG] [LOCAL ] KMPB: Loaded 2577 existing records from primary storage. [2025-09-17T04:39:14.523800] [INFO ] [MAIN ] KMPB: Loaded 2577 existing records. [2025-09-17T04:39:14.681118] [DEBUG] [LOCAL ] KMT: Loaded 32017 existing records from primary storage. [2025-09-17T04:39:14.675386] [DEBUG] [LOCAL ] KMPR: Loaded 29360 existing records from primary storage. [2025-09-17T04:39:14.717884] [INFO ] [MAIN ] KMT: Loaded 32017 existing records. [2025-09-17T04:39:14.759804] [INFO ] [MAIN ] KMPR: Loaded 29360 existing records. [2025-09-17T04:39:14.805463] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:14.948614] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-17T04:39:14.959814] [DEBUG] [LOCAL ] KMI: Loaded 40043 existing records from primary storage. [2025-09-17T04:39:14.981384] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-17T04:39:14.997450] [INFO ] [MAIN ] KMI: Loaded 40043 existing records. [2025-09-17T04:39:15.038115] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-17T04:39:15.152302] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:15.184058] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-17T04:39:15.257617] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-17T04:39:15.245525] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:15.282487] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-17T04:39:15.317542] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-17T04:39:15.372258] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-17T04:39:15.338226] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-17T04:39:15.386189] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-17T04:39:15.386117] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-17T04:39:15.446935] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-17T04:39:15.519000] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:15.592970] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-17T04:39:15.594495] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-17T04:39:15.687467] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-17T04:39:15.804713] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-17T04:39:16.219787] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.408014] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-11. [2025-09-17T04:39:16.763029] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.780929] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-11. [2025-09-17T04:39:16.800181] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.805883] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-11. [2025-09-17T04:39:16.866569] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.868431] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-11. [2025-09-17T04:39:17.099384] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T04:39:17.100737] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-17T04:39:17.640490] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T04:39:17.642047] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-17T04:39:17.856201] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T04:39:17.865503] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-17T04:39:17.884793] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:39:17.891177] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-17T04:39:18.074269] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T04:39:18.075511] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-17T04:39:18.424431] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T04:39:18.425892] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-17T04:39:18.622456] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:39:18.633033] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-17T04:39:18.707385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:39:18.713112] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-17T04:39:18.756508] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T04:39:19.090150] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-17T04:39:19.266760] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T04:39:19.620916] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-17T04:39:19.868786] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T04:39:19.890073] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-17T04:39:20.670628] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T04:39:20.690081] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-17T04:39:21.120547] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T04:39:21.490155] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-17T04:39:22.008482] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T04:39:22.290164] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-17T04:39:22.814682] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T04:39:23.090145] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-17T04:39:23.267958] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T04:39:23.710435] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T04:39:23.890148] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-17T04:39:24.690162] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-17T04:39:25.308819] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:39:25.490193] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-17T04:39:26.290198] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-17T04:39:26.706168] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T04:39:26.794929] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T04:39:27.090235] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-17T04:39:27.224260] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T04:39:27.890135] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-17T04:39:28.690148] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-17T04:39:28.838221] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:39:29.490222] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-17T04:39:29.904329] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T04:39:30.161449] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T04:39:30.290111] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-17T04:39:31.009967] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:39:31.090090] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-17T04:39:31.832178] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:39:31.890087] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-17T04:39:32.538193] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:39:32.690132] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-17T04:39:33.148231] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:39:33.490143] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-17T04:39:33.540085] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:39:34.290270] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-17T04:39:35.090157] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-17T04:39:35.511846] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T04:39:35.543038] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T04:39:35.805342] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T04:39:35.811106] [INFO ] [REMOTE ] KMPR: Full fetch complete (49673 records). [2025-09-17T04:39:35.811296] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-17T04:39:35.895275] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-17T04:39:36.212329] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-17T04:39:36.212512] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-17T04:39:36.213980] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-17T04:39:36.214067] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-17T04:39:36.216172] [DEBUG] [LOCAL ] KMPR: Trimmed 49673 records to 37685 (keeping 200 days of data) [2025-09-17T04:39:36.486354] [DEBUG] [LOCAL ] KMPR: Primary data saved (37685 records). [2025-09-17T04:39:36.486632] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-17T04:39:36.486821] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KMPR took 22.9s. Estimated remaining: 2h 50m 40s. Rate: 6.8 symbols/min [2025-09-17T04:39:36.669985] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:36.695994] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-17T04:39:36.715740] [DEBUG] [LOCAL ] KMX: Loaded 39668 existing records from primary storage. [2025-09-17T04:39:36.715983] [INFO ] [MAIN ] KMX: Loaded 39668 existing records. [2025-09-17T04:39:36.903410] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:36.903870] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-17T04:39:36.903955] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-17T04:39:36.905567] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-17T04:39:36.905733] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-17T04:39:37.285832] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T04:39:37.310217] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:37.310522] [INFO ] [REMOTE ] KMPB: Full fetch complete (4834 records). [2025-09-17T04:39:37.311887] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-17T04:39:37.505762] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-17T04:39:37.527452] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T04:39:37.731767] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-17T04:39:37.731892] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-17T04:39:37.732097] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-17T04:39:37.732149] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-17T04:39:37.732539] [DEBUG] [LOCAL ] KMPB: Trimmed 4834 records to 3647 (keeping 200 days of data) [2025-09-17T04:39:37.757094] [DEBUG] [LOCAL ] KMPB: Primary data saved (3647 records). [2025-09-17T04:39:37.757283] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-17T04:39:37.757389] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KMPB took 24.2s. Estimated remaining: 2h 50m 24s. Rate: 6.8 symbols/min [2025-09-17T04:39:37.925964] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:37.953926] [DEBUG] [LOCAL ] KN: Loaded 28017 existing records from primary storage. [2025-09-17T04:39:37.954168] [INFO ] [MAIN ] KN: Loaded 28017 existing records. [2025-09-17T04:39:38.138164] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:38.138523] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-17T04:39:38.138594] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-17T04:39:38.139320] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-17T04:39:38.139388] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-17T04:39:38.297063] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-17T04:39:38.508623] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:39.090154] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-11. [2025-09-17T04:39:39.478526] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T04:39:39.880301] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T04:39:39.890075] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-17T04:39:40.690144] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-17T04:39:40.813824] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:39:41.490198] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-17T04:39:41.532034] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:39:42.290165] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-17T04:39:42.543287] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T04:39:43.090153] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-11. [2025-09-17T04:39:43.261898] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:39:43.413021] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T04:39:43.890187] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-17T04:39:44.114189] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T04:39:44.690150] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-17T04:39:45.324424] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:39:45.329689] [INFO ] [REMOTE ] KMT: Full fetch complete (61694 records). [2025-09-17T04:39:45.329811] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-17T04:39:45.495006] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-17T04:39:45.725406] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-17T04:39:45.725516] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-17T04:39:45.726398] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-17T04:39:45.726463] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-17T04:39:45.727753] [DEBUG] [LOCAL ] KMT: Trimmed 61694 records to 43199 (keeping 200 days of data) [2025-09-17T04:39:46.007552] [DEBUG] [LOCAL ] KMT: Primary data saved (43199 records). [2025-09-17T04:39:46.007756] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-17T04:39:46.007869] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMT took 32.5s. Estimated remaining: 2h 50m 15s. Rate: 6.8 symbols/min [2025-09-17T04:39:46.184381] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:46.213036] [DEBUG] [LOCAL ] KNF: Loaded 26715 existing records from primary storage. [2025-09-17T04:39:46.213236] [INFO ] [MAIN ] KNF: Loaded 26715 existing records. [2025-09-17T04:39:46.292704] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-17T04:39:46.397535] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:46.397976] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-17T04:39:46.398131] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-17T04:39:46.408019] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-17T04:39:46.423959] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-17T04:39:46.502550] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:39:46.793168] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:47.003772] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:39:47.090127] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-17T04:39:47.890169] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-17T04:39:48.383086] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T04:39:48.523393] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T04:39:48.690144] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-17T04:39:48.913494] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T04:39:49.490131] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-17T04:39:50.290137] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-11. [2025-09-17T04:39:50.427268] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:39:50.930472] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T04:39:51.090174] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-17T04:39:51.652202] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T04:39:51.890129] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-17T04:39:52.539025] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:39:52.690133] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-17T04:39:52.998074] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T04:39:53.490130] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-17T04:39:54.290132] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-17T04:39:54.465869] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:39:55.090167] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-17T04:39:55.345715] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T04:39:55.352894] [INFO ] [REMOTE ] KMI: Full fetch complete (77658 records). [2025-09-17T04:39:55.353151] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-17T04:39:55.792260] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-17T04:39:55.792487] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-17T04:39:55.793704] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-17T04:39:55.793859] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-17T04:39:55.797429] [DEBUG] [LOCAL ] KMI: Trimmed 77658 records to 53693 (keeping 200 days of data) [2025-09-17T04:39:55.825610] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:39:55.890358] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-17T04:39:56.178566] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-17T04:39:56.178869] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-17T04:39:56.179073] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMI took 42.7s. Estimated remaining: 2h 50m 8s. Rate: 6.8 symbols/min [2025-09-17T04:39:56.370142] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:56.382420] [DEBUG] [LOCAL ] KNOP: Loaded 6647 existing records from primary storage. [2025-09-17T04:39:56.382696] [INFO ] [MAIN ] KNOP: Loaded 6647 existing records. [2025-09-17T04:39:56.575542] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:56.575933] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-17T04:39:56.576026] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-17T04:39:56.576570] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-17T04:39:56.576719] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-17T04:39:56.695379] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-17T04:39:56.981042] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:57.086358] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T04:39:57.118317] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T04:39:57.490175] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-17T04:39:58.132089] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:39:58.290141] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-17T04:39:58.921186] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:39:59.090153] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-17T04:39:59.150879] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:39:59.890164] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-11. [2025-09-17T04:40:00.396230] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T04:40:00.690158] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-17T04:40:00.736878] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T04:40:01.490173] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-17T04:40:02.209415] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:40:02.290201] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-17T04:40:02.614893] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T04:40:03.090147] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-17T04:40:03.265790] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T04:40:03.890166] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-17T04:40:04.564185] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:40:04.678404] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T04:40:04.690137] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-17T04:40:05.490219] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-17T04:40:06.290235] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-17T04:40:06.537969] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T04:40:06.804657] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:40:07.003120] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:40:07.090227] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-17T04:40:07.890259] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-17T04:40:08.349024] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T04:40:08.690208] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-17T04:40:08.779877] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T04:40:09.490148] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-17T04:40:10.290163] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-17T04:40:10.667813] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T04:40:10.929239] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T04:40:10.950194] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T04:40:11.090198] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-17T04:40:11.890216] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-17T04:40:12.202183] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T04:40:12.209520] [INFO ] [REMOTE ] KN: Full fetch complete (56116 records). [2025-09-17T04:40:12.209741] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-17T04:40:12.610454] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-17T04:40:12.610603] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-17T04:40:12.611663] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-17T04:40:12.611732] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-17T04:40:12.613194] [DEBUG] [LOCAL ] KN: Trimmed 56116 records to 39122 (keeping 200 days of data) [2025-09-17T04:40:12.708847] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-17T04:40:12.736924] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:40:12.866989] [DEBUG] [LOCAL ] KN: Primary data saved (39122 records). [2025-09-17T04:40:12.867158] [INFO ] [MAIN ] KN: Full history saved. [2025-09-17T04:40:12.867292] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KN took 35.1s. Estimated remaining: 2h 50m 7s. Rate: 6.8 symbols/min [2025-09-17T04:40:13.039126] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:13.054580] [DEBUG] [LOCAL ] KNSL: Loaded 13618 existing records from primary storage. [2025-09-17T04:40:13.054780] [INFO ] [MAIN ] KNSL: Loaded 13618 existing records. [2025-09-17T04:40:13.236104] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:13.236355] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-17T04:40:13.236438] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-17T04:40:13.236943] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-17T04:40:13.237009] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-17T04:40:13.495222] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-17T04:40:13.598147] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:14.136983] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:40:14.290150] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-17T04:40:14.358127] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:40:15.090203] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-11. [2025-09-17T04:40:15.890135] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-17T04:40:16.040259] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T04:40:16.117589] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T04:40:16.690145] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-17T04:40:17.336611] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:40:17.490132] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-17T04:40:18.290144] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-17T04:40:18.478091] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T04:40:18.484784] [INFO ] [REMOTE ] KMX: Full fetch complete (75722 records). [2025-09-17T04:40:18.484964] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-17T04:40:18.883988] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-17T04:40:18.884197] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-17T04:40:18.885318] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-17T04:40:18.885393] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-17T04:40:18.898580] [DEBUG] [LOCAL ] KMX: Trimmed 75722 records to 53084 (keeping 200 days of data) [2025-09-17T04:40:18.898471] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T04:40:18.904226] [INFO ] [REMOTE ] KNF: Full fetch complete (49793 records). [2025-09-17T04:40:18.904343] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-17T04:40:19.091666] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-17T04:40:19.342505] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T04:40:19.417293] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-17T04:40:19.418175] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-17T04:40:19.419735] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-17T04:40:19.420813] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-17T04:40:19.425300] [DEBUG] [LOCAL ] KNF: Trimmed 49793 records to 35622 (keeping 200 days of data) [2025-09-17T04:40:19.833680] [DEBUG] [LOCAL ] KNF: Primary data saved (35622 records). [2025-09-17T04:40:19.835801] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-17T04:40:19.836512] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNF took 33.8s. Estimated remaining: 2h 49m 56s. Rate: 6.8 symbols/min [2025-09-17T04:40:19.897405] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-17T04:40:20.021295] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:20.040823] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T04:40:20.047067] [DEBUG] [LOCAL ] KMX: Primary data saved (53084 records). [2025-09-17T04:40:20.047658] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-17T04:40:20.047773] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KMX took 43.6s. Estimated remaining: 2h 49m 39s. Rate: 6.8 symbols/min [2025-09-17T04:40:20.248950] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:20.249925] [DEBUG] [LOCAL ] KNTK: Loaded 35014 existing records from primary storage. [2025-09-17T04:40:20.250556] [INFO ] [MAIN ] KNTK: Loaded 35014 existing records. [2025-09-17T04:40:20.442898] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:20.443157] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-17T04:40:20.443220] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-17T04:40:20.444234] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-17T04:40:20.444329] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-17T04:40:20.579763] [DEBUG] [LOCAL ] KNX: Loaded 39070 existing records from primary storage. [2025-09-17T04:40:20.608892] [INFO ] [MAIN ] KNX: Loaded 39070 existing records. [2025-09-17T04:40:20.697060] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-17T04:40:20.928533] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:20.987943] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-17T04:40:21.007152] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-17T04:40:21.011473] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:21.018308] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-17T04:40:21.024750] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-17T04:40:21.031276] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T04:40:21.391744] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:21.490102] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-11. [2025-09-17T04:40:21.512565] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T04:40:22.290162] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-11. [2025-09-17T04:40:23.090196] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-17T04:40:23.213263] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:40:23.678449] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T04:40:23.836465] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T04:40:23.838319] [INFO ] [REMOTE ] KNOP: Full fetch complete (14732 records). [2025-09-17T04:40:23.838424] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-17T04:40:23.900429] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-17T04:40:24.206468] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-17T04:40:24.206570] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-17T04:40:24.206963] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-17T04:40:24.207017] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-17T04:40:24.207609] [DEBUG] [LOCAL ] KNOP: Trimmed 14732 records to 9947 (keeping 200 days of data) [2025-09-17T04:40:24.268377] [DEBUG] [LOCAL ] KNOP: Primary data saved (9947 records). [2025-09-17T04:40:24.268518] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-17T04:40:24.268668] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNOP took 28.1s. Estimated remaining: 2h 49m 26s. Rate: 6.9 symbols/min [2025-09-17T04:40:24.489815] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:24.527243] [DEBUG] [LOCAL ] KO: Loaded 40168 existing records from primary storage. [2025-09-17T04:40:24.527417] [INFO ] [MAIN ] KO: Loaded 40168 existing records. [2025-09-17T04:40:24.702261] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-17T04:40:24.706610] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:24.707564] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-17T04:40:24.707697] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-17T04:40:24.709119] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-17T04:40:24.709205] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-17T04:40:25.066549] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:25.373298] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T04:40:25.490316] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-17T04:40:25.528393] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T04:40:26.290152] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-11. [2025-09-17T04:40:27.090162] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-17T04:40:27.172671] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T04:40:27.890143] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-17T04:40:28.147690] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T04:40:28.690181] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-17T04:40:28.842801] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-11 (2.55 seconds). [2025-09-17T04:40:29.490158] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-17T04:40:29.660360] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T04:40:30.116465] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T04:40:30.290164] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-17T04:40:30.564900] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T04:40:31.090211] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-17T04:40:31.894594] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-17T04:40:31.898259] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:40:31.922690] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T04:40:32.690205] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-17T04:40:33.490119] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-17T04:40:33.569457] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T04:40:33.817168] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T04:40:34.290164] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-17T04:40:34.499957] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T04:40:35.090139] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-17T04:40:35.836932] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T04:40:35.890130] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-17T04:40:36.690093] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-17T04:40:36.878157] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T04:40:37.021621] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T04:40:37.490093] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-17T04:40:37.889115] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T04:40:38.290214] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-17T04:40:39.090224] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-17T04:40:39.362351] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:40:39.887672] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T04:40:39.897094] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-17T04:40:40.690209] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-17T04:40:41.490172] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-17T04:40:41.657084] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T04:40:41.742271] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-17T04:40:41.834993] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T04:40:42.290178] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-17T04:40:42.450066] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T04:40:43.090187] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-17T04:40:43.890104] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-17T04:40:43.953207] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:40:44.027093] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:40:44.029503] [INFO ] [REMOTE ] KNSL: Full fetch complete (26500 records). [2025-09-17T04:40:44.029593] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-17T04:40:44.393015] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-17T04:40:44.393112] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-17T04:40:44.393659] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-17T04:40:44.393712] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-17T04:40:44.394390] [DEBUG] [LOCAL ] KNSL: Trimmed 26500 records to 18049 (keeping 200 days of data) [2025-09-17T04:40:44.508085] [DEBUG] [LOCAL ] KNSL: Primary data saved (18049 records). [2025-09-17T04:40:44.508251] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-17T04:40:44.508344] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KNSL took 31.6s. Estimated remaining: 2h 49m 28s. Rate: 6.8 symbols/min [2025-09-17T04:40:44.676701] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:44.693984] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-17T04:40:44.708306] [DEBUG] [LOCAL ] KODK: Loaded 32256 existing records from primary storage. [2025-09-17T04:40:44.708533] [INFO ] [MAIN ] KODK: Loaded 32256 existing records. [2025-09-17T04:40:44.890083] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:44.890356] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-17T04:40:44.890412] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-17T04:40:44.891132] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-17T04:40:44.891205] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-17T04:40:45.264867] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:45.490161] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-17T04:40:45.574434] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T04:40:46.290205] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-17T04:40:46.430284] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:40:47.090195] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-17T04:40:47.844365] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:40:47.850726] [INFO ] [REMOTE ] KNTK: Full fetch complete (63443 records). [2025-09-17T04:40:47.851057] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-17T04:40:47.895754] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-11. [2025-09-17T04:40:48.295619] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-17T04:40:48.298351] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-17T04:40:48.308589] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-17T04:40:48.310056] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-17T04:40:48.310812] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-17T04:40:48.312849] [DEBUG] [LOCAL ] KNTK: Trimmed 63443 records to 46120 (keeping 200 days of data) [2025-09-17T04:40:48.448841] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T04:40:48.653303] [DEBUG] [LOCAL ] KNTK: Primary data saved (46120 records). [2025-09-17T04:40:48.653492] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-17T04:40:48.653591] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KNTK took 28.8s. Estimated remaining: 2h 49m 15s. Rate: 6.8 symbols/min [2025-09-17T04:40:48.696384] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-17T04:40:48.825363] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:48.844433] [DEBUG] [LOCAL ] KOF: Loaded 19629 existing records from primary storage. [2025-09-17T04:40:48.844590] [INFO ] [MAIN ] KOF: Loaded 19629 existing records. [2025-09-17T04:40:49.021261] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:49.021502] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-17T04:40:49.021554] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-17T04:40:49.022120] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-17T04:40:49.022183] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-17T04:40:49.377638] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:49.490148] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-11. [2025-09-17T04:40:49.622388] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T04:40:50.290122] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-17T04:40:50.681255] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T04:40:50.795624] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T04:40:51.090136] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-17T04:40:51.882456] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:40:51.892099] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-17T04:40:52.690208] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-17T04:40:52.794834] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:40:52.803833] [INFO ] [REMOTE ] KNX: Full fetch complete (75402 records). [2025-09-17T04:40:52.804026] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-17T04:40:53.204030] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-17T04:40:53.204167] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-17T04:40:53.205293] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-17T04:40:53.205421] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-17T04:40:53.217460] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T04:40:53.222809] [DEBUG] [LOCAL ] KNX: Trimmed 75402 records to 52592 (keeping 200 days of data) [2025-09-17T04:40:53.490818] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-17T04:40:53.579145] [DEBUG] [LOCAL ] KNX: Primary data saved (52592 records). [2025-09-17T04:40:53.579352] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-17T04:40:53.579493] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KNX took 33.5s. Estimated remaining: 2h 49m 3s. Rate: 6.9 symbols/min [2025-09-17T04:40:53.751573] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:53.765962] [DEBUG] [LOCAL ] KOP: Loaded 12808 existing records from primary storage. [2025-09-17T04:40:53.766173] [INFO ] [MAIN ] KOP: Loaded 12808 existing records. [2025-09-17T04:40:53.947098] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:53.947364] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-17T04:40:53.947435] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-17T04:40:53.947962] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-17T04:40:53.948030] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-17T04:40:54.298217] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-17T04:40:54.303005] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:54.869037] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T04:40:55.090118] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-11. [2025-09-17T04:40:55.232397] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-17T04:40:55.400935] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T04:40:55.890202] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-17T04:40:56.018914] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T04:40:56.690153] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-17T04:40:57.490161] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-17T04:40:58.285276] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:40:58.296522] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-17T04:40:58.458880] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-17T04:40:58.482517] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:40:59.090298] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-17T04:40:59.446611] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T04:40:59.890196] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-17T04:41:00.690220] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-17T04:41:01.109774] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:41:01.490203] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-17T04:41:01.698713] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-17T04:41:01.725202] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:41:02.290179] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-17T04:41:02.752761] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T04:41:03.090206] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-17T04:41:03.294347] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T04:41:03.890226] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-17T04:41:04.077777] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T04:41:04.650123] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T04:41:04.690201] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-17T04:41:05.490177] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-17T04:41:05.769953] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T04:41:06.290136] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-17T04:41:06.726243] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T04:41:07.090172] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-17T04:41:07.890174] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-17T04:41:08.103308] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T04:41:08.690142] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-17T04:41:08.770991] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T04:41:09.498200] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-17T04:41:09.514935] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:41:09.602973] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T04:41:10.290188] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-17T04:41:11.090190] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-17T04:41:11.880318] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T04:41:11.890003] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-17T04:41:11.937730] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:41:12.313677] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-17T04:41:12.690204] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-17T04:41:13.184420] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T04:41:13.490140] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-17T04:41:13.885145] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T04:41:14.290187] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-17T04:41:15.090240] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-17T04:41:15.708464] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T04:41:15.890140] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-17T04:41:16.078585] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T04:41:16.186608] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-17T04:41:16.690133] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-17T04:41:17.402104] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T04:41:17.406016] [INFO ] [REMOTE ] KOP: Full fetch complete (25074 records). [2025-09-17T04:41:17.406228] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-17T04:41:17.493576] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-17T04:41:17.799955] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-17T04:41:17.800229] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-17T04:41:17.801204] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-17T04:41:17.816473] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-17T04:41:17.831294] [DEBUG] [LOCAL ] KOP: Trimmed 25074 records to 18072 (keeping 200 days of data) [2025-09-17T04:41:17.832576] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:41:17.958189] [DEBUG] [LOCAL ] KOP: Primary data saved (18072 records). [2025-09-17T04:41:17.958375] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-17T04:41:17.958503] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KOP took 24.4s. Estimated remaining: 2h 49m 9s. Rate: 6.8 symbols/min [2025-09-17T04:41:18.128600] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:18.131815] [DEBUG] [LOCAL ] KORE: Loaded 1535 existing records from primary storage. [2025-09-17T04:41:18.131907] [INFO ] [MAIN ] KORE: Loaded 1535 existing records. [2025-09-17T04:41:18.295300] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-17T04:41:18.323775] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:18.324062] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-17T04:41:18.324123] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-17T04:41:18.324508] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-17T04:41:18.324570] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-17T04:41:18.694400] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:19.090201] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-17T04:41:19.890146] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-11. [2025-09-17T04:41:20.095575] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:41:20.204893] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T04:41:20.234493] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-17T04:41:20.241245] [INFO ] [REMOTE ] KO: Full fetch complete (77993 records). [2025-09-17T04:41:20.241461] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-17T04:41:20.647837] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-17T04:41:20.656512] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-17T04:41:20.658162] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-17T04:41:20.659116] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:41:20.659285] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-17T04:41:20.666988] [DEBUG] [LOCAL ] KO: Trimmed 77993 records to 53818 (keeping 200 days of data) [2025-09-17T04:41:20.727432] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-17T04:41:21.033384] [DEBUG] [LOCAL ] KO: Primary data saved (53818 records). [2025-09-17T04:41:21.033599] [INFO ] [MAIN ] KO: Full history saved. [2025-09-17T04:41:21.033735] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KO took 56.8s. Estimated remaining: 2h 48m 55s. Rate: 6.8 symbols/min [2025-09-17T04:41:21.216455] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:21.271064] [DEBUG] [LOCAL ] KOS: Loaded 39572 existing records from primary storage. [2025-09-17T04:41:21.271335] [INFO ] [MAIN ] KOS: Loaded 39572 existing records. [2025-09-17T04:41:21.469058] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:21.469346] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-17T04:41:21.469412] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-17T04:41:21.470369] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-17T04:41:21.470437] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-17T04:41:21.495387] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-17T04:41:21.854944] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:22.204392] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T04:41:22.209718] [INFO ] [REMOTE ] KODK: Full fetch complete (63796 records). [2025-09-17T04:41:22.209947] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-17T04:41:22.295303] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-11. [2025-09-17T04:41:22.641968] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-17T04:41:22.642490] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-17T04:41:22.643996] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-17T04:41:22.644080] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-17T04:41:22.646180] [DEBUG] [LOCAL ] KODK: Trimmed 63796 records to 43444 (keeping 200 days of data) [2025-09-17T04:41:22.927317] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:41:22.933402] [DEBUG] [LOCAL ] KODK: Primary data saved (43444 records). [2025-09-17T04:41:22.937634] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-17T04:41:22.937809] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KODK took 38.4s. Estimated remaining: 2h 48m 39s. Rate: 6.8 symbols/min [2025-09-17T04:41:22.937925] [INFO ] [REMOTE ] KOF: Full fetch complete (36958 records). [2025-09-17T04:41:22.938433] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-17T04:41:23.095000] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-17T04:41:23.256529] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:23.536865] [DEBUG] [LOCAL ] KR: Loaded 40033 existing records from primary storage. [2025-09-17T04:41:23.602046] [INFO ] [MAIN ] KR: Loaded 40033 existing records. [2025-09-17T04:41:23.611714] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-17T04:41:23.656620] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-17T04:41:23.703321] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-17T04:41:23.730632] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-17T04:41:23.783746] [DEBUG] [LOCAL ] KOF: Trimmed 36958 records to 26043 (keeping 200 days of data) [2025-09-17T04:41:23.813215] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:23.813743] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-17T04:41:23.814043] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-17T04:41:23.815388] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-17T04:41:23.815515] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-17T04:41:24.237017] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:41:24.264122] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-17T04:41:24.363818] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:24.382337] [DEBUG] [LOCAL ] KOF: Primary data saved (26043 records). [2025-09-17T04:41:24.383062] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-17T04:41:24.383189] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KOF took 35.7s. Estimated remaining: 2h 48m 24s. Rate: 6.9 symbols/min [2025-09-17T04:41:24.516151] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T04:41:24.628590] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:24.664762] [DEBUG] [LOCAL ] KRC: Loaded 35713 existing records from primary storage. [2025-09-17T04:41:24.664940] [INFO ] [MAIN ] KRC: Loaded 35713 existing records. [2025-09-17T04:41:24.690172] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-11. [2025-09-17T04:41:24.846593] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:24.846898] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-17T04:41:24.846960] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-17T04:41:24.847838] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-17T04:41:24.847919] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-17T04:41:25.202886] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:25.219847] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T04:41:25.490161] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-17T04:41:26.031998] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T04:41:26.290118] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-11. [2025-09-17T04:41:26.363785] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:41:27.090130] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-17T04:41:27.869461] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T04:41:27.890096] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-17T04:41:28.690177] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-17T04:41:29.044953] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T04:41:29.113591] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T04:41:29.490168] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-17T04:41:29.909926] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T04:41:30.290154] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-17T04:41:30.544397] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T04:41:31.090167] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-17T04:41:31.857406] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T04:41:31.890079] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-17T04:41:32.690115] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-17T04:41:32.975987] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T04:41:33.100732] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T04:41:33.490168] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-17T04:41:33.929958] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T04:41:34.290112] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-17T04:41:34.403289] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T04:41:35.090182] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-17T04:41:35.891765] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-17T04:41:35.897756] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:41:36.690157] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-17T04:41:36.769298] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:41:37.490138] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-17T04:41:37.685198] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T04:41:38.290123] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-17T04:41:38.440950] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T04:41:39.090178] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-17T04:41:39.139298] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:41:39.890141] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-17T04:41:40.124981] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T04:41:40.174366] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-17T04:41:40.690166] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-17T04:41:40.973666] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T04:41:41.490133] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-17T04:41:42.290184] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-17T04:41:42.660265] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T04:41:42.705198] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T04:41:43.090137] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-17T04:41:43.890194] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-17T04:41:44.240332] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T04:41:44.323574] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T04:41:44.520379] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:41:44.690199] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-17T04:41:45.490195] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-17T04:41:45.927872] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T04:41:46.290190] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-17T04:41:46.786625] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:41:47.090200] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-17T04:41:47.896502] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-17T04:41:47.919851] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T04:41:48.667304] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T04:41:48.690102] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-17T04:41:49.231873] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T04:41:49.490170] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-17T04:41:49.859320] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T04:41:50.290138] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-17T04:41:51.090137] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-17T04:41:51.397477] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T04:41:51.500728] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T04:41:51.838859] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:41:51.848615] [INFO ] [REMOTE ] KRC: Full fetch complete (69351 records). [2025-09-17T04:41:51.848944] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-17T04:41:51.896517] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-17T04:41:52.417710] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-17T04:41:52.417861] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-17T04:41:52.419440] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-17T04:41:52.419555] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-17T04:41:52.421313] [DEBUG] [LOCAL ] KRC: Trimmed 69351 records to 48450 (keeping 200 days of data) [2025-09-17T04:41:52.690973] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-17T04:41:52.765127] [DEBUG] [LOCAL ] KRC: Primary data saved (48450 records). [2025-09-17T04:41:52.765344] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-17T04:41:52.765471] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KRC took 28.4s. Estimated remaining: 2h 48m 33s. Rate: 6.8 symbols/min [2025-09-17T04:41:52.993857] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:53.021326] [DEBUG] [LOCAL ] KREF: Loaded 27305 existing records from primary storage. [2025-09-17T04:41:53.021514] [INFO ] [MAIN ] KREF: Loaded 27305 existing records. [2025-09-17T04:41:53.199488] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:53.199773] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-17T04:41:53.199834] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-17T04:41:53.200430] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-17T04:41:53.200493] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-17T04:41:53.495234] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-17T04:41:53.571377] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:53.820194] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T04:41:53.990350] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T04:41:53.991279] [INFO ] [REMOTE ] KORE: Full fetch complete (6125 records). [2025-09-17T04:41:53.991367] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-17T04:41:54.290596] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-17T04:41:54.357043] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-17T04:41:54.357189] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-17T04:41:54.357404] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-17T04:41:54.357623] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-17T04:41:54.359258] [DEBUG] [LOCAL ] KORE: Trimmed 6125 records to 1956 (keeping 200 days of data) [2025-09-17T04:41:54.373228] [DEBUG] [LOCAL ] KORE: Primary data saved (1956 records). [2025-09-17T04:41:54.373478] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-17T04:41:54.373701] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KORE took 36.4s. Estimated remaining: 2h 48m 18s. Rate: 6.8 symbols/min [2025-09-17T04:41:54.539630] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T04:41:54.602681] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:54.642532] [DEBUG] [LOCAL ] KRG: Loaded 36453 existing records from primary storage. [2025-09-17T04:41:54.642728] [INFO ] [MAIN ] KRG: Loaded 36453 existing records. [2025-09-17T04:41:54.821867] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:54.822114] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-17T04:41:54.822180] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-17T04:41:54.823031] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-17T04:41:54.823106] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-17T04:41:55.095517] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-17T04:41:55.193781] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:55.890161] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-11. [2025-09-17T04:41:56.085837] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:41:56.092501] [INFO ] [REMOTE ] KOS: Full fetch complete (76683 records). [2025-09-17T04:41:56.092688] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-17T04:41:56.496440] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-17T04:41:56.496790] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-17T04:41:56.498271] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-17T04:41:56.498379] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-17T04:41:56.500083] [DEBUG] [LOCAL ] KOS: Trimmed 76683 records to 53081 (keeping 200 days of data) [2025-09-17T04:41:56.701732] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-11. [2025-09-17T04:41:56.814967] [DEBUG] [LOCAL ] KOS: Primary data saved (53081 records). [2025-09-17T04:41:56.815167] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-17T04:41:56.815267] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KOS took 35.8s. Estimated remaining: 2h 48m 3s. Rate: 6.8 symbols/min [2025-09-17T04:41:56.994246] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:56.994842] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-17T04:41:56.995107] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-17T04:41:56.995907] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-17T04:41:57.014811] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-17T04:41:57.015160] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-17T04:41:57.015943] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-17T04:41:57.016872] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T04:41:57.226251] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T04:41:57.442601] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:57.490154] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-11. [2025-09-17T04:41:57.683545] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:41:57.683949] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-11 [2025-09-17T04:41:58.268736] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:41:58.290090] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-17T04:41:59.090169] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-17T04:41:59.821463] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:41:59.890159] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-17T04:42:00.690187] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-17T04:42:00.905951] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:42:00.906329] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-17T04:42:00.965882] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T04:42:00.972413] [INFO ] [REMOTE ] KR: Full fetch complete (77522 records). [2025-09-17T04:42:00.972555] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-17T04:42:01.380321] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-17T04:42:01.380483] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-17T04:42:01.381850] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-17T04:42:01.381934] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-17T04:42:01.383664] [DEBUG] [LOCAL ] KR: Trimmed 77522 records to 53682 (keeping 200 days of data) [2025-09-17T04:42:01.490785] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-17T04:42:01.545791] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:42:01.787866] [DEBUG] [LOCAL ] KR: Primary data saved (53682 records). [2025-09-17T04:42:01.788092] [INFO ] [MAIN ] KR: Full history saved. [2025-09-17T04:42:01.788248] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KR took 38.9s. Estimated remaining: 2h 47m 51s. Rate: 6.9 symbols/min [2025-09-17T04:42:01.961911] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:01.981824] [DEBUG] [LOCAL ] KRO: Loaded 19557 existing records from primary storage. [2025-09-17T04:42:01.982000] [INFO ] [MAIN ] KRO: Loaded 19557 existing records. [2025-09-17T04:42:02.165871] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:02.166165] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-17T04:42:02.166243] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-17T04:42:02.166817] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-17T04:42:02.166895] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-17T04:42:02.295276] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-17T04:42:02.550936] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:03.090183] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-11. [2025-09-17T04:42:03.890209] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-17T04:42:04.146211] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:42:04.146580] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-17T04:42:04.565072] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:42:04.614626] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (3.12 seconds). [2025-09-17T04:42:04.690123] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-17T04:42:05.501100] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-17T04:42:05.507890] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:42:05.665408] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T04:42:06.290149] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-17T04:42:06.340632] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T04:42:07.090155] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-17T04:42:07.888365] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T04:42:07.897786] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-17T04:42:08.607547] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:42:08.674929] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T04:42:08.690136] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-17T04:42:09.490196] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-17T04:42:10.290126] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-17T04:42:10.452724] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:42:11.060511] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T04:42:11.090149] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-17T04:42:11.288504] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T04:42:11.890197] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-17T04:42:12.557312] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T04:42:12.690159] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-17T04:42:12.856986] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T04:42:13.490169] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-17T04:42:13.942703] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:42:14.290183] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-17T04:42:14.605055] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:42:15.090131] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-17T04:42:15.890084] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-17T04:42:16.416800] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T04:42:16.690174] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-17T04:42:17.232962] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T04:42:17.490153] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-17T04:42:18.079787] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T04:42:18.284066] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:42:18.294328] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-17T04:42:18.461482] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T04:42:19.090165] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-17T04:42:19.530444] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T04:42:19.890215] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-17T04:42:20.214313] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T04:42:20.690187] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-17T04:42:21.336413] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:42:21.490156] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-17T04:42:22.297974] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-17T04:42:22.328425] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:42:22.999673] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:42:23.005761] [INFO ] [REMOTE ] KRMN: Full fetch complete (47758 records). [2025-09-17T04:42:23.005938] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-17T04:42:23.095380] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-17T04:42:23.212491] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 148 unique days, need 200 days [2025-09-17T04:42:23.213145] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:42:23.213204] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:42:23.213261] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-17T04:42:23.213344] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-17T04:42:23.213397] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-17T04:42:23.213462] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-17T04:42:23.213562] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRMN took 26.4s. Estimated remaining: 2h 47m 54s. Rate: 6.8 symbols/min [2025-09-17T04:42:23.396786] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:23.426523] [DEBUG] [LOCAL ] KRP: Loaded 26905 existing records from primary storage. [2025-09-17T04:42:23.426816] [INFO ] [MAIN ] KRP: Loaded 26905 existing records. [2025-09-17T04:42:23.615202] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:23.616007] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-17T04:42:23.616124] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-17T04:42:23.617117] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-17T04:42:23.617268] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-17T04:42:23.799773] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:42:23.895851] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-17T04:42:24.045952] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:24.690149] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-11. [2025-09-17T04:42:24.844197] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T04:42:25.061164] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T04:42:25.490148] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-17T04:42:26.030320] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T04:42:26.290172] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-17T04:42:27.090222] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-17T04:42:27.109236] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:42:27.116554] [INFO ] [REMOTE ] KRG: Full fetch complete (70680 records). [2025-09-17T04:42:27.116774] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-17T04:42:27.484181] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T04:42:27.540026] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-17T04:42:27.540614] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-17T04:42:27.541624] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-17T04:42:27.541732] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-17T04:42:27.544796] [DEBUG] [LOCAL ] KRG: Trimmed 70680 records to 49190 (keeping 200 days of data) [2025-09-17T04:42:27.852780] [DEBUG] [LOCAL ] KRG: Primary data saved (49190 records). [2025-09-17T04:42:27.852950] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-17T04:42:27.853068] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRG took 33.5s. Estimated remaining: 2h 47m 41s. Rate: 6.8 symbols/min [2025-09-17T04:42:27.895549] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-17T04:42:28.025075] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:28.072464] [DEBUG] [LOCAL ] KSS: Loaded 39965 existing records from primary storage. [2025-09-17T04:42:28.072679] [INFO ] [MAIN ] KSS: Loaded 39965 existing records. [2025-09-17T04:42:28.251544] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:28.251827] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-17T04:42:28.251897] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-17T04:42:28.252894] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-17T04:42:28.252986] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-17T04:42:28.614986] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:28.634408] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T04:42:28.690077] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-17T04:42:29.451851] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:42:29.490089] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-17T04:42:29.812411] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T04:42:30.290126] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-11. [2025-09-17T04:42:30.507123] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T04:42:31.090159] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-17T04:42:31.890109] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-17T04:42:32.310252] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T04:42:32.413575] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T04:42:32.690167] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-17T04:42:33.276168] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:42:33.490147] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-17T04:42:33.931881] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T04:42:33.935470] [INFO ] [REMOTE ] KRO: Full fetch complete (34478 records). [2025-09-17T04:42:33.935583] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-17T04:42:34.293568] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-17T04:42:34.331415] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-17T04:42:34.331531] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-17T04:42:34.332413] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-17T04:42:34.332475] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-17T04:42:34.333379] [DEBUG] [LOCAL ] KRO: Trimmed 34478 records to 25645 (keeping 200 days of data) [2025-09-17T04:42:34.494108] [DEBUG] [LOCAL ] KRO: Primary data saved (25645 records). [2025-09-17T04:42:34.497917] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-17T04:42:34.498043] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KRO took 32.7s. Estimated remaining: 2h 47m 31s. Rate: 6.8 symbols/min [2025-09-17T04:42:34.666260] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:34.700461] [DEBUG] [LOCAL ] KT: Loaded 33570 existing records from primary storage. [2025-09-17T04:42:34.700691] [INFO ] [MAIN ] KT: Loaded 33570 existing records. [2025-09-17T04:42:34.877714] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:34.877997] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-17T04:42:34.878056] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-17T04:42:34.878880] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-17T04:42:34.878961] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-17T04:42:35.095261] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-17T04:42:35.252407] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:35.386308] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T04:42:35.743172] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:42:35.890182] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-11. [2025-09-17T04:42:36.690151] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-17T04:42:36.792816] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:42:37.137008] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T04:42:37.490161] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-17T04:42:38.290143] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-17T04:42:38.535845] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T04:42:39.090145] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-17T04:42:39.189566] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T04:42:39.811573] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:42:39.890079] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-17T04:42:40.371607] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T04:42:40.690158] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-17T04:42:41.136890] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:42:41.490154] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-17T04:42:42.182069] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T04:42:42.290093] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-17T04:42:42.989101] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:42:43.090121] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-17T04:42:43.849578] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:42:43.890080] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-17T04:42:44.690084] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-17T04:42:45.185835] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T04:42:45.490135] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-17T04:42:45.569146] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:42:45.952954] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:42:45.957578] [INFO ] [REMOTE ] KREF: Full fetch complete (51358 records). [2025-09-17T04:42:45.957780] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-17T04:42:46.301598] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-17T04:42:46.355632] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-17T04:42:46.355791] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-17T04:42:46.356727] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-17T04:42:46.356810] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-17T04:42:46.358662] [DEBUG] [LOCAL ] KREF: Trimmed 51358 records to 36939 (keeping 200 days of data) [2025-09-17T04:42:46.585985] [DEBUG] [LOCAL ] KREF: Primary data saved (36939 records). [2025-09-17T04:42:46.586191] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-17T04:42:46.586328] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KREF took 53.8s. Estimated remaining: 2h 47m 25s. Rate: 6.8 symbols/min [2025-09-17T04:42:46.756700] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:46.786096] [DEBUG] [LOCAL ] KTB: Loaded 30470 existing records from primary storage. [2025-09-17T04:42:46.786260] [INFO ] [MAIN ] KTB: Loaded 30470 existing records. [2025-09-17T04:42:46.966941] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:46.967708] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-17T04:42:46.967805] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-17T04:42:46.968862] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-17T04:42:46.968940] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-17T04:42:47.095003] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-17T04:42:47.147709] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:42:47.376398] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:47.766187] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:42:47.890164] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-17T04:42:48.690151] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-17T04:42:49.321180] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T04:42:49.448531] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:42:49.490128] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-17T04:42:49.614197] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T04:42:50.290132] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-11. [2025-09-17T04:42:51.063862] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:42:51.090082] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-17T04:42:51.618508] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T04:42:51.890163] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-17T04:42:52.406947] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T04:42:52.690212] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-17T04:42:53.490198] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-17T04:42:53.895338] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T04:42:54.258742] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:42:54.290095] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-17T04:42:54.519420] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T04:42:55.090156] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-17T04:42:55.619607] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T04:42:55.627041] [INFO ] [REMOTE ] KT: Full fetch complete (66863 records). [2025-09-17T04:42:55.627258] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-17T04:42:55.897143] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-17T04:42:56.040140] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-17T04:42:56.040249] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-17T04:42:56.041205] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-17T04:42:56.041265] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-17T04:42:56.042697] [DEBUG] [LOCAL ] KT: Trimmed 66863 records to 45727 (keeping 200 days of data) [2025-09-17T04:42:56.327100] [DEBUG] [LOCAL ] KT: Primary data saved (45727 records). [2025-09-17T04:42:56.327275] [INFO ] [MAIN ] KT: Full history saved. [2025-09-17T04:42:56.327381] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KT took 21.8s. Estimated remaining: 2h 47m 17s. Rate: 6.8 symbols/min [2025-09-17T04:42:56.497255] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:56.507593] [DEBUG] [LOCAL ] KTF: Loaded 8672 existing records from primary storage. [2025-09-17T04:42:56.507767] [INFO ] [MAIN ] KTF: Loaded 8672 existing records. [2025-09-17T04:42:56.688206] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:56.688524] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-17T04:42:56.688590] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-17T04:42:56.689044] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-17T04:42:56.689133] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-17T04:42:56.721110] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-17T04:42:57.073171] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:57.111015] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T04:42:57.313021] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:42:57.490204] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-17T04:42:58.099458] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T04:42:58.104505] [INFO ] [REMOTE ] KRP: Full fetch complete (54749 records). [2025-09-17T04:42:58.104782] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-17T04:42:58.295482] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-17T04:42:58.516146] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-17T04:42:58.516287] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-17T04:42:58.517505] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-17T04:42:58.517570] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-17T04:42:58.519142] [DEBUG] [LOCAL ] KRP: Trimmed 54749 records to 38147 (keeping 200 days of data) [2025-09-17T04:42:58.774540] [DEBUG] [LOCAL ] KRP: Primary data saved (38147 records). [2025-09-17T04:42:58.774798] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-17T04:42:58.774929] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KRP took 35.6s. Estimated remaining: 2h 47m 2s. Rate: 6.8 symbols/min [2025-09-17T04:42:58.972271] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:58.973832] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:42:58.974009] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-17T04:42:58.981105] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-17T04:42:58.981591] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-17T04:42:58.981678] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-17T04:42:58.981734] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-17T04:42:58.981779] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-17T04:42:59.148989] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-11. [2025-09-17T04:42:59.416780] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:59.890248] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-17T04:43:00.101336] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T04:43:00.512507] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T04:43:00.690104] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-17T04:43:01.465371] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:43:01.490168] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-17T04:43:01.607379] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T04:43:02.290225] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-17T04:43:03.090284] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-11. [2025-09-17T04:43:03.582842] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T04:43:03.833959] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:43:03.890229] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-17T04:43:04.131618] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T04:43:04.690146] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-17T04:43:05.349075] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:43:05.490179] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-17T04:43:06.290192] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-17T04:43:06.316388] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T04:43:06.722616] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T04:43:06.730819] [INFO ] [REMOTE ] KSS: Full fetch complete (77580 records). [2025-09-17T04:43:06.731061] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-17T04:43:07.097982] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-17T04:43:07.149391] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-17T04:43:07.149766] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-17T04:43:07.151766] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-17T04:43:07.151853] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-17T04:43:07.154958] [DEBUG] [LOCAL ] KSS: Trimmed 77580 records to 53612 (keeping 200 days of data) [2025-09-17T04:43:07.525500] [DEBUG] [LOCAL ] KSS: Primary data saved (53612 records). [2025-09-17T04:43:07.525718] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-17T04:43:07.525839] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KSS took 39.7s. Estimated remaining: 2h 46m 54s. Rate: 6.8 symbols/min [2025-09-17T04:43:07.698215] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:07.744761] [DEBUG] [LOCAL ] KVUE: Loaded 40017 existing records from primary storage. [2025-09-17T04:43:07.745214] [INFO ] [MAIN ] KVUE: Loaded 40017 existing records. [2025-09-17T04:43:07.912793] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-17T04:43:07.977904] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T04:43:07.985968] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:07.995743] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-17T04:43:08.001088] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-17T04:43:08.004730] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:43:08.004896] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-17T04:43:08.008548] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-17T04:43:08.380726] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:08.599938] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T04:43:08.690181] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-17T04:43:09.490212] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-17T04:43:09.587456] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T04:43:10.290150] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-11. [2025-09-17T04:43:10.882176] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:43:11.090183] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-17T04:43:11.890250] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-17T04:43:12.017634] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T04:43:12.157126] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T04:43:12.690178] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-17T04:43:12.880839] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T04:43:13.397274] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:43:13.490209] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-17T04:43:14.290168] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-17T04:43:15.086764] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T04:43:15.095630] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-17T04:43:15.890186] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-17T04:43:16.064803] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:43:16.085964] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T04:43:16.690251] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-17T04:43:16.743188] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:43:17.029311] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T04:43:17.490236] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-17T04:43:18.290165] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-17T04:43:18.729241] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T04:43:18.777499] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:43:19.090184] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-17T04:43:19.446674] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T04:43:19.890245] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-17T04:43:20.690226] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-17T04:43:21.490206] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-17T04:43:21.702777] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:43:21.917887] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T04:43:22.065749] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T04:43:22.071616] [INFO ] [REMOTE ] KTB: Full fetch complete (57069 records). [2025-09-17T04:43:22.071872] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-17T04:43:22.299039] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-17T04:43:22.484905] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-17T04:43:22.485083] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-17T04:43:22.486219] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-17T04:43:22.486288] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-17T04:43:22.488091] [DEBUG] [LOCAL ] KTB: Trimmed 57069 records to 41355 (keeping 200 days of data) [2025-09-17T04:43:22.765156] [DEBUG] [LOCAL ] KTB: Primary data saved (41355 records). [2025-09-17T04:43:22.765371] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-17T04:43:22.765482] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KTB took 36.2s. Estimated remaining: 2h 46m 51s. Rate: 6.8 symbols/min [2025-09-17T04:43:22.945529] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:22.987457] [DEBUG] [LOCAL ] KVYO: Loaded 37611 existing records from primary storage. [2025-09-17T04:43:22.987713] [INFO ] [MAIN ] KVYO: Loaded 37611 existing records. [2025-09-17T04:43:23.098628] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-17T04:43:23.196913] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:23.197303] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-17T04:43:23.197373] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-17T04:43:23.198508] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-17T04:43:23.198587] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-17T04:43:23.613772] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:23.890211] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-11. [2025-09-17T04:43:23.980351] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T04:43:24.148882] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T04:43:24.690227] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-17T04:43:25.446208] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:43:25.490118] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-17T04:43:25.542395] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:43:26.290184] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-17T04:43:26.920476] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T04:43:27.078579] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T04:43:27.090176] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-17T04:43:27.765429] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T04:43:27.766828] [INFO ] [REMOTE ] KUKE: Full fetch complete (8000 records). [2025-09-17T04:43:27.766936] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-17T04:43:27.895244] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-17T04:43:27.957366] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T04:43:27.957703] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:43:27.957762] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:43:27.957812] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-17T04:43:27.957886] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-17T04:43:27.957937] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-17T04:43:27.958010] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-17T04:43:27.958095] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KUKE took 29.2s. Estimated remaining: 2h 46m 39s. Rate: 6.8 symbols/min [2025-09-17T04:43:28.134100] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:28.163963] [DEBUG] [LOCAL ] KW: Loaded 30155 existing records from primary storage. [2025-09-17T04:43:28.164175] [INFO ] [MAIN ] KW: Loaded 30155 existing records. [2025-09-17T04:43:28.350951] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:28.351235] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-17T04:43:28.351301] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-17T04:43:28.352214] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-17T04:43:28.352282] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-17T04:43:28.712589] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-17T04:43:28.720979] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:28.846612] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T04:43:29.490167] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-17T04:43:30.290209] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-11. [2025-09-17T04:43:30.369258] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:43:30.387313] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T04:43:30.389758] [INFO ] [REMOTE ] KTF: Full fetch complete (18455 records). [2025-09-17T04:43:30.389853] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-17T04:43:30.778796] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-17T04:43:30.778962] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-17T04:43:30.780008] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-17T04:43:30.780096] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-17T04:43:30.780886] [DEBUG] [LOCAL ] KTF: Trimmed 18455 records to 13188 (keeping 200 days of data) [2025-09-17T04:43:30.872208] [DEBUG] [LOCAL ] KTF: Primary data saved (13188 records). [2025-09-17T04:43:30.872443] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-17T04:43:30.872565] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KTF took 34.5s. Estimated remaining: 2h 46m 25s. Rate: 6.9 symbols/min [2025-09-17T04:43:31.061596] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:31.078346] [DEBUG] [LOCAL ] KWR: Loaded 12353 existing records from primary storage. [2025-09-17T04:43:31.078532] [INFO ] [MAIN ] KWR: Loaded 12353 existing records. [2025-09-17T04:43:31.099615] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-17T04:43:31.278969] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:31.279404] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-17T04:43:31.279510] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-17T04:43:31.280597] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-17T04:43:31.280697] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-17T04:43:31.671052] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:31.699829] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T04:43:31.890177] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-11. [2025-09-17T04:43:32.690233] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-17T04:43:32.779008] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:43:32.799387] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T04:43:33.490184] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-17T04:43:34.010119] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:43:34.290184] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-17T04:43:35.090126] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-17T04:43:35.125219] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T04:43:35.890196] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-17T04:43:36.131217] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T04:43:36.612235] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:43:36.690116] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-17T04:43:37.182436] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T04:43:37.490138] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-17T04:43:37.672100] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T04:43:38.290144] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-17T04:43:39.090208] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-17T04:43:39.197471] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:43:39.890153] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-17T04:43:40.200268] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:43:40.391689] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T04:43:40.690173] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-17T04:43:41.490204] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-17T04:43:41.627527] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:43:42.024354] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T04:43:42.290164] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-17T04:43:42.482400] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T04:43:43.090183] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-17T04:43:43.890117] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-17T04:43:43.949108] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:43:44.631399] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:43:44.690167] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-17T04:43:45.425254] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:43:45.490084] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-17T04:43:46.179099] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:43:46.290140] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-17T04:43:47.090157] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-17T04:43:47.327309] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T04:43:47.398900] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T04:43:47.890205] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-17T04:43:47.981831] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T04:43:48.690203] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-17T04:43:49.293586] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T04:43:49.490152] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-17T04:43:50.295423] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-17T04:43:50.319478] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T04:43:51.090236] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-17T04:43:51.339679] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:43:51.417427] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T04:43:51.424138] [INFO ] [REMOTE ] KVUE: Full fetch complete (77507 records). [2025-09-17T04:43:51.424425] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-17T04:43:51.819691] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-17T04:43:51.819843] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-17T04:43:51.821275] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-17T04:43:51.821342] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-17T04:43:51.823215] [DEBUG] [LOCAL ] KVUE: Trimmed 77507 records to 53667 (keeping 200 days of data) [2025-09-17T04:43:51.891781] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-17T04:43:52.175931] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-17T04:43:52.176123] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-17T04:43:52.176226] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KVUE took 44.7s. Estimated remaining: 2h 46m 27s. Rate: 6.8 symbols/min [2025-09-17T04:43:52.349447] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:52.371506] [DEBUG] [LOCAL ] KYN: Loaded 22074 existing records from primary storage. [2025-09-17T04:43:52.371728] [INFO ] [MAIN ] KYN: Loaded 22074 existing records. [2025-09-17T04:43:52.550130] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:52.550579] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-17T04:43:52.550765] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-17T04:43:52.551456] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-17T04:43:52.566761] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-17T04:43:52.655267] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:43:52.690533] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-17T04:43:52.958475] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:53.490167] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-11. [2025-09-17T04:43:53.619749] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T04:43:53.779040] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T04:43:54.290192] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-17T04:43:54.890787] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T04:43:55.090179] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-17T04:43:55.369912] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T04:43:55.890245] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-17T04:43:56.481299] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:43:56.488779] [INFO ] [REMOTE ] KW: Full fetch complete (56571 records). [2025-09-17T04:43:56.489083] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-17T04:43:56.695718] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-17T04:43:57.034601] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-17T04:43:57.034774] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-17T04:43:57.035869] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-17T04:43:57.035964] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-17T04:43:57.037940] [DEBUG] [LOCAL ] KW: Trimmed 56571 records to 40623 (keeping 200 days of data) [2025-09-17T04:43:57.289354] [DEBUG] [LOCAL ] KW: Primary data saved (40623 records). [2025-09-17T04:43:57.289542] [INFO ] [MAIN ] KW: Full history saved. [2025-09-17T04:43:57.289662] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KW took 29.3s. Estimated remaining: 2h 46m 15s. Rate: 6.8 symbols/min [2025-09-17T04:43:57.482321] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:57.490164] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-17T04:43:57.514820] [DEBUG] [LOCAL ] L: Loaded 30321 existing records from primary storage. [2025-09-17T04:43:57.515040] [INFO ] [MAIN ] L: Loaded 30321 existing records. [2025-09-17T04:43:57.695488] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:57.696153] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-17T04:43:57.696250] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-17T04:43:57.703692] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-17T04:43:57.716057] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-17T04:43:57.716808] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T04:43:57.805110] [INFO ] [REMOTE ] KVYO: Full fetch complete (70976 records). [2025-09-17T04:43:57.836955] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T04:43:57.840404] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-17T04:43:58.314482] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-17T04:43:58.383776] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:58.504628] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-17T04:43:58.504762] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-17T04:43:58.505744] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-17T04:43:58.505802] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-17T04:43:58.507242] [DEBUG] [LOCAL ] KVYO: Trimmed 70976 records to 49770 (keeping 200 days of data) [2025-09-17T04:43:58.804994] [DEBUG] [LOCAL ] KVYO: Primary data saved (49770 records). [2025-09-17T04:43:58.805182] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-17T04:43:58.805285] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. KVYO took 36.0s. Estimated remaining: 2h 45m 60s. Rate: 6.8 symbols/min [2025-09-17T04:43:58.980103] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:59.001243] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:43:59.043073] [DEBUG] [LOCAL ] LAC: Loaded 39040 existing records from primary storage. [2025-09-17T04:43:59.043308] [INFO ] [MAIN ] LAC: Loaded 39040 existing records. [2025-09-17T04:43:59.097232] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-17T04:43:59.223358] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:59.223665] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-17T04:43:59.223729] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-17T04:43:59.224553] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-17T04:43:59.224617] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-17T04:43:59.579655] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:59.592444] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T04:43:59.890154] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-11. [2025-09-17T04:44:00.300851] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T04:44:00.690168] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-17T04:44:01.490176] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-17T04:44:01.936518] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:44:01.988364] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T04:44:02.180501] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T04:44:02.290116] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-17T04:44:03.090148] [INFO ] [REMOTE ] L: Fetching primary data for 2024-11. [2025-09-17T04:44:03.890215] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-17T04:44:04.465922] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-17T04:44:04.616828] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T04:44:04.690163] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-17T04:44:04.837296] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T04:44:05.490169] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-17T04:44:05.992461] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T04:44:06.290176] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-17T04:44:06.577266] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T04:44:07.090177] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-17T04:44:07.199020] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:44:07.201213] [INFO ] [REMOTE ] KWR: Full fetch complete (23996 records). [2025-09-17T04:44:07.201307] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-17T04:44:07.567603] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-17T04:44:07.567738] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-17T04:44:07.568407] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-17T04:44:07.568472] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-17T04:44:07.569268] [DEBUG] [LOCAL ] KWR: Trimmed 23996 records to 16974 (keeping 200 days of data) [2025-09-17T04:44:07.676931] [DEBUG] [LOCAL ] KWR: Primary data saved (16974 records). [2025-09-17T04:44:07.677134] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-17T04:44:07.677236] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. KWR took 36.8s. Estimated remaining: 2h 45m 51s. Rate: 6.8 symbols/min [2025-09-17T04:44:07.846499] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:07.864056] [DEBUG] [LOCAL ] LAD: Loaded 16994 existing records from primary storage. [2025-09-17T04:44:07.864257] [INFO ] [MAIN ] LAD: Loaded 16994 existing records. [2025-09-17T04:44:07.898394] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-17T04:44:08.050673] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:08.050971] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-17T04:44:08.051041] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-17T04:44:08.051602] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-17T04:44:08.051690] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-17T04:44:08.403506] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:08.535216] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:44:08.690155] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-17T04:44:09.082803] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:44:09.490180] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-17T04:44:10.070759] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:44:10.290205] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-17T04:44:10.953987] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:44:11.090168] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-17T04:44:11.489468] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T04:44:11.890152] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-17T04:44:12.690184] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-11. [2025-09-17T04:44:12.852611] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T04:44:12.903931] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T04:44:13.490114] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-17T04:44:13.878943] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T04:44:14.290168] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-17T04:44:15.037943] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T04:44:15.090097] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-17T04:44:15.473040] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T04:44:15.890143] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-17T04:44:16.445097] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T04:44:16.690173] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-17T04:44:17.108158] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T04:44:17.490187] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-17T04:44:17.613168] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T04:44:18.290197] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-17T04:44:18.746719] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:44:18.750380] [INFO ] [REMOTE ] KYN: Full fetch complete (45296 records). [2025-09-17T04:44:18.750500] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-17T04:44:19.096963] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-17T04:44:19.132046] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-17T04:44:19.132176] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-17T04:44:19.133294] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-17T04:44:19.133378] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-17T04:44:19.134714] [DEBUG] [LOCAL ] KYN: Trimmed 45296 records to 30513 (keeping 200 days of data) [2025-09-17T04:44:19.340835] [DEBUG] [LOCAL ] KYN: Primary data saved (30513 records). [2025-09-17T04:44:19.341041] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-17T04:44:19.341145] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. KYN took 27.2s. Estimated remaining: 2h 45m 45s. Rate: 6.8 symbols/min [2025-09-17T04:44:19.536582] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:19.570215] [DEBUG] [LOCAL ] LADR: Loaded 28533 existing records from primary storage. [2025-09-17T04:44:19.570417] [INFO ] [MAIN ] LADR: Loaded 28533 existing records. [2025-09-17T04:44:19.761055] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:19.761467] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-17T04:44:19.761630] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-17T04:44:19.762365] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-17T04:44:19.762428] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-17T04:44:19.892031] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-17T04:44:19.999897] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T04:44:20.198404] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:20.348132] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:44:20.690141] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-17T04:44:21.245237] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T04:44:21.490109] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-17T04:44:22.290186] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-11. [2025-09-17T04:44:22.651930] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T04:44:22.699547] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T04:44:23.090166] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-17T04:44:23.384395] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T04:44:23.890146] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-17T04:44:24.354608] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T04:44:24.690164] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-17T04:44:24.851397] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T04:44:25.490165] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-17T04:44:26.124481] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:44:26.290141] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-17T04:44:27.090158] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-17T04:44:27.546823] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T04:44:27.585712] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T04:44:27.890154] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-17T04:44:28.414999] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T04:44:28.690180] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-17T04:44:29.490247] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-17T04:44:29.631051] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:44:29.701050] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T04:44:30.290161] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-17T04:44:30.790258] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T04:44:31.090200] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-17T04:44:31.363919] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T04:44:31.890184] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-17T04:44:32.534811] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T04:44:32.690249] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-17T04:44:33.411566] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:44:33.490167] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-17T04:44:34.290116] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-17T04:44:34.521781] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T04:44:35.090207] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-17T04:44:35.147444] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T04:44:35.412835] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T04:44:35.417974] [INFO ] [REMOTE ] L: Full fetch complete (59289 records). [2025-09-17T04:44:35.418132] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-17T04:44:35.813211] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-17T04:44:35.813325] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-17T04:44:35.814223] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-17T04:44:35.814281] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-17T04:44:35.815490] [DEBUG] [LOCAL ] L: Trimmed 59289 records to 40939 (keeping 200 days of data) [2025-09-17T04:44:35.907698] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-17T04:44:36.077832] [DEBUG] [LOCAL ] L: Primary data saved (40939 records). [2025-09-17T04:44:36.078051] [INFO ] [MAIN ] L: Full history saved. [2025-09-17T04:44:36.078184] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. L took 38.8s. Estimated remaining: 2h 45m 44s. Rate: 6.8 symbols/min [2025-09-17T04:44:36.253449] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:36.257084] [DEBUG] [LOCAL ] LANV: Loaded 1929 existing records from primary storage. [2025-09-17T04:44:36.257182] [INFO ] [MAIN ] LANV: Loaded 1929 existing records. [2025-09-17T04:44:36.446861] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:36.447184] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-17T04:44:36.447263] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-17T04:44:36.447500] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-17T04:44:36.447567] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-17T04:44:36.703269] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-17T04:44:36.820066] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:37.145616] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T04:44:37.341386] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:44:37.490084] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-11. [2025-09-17T04:44:37.532858] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T04:44:37.823682] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T04:44:38.290139] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-17T04:44:38.720954] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:44:39.090129] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-17T04:44:39.890139] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-17T04:44:40.221319] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T04:44:40.690158] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-17T04:44:41.262875] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:44:41.490113] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-17T04:44:41.661485] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T04:44:41.665166] [INFO ] [REMOTE ] LAD: Full fetch complete (35322 records). [2025-09-17T04:44:41.665343] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-17T04:44:42.057188] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-17T04:44:42.057310] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-17T04:44:42.058174] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-17T04:44:42.058292] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-17T04:44:42.059284] [DEBUG] [LOCAL ] LAD: Trimmed 35322 records to 24197 (keeping 200 days of data) [2025-09-17T04:44:42.222810] [DEBUG] [LOCAL ] LAD: Primary data saved (24197 records). [2025-09-17T04:44:42.223013] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-17T04:44:42.223163] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LAD took 34.5s. Estimated remaining: 2h 45m 32s. Rate: 6.8 symbols/min [2025-09-17T04:44:42.296694] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-17T04:44:42.403890] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:42.441787] [DEBUG] [LOCAL ] LAR: Loaded 33661 existing records from primary storage. [2025-09-17T04:44:42.442635] [INFO ] [MAIN ] LAR: Loaded 33661 existing records. [2025-09-17T04:44:42.620203] [WARN ] [MAIN ] LAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:42.620456] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-17T04:44:42.620525] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-17T04:44:42.621192] [DEBUG] [LOCAL ] LAR: Deleted primary data file. [2025-09-17T04:44:42.621288] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-17T04:44:42.982533] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:43.011809] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:44:43.090153] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-11. [2025-09-17T04:44:43.278467] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:44:43.278892] [WARN ] [REMOTE ] LAR: No data returned for month 2024-11 [2025-09-17T04:44:43.890119] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-17T04:44:44.080006] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:44:44.080348] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-17T04:44:44.329114] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T04:44:44.690159] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-17T04:44:45.238109] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T04:44:45.490147] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-17T04:44:46.290200] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-17T04:44:46.742603] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T04:44:47.090187] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-17T04:44:47.342762] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T04:44:47.349738] [INFO ] [REMOTE ] LAC: Full fetch complete (75851 records). [2025-09-17T04:44:47.349893] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-17T04:44:47.736031] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-17T04:44:47.736146] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-17T04:44:47.737164] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-17T04:44:47.737226] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-17T04:44:47.738699] [DEBUG] [LOCAL ] LAC: Trimmed 75851 records to 52277 (keeping 200 days of data) [2025-09-17T04:44:47.903458] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-17T04:44:48.064380] [DEBUG] [LOCAL ] LAC: Primary data saved (52277 records). [2025-09-17T04:44:48.064625] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-17T04:44:48.064811] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LAC took 49.3s. Estimated remaining: 2h 45m 21s. Rate: 6.8 symbols/min [2025-09-17T04:44:48.471360] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T04:44:48.506665] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:44:48.690183] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-17T04:44:49.490216] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-17T04:44:50.028283] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T04:44:50.035620] [INFO ] [REMOTE ] LADR: Full fetch complete (54614 records). [2025-09-17T04:44:50.035945] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-17T04:44:50.312055] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-17T04:44:50.417259] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T04:44:50.456123] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-17T04:44:50.456269] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-17T04:44:50.457298] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-17T04:44:50.457379] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-17T04:44:50.459121] [DEBUG] [LOCAL ] LADR: Trimmed 54614 records to 38529 (keeping 200 days of data) [2025-09-17T04:44:50.705422] [DEBUG] [LOCAL ] LADR: Primary data saved (38529 records). [2025-09-17T04:44:50.705661] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-17T04:44:50.705775] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LADR took 31.4s. Estimated remaining: 2h 45m 7s. Rate: 6.8 symbols/min [2025-09-17T04:44:50.827482] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T04:44:51.090155] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-17T04:44:51.890200] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-17T04:44:52.317175] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T04:44:52.693526] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-17T04:44:52.696942] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:44:53.153316] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T04:44:53.490201] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-17T04:44:53.970756] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T04:44:54.290190] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-17T04:44:54.686199] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T04:44:55.090154] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-17T04:44:55.788760] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T04:44:55.790090] [INFO ] [REMOTE ] LANV: Full fetch complete (4252 records). [2025-09-17T04:44:55.790196] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-17T04:44:55.894460] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-17T04:44:56.165290] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-17T04:44:56.165414] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-17T04:44:56.165705] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-17T04:44:56.165779] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-17T04:44:56.166177] [DEBUG] [LOCAL ] LANV: Trimmed 4252 records to 2616 (keeping 200 days of data) [2025-09-17T04:44:56.181220] [DEBUG] [LOCAL ] LANV: Primary data saved (2616 records). [2025-09-17T04:44:56.181299] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-17T04:44:56.181396] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LANV took 20.1s. Estimated remaining: 2h 44m 55s. Rate: 6.9 symbols/min [2025-09-17T04:44:57.607861] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:44:57.617221] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-17T04:44:59.287987] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:44:59.297679] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-17T04:45:00.997881] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:45:01.009125] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-17T04:45:02.848604] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T04:45:02.857840] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-17T04:45:05.385709] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-17T04:45:05.396254] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-17T04:45:07.167936] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T04:45:07.178440] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-17T04:45:08.775620] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T04:45:08.781289] [INFO ] [REMOTE ] LAR: Full fetch complete (52601 records). [2025-09-17T04:45:08.781433] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-17T04:45:08.972857] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 161 unique days, need 200 days [2025-09-17T04:45:08.973446] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:45:08.973521] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:45:08.973580] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-17T04:45:08.973666] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-17T04:45:08.973727] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-17T04:45:08.974196] [DEBUG] [LOCAL ] LAR: Deleted derivative data file. [2025-09-17T04:45:08.974302] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAR took 26.8s. Estimated remaining: 2h 44m 50s. Rate: 6.8 symbols/min [2025-09-17T04:45:09.596538] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.655165] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.682184] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.703446] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.719371] [DEBUG] [LOCAL ] LAW: Loaded 10628 existing records from primary storage. [2025-09-17T04:45:09.719603] [INFO ] [MAIN ] LAW: Loaded 10628 existing records. [2025-09-17T04:45:09.884417] [DEBUG] [LOCAL ] LAZ: Loaded 33463 existing records from primary storage. [2025-09-17T04:45:09.962267] [INFO ] [MAIN ] LAZ: Loaded 33463 existing records. [2025-09-17T04:45:09.954538] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:09.963007] [DEBUG] [LOCAL ] LBRT: Loaded 39400 existing records from primary storage. [2025-09-17T04:45:09.984540] [DEBUG] [LOCAL ] LB: Loaded 27672 existing records from primary storage. [2025-09-17T04:45:09.998872] [INFO ] [MAIN ] LB: Loaded 27672 existing records. [2025-09-17T04:45:09.998997] [INFO ] [MAIN ] LBRT: Loaded 39400 existing records. [2025-09-17T04:45:09.993565] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.009410] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-17T04:45:10.125329] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-17T04:45:10.182950] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-17T04:45:10.556799] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:10.552536] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:10.600240] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.609868] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.615285] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-17T04:45:10.615586] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:10.615657] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-17T04:45:10.636400] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-17T04:45:10.669391] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.669443] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-17T04:45:10.692592] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-17T04:45:10.734823] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-17T04:45:10.763167] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-17T04:45:10.808927] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-17T04:45:10.898410] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-17T04:45:11.304792] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:11.382451] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-11. [2025-09-17T04:45:11.856423] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:11.935327] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:11.900506] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-11. [2025-09-17T04:45:11.939695] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-11. [2025-09-17T04:45:12.022241] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:12.022616] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-11. [2025-09-17T04:45:12.516922] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T04:45:12.520924] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-17T04:45:13.409556] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:45:13.418628] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-17T04:45:13.458369] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T04:45:13.462547] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-17T04:45:13.495126] [INFO ] [REMOTE ]